Basic Python requests
Proxy Setup
import requests
proxies = {
"http": "http://username:password@proxy.squidproxies.com:8907",
"https": "http://username:password@proxy.squidproxies.com:8907"
}
res = requests.get("https://api.ipify.org", proxies=proxies)
print("Proxy IP:", res.text)
Importing a Proxy List for Bulk or Rotation
with open("proxies.txt") as f:
proxy_list = [line.strip() for line in f if line.strip()]
Use this with a rotation or retry handler for scalable applications.
📍 Tip: Deduplicate, validate, and randomize your proxy list before use.
Proxy Integration Guides by Language
Proxy Rotation & Session Strategy at Scale
- Time-Based Rotation (Sticky Sessions)
- Residential proxies rotate ~every 10 minutes
- Ideal for sessions (login, carts, dashboards)
- IP remains consistent during short sessions
- Request-Based Rotation (Per Request)
- Datacenter proxies rotated per-request
- Ideal for public scraping, SEO audits, SERP monitoring
📍 Reference: Rotation & Session Management Guide
Scaling Tips for Scrapers & Bots
- Assign 1 proxy per thread or browser instance
- Don’t send more than 10–50 requests per proxy per target (depends on sensitivity)
- Rotate User-Agents with IPs to avoid fingerprinting
- Use headers, timeouts, and delays to reduce detection
Next Steps for Optimizing Proxy Usage
You’re now fully connected and verified. From here, you can:
- Enable automatic proxy rotation
- Implement [sticky sessions] for account-level workflows
- Optimize your scraping with header spoofing and retries
More Guides: