+- Sinisterly (https://sinister.ly)
+-- Forum: Sharing (https://sinister.ly/Forum-Sharing)
+--- Forum: Programs (https://sinister.ly/Forum-Programs)
+--- Thread: Tutorial Why use proxy IPs for crawling? (/Thread-Tutorial-Why-use-proxy-IPs-for-crawling)
Why use proxy IPs for crawling? - Seashell - 11-21-2024
1、Slow down the crawling speed, reduce the pressure caused by the target website;
2、Proxy IP can play the role of the middle layer, the use of proxy IP can be more secure access to the global public web pages, more efficient data collection;
3, of course, not all proxy IP can play this role. Proxy IP is divided into two kinds: high anonymity and transparent (ordinary anonymity is also considered transparent); transparent proxy IP server-side to see your real IP and proxy IP, high anonymity proxy IP server-side can only see the proxy IP. so, it is best to use high anonymity proxy IP.