+- Sinisterly (https://sinister.ly)
+-- Forum: Computers (https://sinister.ly/Forum-Computers)
+--- Forum: Networking (https://sinister.ly/Forum-Networking)
+---- Forum: Anonymity (https://sinister.ly/Forum-Anonymity)
+---- Thread: Help! an extension that automatically switch the proxy when I scrape a website (/Thread-Help-an-extension-that-automatically-switch-the-proxy-when-I-scrape-a-website)
Help! an extension that automatically switch the proxy when I scrape a website - TropMuch - 03-19-2022
Hi dear Sinsiters,
I am newbie in the domain and I need the expert members' help
I'm scraping data from a website, that later hide its data from non US members.
Since I'm not yet a professional, I use only an extension on my browser to have a US Ip.
The issue is that though I use the US-ip, the website hide the content from many links I visit while scraping.
The solution I can think of it is that I have to install an extension on my browser so that any time my scraping tool visit an URL from the website, the extension change the Ip from an US proxy list.
My question is do you have any suggestion for such extension, or do you have better ideas ?
Thank you in advance for your consideration and your help, I appreciate a lot
RE: Help! an extension that automatically switch the proxy when I scrape a website - mothered - 03-19-2022
Quote:I use only an extension on my browser to have a US Ip.Have you tried using a VPN, and changing US servers In different localities?
RE: Help! an extension that automatically switch the proxy when I scrape a website - TropMuch - 03-19-2022
The Vpn that I a have already chose allow me to visit all the URL list with one US-ip, and the website is able to hide the data when it detect the scraper bot...
I cannot find an Vpn extension that can change the ip which each URL of the website