chevron_left chevron_right
Login Register invert_colors photo_library


Stay updated and chat with others! - Join the Discord!
Thread Rating:
  • 1 Vote(s) - 5 Average


How does google know my bot is a bot? filter_list
Author
Message
RE: How does google know my bot is a bot? #6
(06-25-2016, 02:40 PM)m0dem Wrote: Selenium and mechanize are the real deal.  I was programming a web bot and I went through the old-fashioned HTTP modules (urllib...), but I kept getting blocked by anti-bot stuff until I used Selenium webdriver (and some mechanize).

Exactly this. Selenium is definitely the route you want to take, as you don't need to spoof anything like user agents; it runs the supplied browser and uses hooks to interact with whatever page you feed it. It's also has a super simple and robust API, so I'd jump right into it if I were you.

[+] 1 user Likes Inori's post
Reply




Messages In This Thread
RE: How does google know my bot is a bot? - by Inori - 06-25-2016, 04:58 PM



Users browsing this thread: 1 Guest(s)