chevron_left chevron_right
Login Register invert_colors photo_library

Stay updated and chat with others! - Join the Discord!
Thread Rating:
  • 1 Vote(s) - 5 Average

How does google know my bot is a bot? filter_list
RE: How does google know my bot is a bot? #9
(06-25-2016, 04:58 PM)Shinoa Wrote:
(06-25-2016, 02:40 PM)m0dem Wrote: Selenium and mechanize are the real deal.  I was programming a web bot and I went through the old-fashioned HTTP modules (urllib...), but I kept getting blocked by anti-bot stuff until I used Selenium webdriver (and some mechanize).

Exactly this. Selenium is definitely the route you want to take, as you don't need to spoof anything like user agents; it runs the supplied browser and uses hooks to interact with whatever page you feed it. It's also has a super simple and robust API, so I'd jump right into it if I were you.

And also you can make it so the brower doesn't actually pop up onto your screen (if you don't want that). Google about a "headless" Selenium web driver thingy. Biggrin


Messages In This Thread
RE: How does google know my bot is a bot? - by m0dem - 07-03-2016, 05:19 AM

Users browsing this thread: 1 Guest(s)