[Cyb3rNuX]

I'm just curious, does search engine for crawling exist?

Basically a search engine (or api at least) that can do unlimited searches (without proxy etc) without blocking/blacklisting my IP?

As far as i know, google has search limits, so other "popular" search engines.

Any suggestions?

[Slacker]

Google is one hell of a web site brohamski... Just throwing that out there lol

https://www.webcrawler.com/
https://www.deepcrawl.com
https://scrapy.org/
monstercrawler.com
nutch.apache.org/

or develop your own:
https://www.google.com/url?sa=t&rct=j&q=...6hW9uXKGpg

[Cyb3rNuX]

Google is one hell of a web site brohamski... Just throwing that out there lol

https://www.webcrawler.com/
https://www.deepcrawl.com
https://scrapy.org/
monstercrawler.com
nutch.apache.org/

or develop your own:
https://www.google.com/url?sa=t&rct=j&q=...6hW9uXKGpg

Thanks, i'll test those