+- Sinisterly (https://sinister.ly)
+-- Forum: Coding (https://sinister.ly/Forum-Coding)
+--- Forum: Python (https://sinister.ly/Forum-Python)
+--- Thread: [Release] Lightening Scrapper 1.0 (/Thread-Release-Lightening-Scrapper-1-0)
[Release] Lightening Scrapper 1.0 - 3SidedSquare - 11-07-2013
Hey guys! I finally got off my lazy ass and finished up some scripts I had rotting on my hard drive. A little (long) while ago, I posted a beta for a set of scripts I dub "Lightening Scrapper". These scripts can check massive* lists of proxies for ones that are still working. For the GUI, you will need PyQt4. You can still use it without PyQt4 though. Have a demo!
Demo
All files zip'd
Source:
proxyscrapper.pyw
scrappergui.pyw
*Lightening scrapper becomes unstable with lists of 50kb or more. As far as I can tell it's a problem with PyQt and the Gui, you can bypass the limit by using the proxyScrapper class directly.
Code:
proxyScrapper.scrapper(string fileName,int maxThreads, None,int delay)RE: [Release] Lightening Scrapper 1.0 - Sir - 11-07-2013
For the purpose of branding and promotion(if you care about such a thing) you ma want to rename this to "Lightning Scraper" since your current name has spelling errors.
Other than that nice release, I use scrapebox to handle my proxies so I don't really need it, but for those people who can't shell out 100$, this looks to be a pretty good alternative. Could be simplified though. People love simplicity.
RE: [Release] Lightening Scrapper 1.0 - Eclipse - 11-07-2013
Wow I was just thinking about this yesterday!
RE: [Release] Lightening Scrapper 1.0 - 3SidedSquare - 11-10-2013
(11-07-2013, 05:55 AM)Sir Wrote: For the purpose of branding and promotion(if you care about such a thing) you ma want to rename this to "Lightning Scraper" since your current name has spelling errors.
Other than that nice release, I use scrapebox to handle my proxies so I don't really need it, but for those people who can't shell out 100$, this looks to be a pretty good alternative. Could be simplified though. People love simplicity.
I wanted to, but then that name was taken, so I just put another p in there and called it a day.
RE: [Release] Lightening Scrapper 1.0 - Nyx - 11-10-2013
(11-10-2013, 08:45 PM)3SidedSquare Wrote: I wanted to, but then that name was taken, so I just put another p in there and called it a day.
I think he is talking about how you spelt "Lightning", not scraper.