Login Register






Thread Rating:
  • 0 Vote(s) - 0 Average


Tutorial Selenium tut for scraping filter_list
Author
Message
RE: Selenium tut for scraping #6
(08-27-2016, 02:33 PM)Ao- Wrote:
(08-27-2016, 12:05 PM)BORW3 Wrote:
(08-26-2016, 04:54 PM)Ao- Wrote: I can't get a great look at the code since I'm on mobile, but you should methodize the program (i.e., use methods to split it into chunks) and let it take command line arguments (the String[] args in main) to scrape the user's desired site. Also, with sites using couldflare, you need to give it a few seconds to pass the DDoS protection page.




After compiling ("creating", in your terms) the program, it will work on any computer you use it on. That's why Java requires import statements for everything: import statements tell the compiler what to include in the final product. Additionally, since Java is completely cross-platform, you can run it on any computer that has Java installed, not just PC.

Does Selenium support javascript input on submit buttons? Because I tried using HTMLUnit and it didn't submit my requests on clicking buttons with it, I read I found that if the website had javascript errors then it would'nt load and work properly. So Does Selenium have this same problem?

I mainly use the Python bindings for selenium, so I'm not sure if it's a Java-specific issue, but any JavaScript events/actions/listeners should work if they're put together correctly

Okay, I have tried it, works better with javascript than HTMLUnit ever did. I also tried creating a youtube bot to rack up views with Selenium. I used HtmlUNitDriver wih Selenium and a get() to a video page, i didn't add the web views, but opening the link with firefox normally worked fine. So.... Wondering if you can assist me here.

Reply





Messages In This Thread
Selenium tut for scraping - by Riddle - 08-08-2016, 02:19 AM
RE: Selenium tut for scraping - by BORW3 - 08-26-2016, 09:03 AM
RE: Selenium tut for scraping - by Inori - 08-26-2016, 04:54 PM
RE: Selenium tut for scraping - by BORW3 - 08-27-2016, 12:05 PM
RE: Selenium tut for scraping - by Inori - 08-27-2016, 02:33 PM
RE: Selenium tut for scraping - by BORW3 - 08-29-2016, 01:54 PM
RE: Selenium tut for scraping - by Inori - 08-29-2016, 04:22 PM
RE: Selenium tut for scraping - by Ex094 - 08-29-2016, 03:34 PM
RE: Selenium tut for scraping - by Wildfire - 08-30-2016, 04:03 AM
RE: Selenium tut for scraping - by BORW3 - 08-31-2016, 09:12 AM



Users browsing this thread: 1 Guest(s)