Advertisement
If you have a new account but are having problems posting or verifying your account, please email us on hello@boards.ie for help. Thanks :)
Hello all! Please ensure that you are posting a new thread or question in the appropriate forum. The Feedback forum is overwhelmed with questions that are having to be moved elsewhere. If you need help to verify your account contact hello@boards.ie

Java HTML Scraping 403 error

Options
  • 09-02-2009 4:25pm
    #1
    simonw
    Registered Users Posts: 647 ✭✭✭


    Hi everyone,
    I'm trying to extract the page source of a google query and store the source in a stringbuffer, but i keep getting a Http 403 error. Is there a way to set the user agent or something in java so i can actually access the page source? The method works fine on normal websites, so i assume its some sort of anti-bot measure. Is there a way to get around it?

    Thanks,

    Simon

    ps I can post code if you need it but i'm more just posting to see if it's possible to do with java


Comments

  • Options
    #2
    simonw
    Registered Users Posts: 647 ✭✭✭simonw


    Mods can close the thread now, i found a solution myself


  • Options
    #3
    Páid
    Registered Users Posts: 916 ✭✭✭Páid


    I think you should post the solution that worked for you, if only for the benefit of others who may have the problem in the future.


Advertisement