Advertisement
If you have a new account but are having problems posting or verifying your account, please email us on hello@boards.ie for help. Thanks :)
Hello all! Please ensure that you are posting a new thread or question in the appropriate forum. The Feedback forum is overwhelmed with questions that are having to be moved elsewhere. If you need help to verify your account contact hello@boards.ie
Hi there,
There is an issue with role permissions that is being worked on at the moment.
If you are having trouble with access or permissions on regional forums please post here to get access: https://www.boards.ie/discussion/2058365403/you-do-not-have-permission-for-that#latest

Scrape eir(com) DSLStats

  • 18-09-2017 4:17pm
    #1
    Johnboy1951
    Registered Users, Registered Users 2 Posts: 14,040 ✭✭✭✭


    I use Linux, hence the reason this post is in this section.

    dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?username=<phone number>&password=<account number>&sid=<some sequence of letters>

    Above is the format of a URL to view the usage statics for a DSL broadband account on an eir line.

    What I would like to do is to monitor that usage without using a browser. I expect that wget with some options or such might manage to scrape the numbers, but I have failed to get any information so far.

    Has anyone with eir broadband done this?
    If so, care to share how?

    I am clueless regarding web things so have no idea what I am doing.

    Any help appreciated.


Comments

  • #2
    [Deleted User]
    Posts: 11,614 ✭✭✭✭ [Deleted User]


    Johnboy1951 wrote: »
    I use Linux, hence the reason this post is in this section.

    dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?username=<phone number>&password=<account number>&sid=<some sequence of letters>

    Above is the format of a URL to view the usage statics for a DSL broadband account on an eir line.

    What I would like to do is to monitor that usage without using a browser. I expect that wget with some options or such might manage to scrape the numbers, but I have failed to get any information so far.

    Has anyone with eir broadband done this?
    If so, care to share how?

    I am clueless regarding web things so have no idea what I am doing.

    Any help appreciated.

    I could write a scraper for you in python. It wouldnt take very long. However I dont have an eir account.

    Could you save the webpage and send it to me for testing?


  • #3
    Johnboy1951
    Registered Users, Registered Users 2 Posts: 14,040 ✭✭✭✭Johnboy1951


    Deleted User wrote: »
    I could write a scraper for you in python. It wouldnt take very long. However I dont have an eir account.

    Could you save the webpage and send it to me for testing?

    Thanks, that would be great.

    I hope this is what you mean

    https://www.dropbox.com/deleted

    Let me know if there is something else.

    Thanks.


  • #4
    Johnboy1951
    Registered Users, Registered Users 2 Posts: 14,040 ✭✭✭✭Johnboy1951


    I seem to have found the correct means of getting the info using wget.

    I had been using this form of URL
    wget dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?username=<phone number>&password=<account number>

    When I changed it (after lots of trial and error) to
    wget --post-data='username=<phone number>&password=<account number>' dslstats.eir.ie/commoncgi/dslstats/showstats.cgi?

    I got the page saved.

    I can then extract the stats info from the saved page.

    Thanks for reading, and particular thanks to denartha for the really kind offer to write a python script for me.

    HappyChappy :D


Advertisement