Advertisement
If you have a new account but are having problems posting or verifying your account, please email us on hello@boards.ie for help. Thanks :)
Hello all! Please ensure that you are posting a new thread or question in the appropriate forum. The Feedback forum is overwhelmed with questions that are having to be moved elsewhere. If you need help to verify your account contact hello@boards.ie

Private Beta Testing

Options
  • 08-03-2016 10:41am
    #1
    [Deleted User]
    Posts: 0 ✭


    Looking to do a large private Beta test on some new software - 1000+ testers. Looking around can only seem to find companies offering 50-100 testers. Does anyone know of any companies offering larger tests like I'm looking for or does such a service not exist?


Comments

  • Options
    #2
    Graham
    Moderators, Society & Culture Moderators Posts: 17,642 Mod ✭✭✭✭Graham


    What sort of software, web/PC/mobile?

    Are you planning to provider your own testers or is that the bit you're struggling with?


  • Options
    #3
    [Deleted User]
    Posts: 0 ✭ [Deleted User]


    Graham wrote: »
    What sort of software, web/PC/mobile?

    Are you planning to provider your own testers or is that the bit you're struggling with?

    Its for IOS, Android and Web same app across all 3 platforms.

    I was just told that you could get big batches of thousands of Beta testers and pay for it instead of doing the standard beta testing methods. I don't want to Beta test with the public really.
    But my research hasn't been able to come up with much other then companies offering 20-50 testers


  • Options
    #4
    [Deleted User]
    Posts: 5,121 ✭✭✭ [Deleted User]


    Get them to do it ten times?


  • Options
    #5
    [Deleted User]
    Posts: 0 ✭ [Deleted User]


    Deleted User wrote: »
    Get them to do it ten times?

    I want them all on the system at the same time clicking and puling data to see how we hold up


  • Options
    #6
    Graham
    Moderators, Society & Culture Moderators Posts: 17,642 Mod ✭✭✭✭Graham


    This might be worth a look:

    https://betafamily.com

    Can I ask why you need so many Beta testers, 1000+ is rather a large number. If you're trying to stress test your infrastructure there are other ways to simulate loads.


  • Advertisement
  • Options
    #7
    [Deleted User]
    Posts: 0 ✭ [Deleted User]


    Graham wrote: »
    This might be worth a look:

    https://betafamily.com

    Can I ask why you need so many Beta testers, 1000+ is rather a large number. If you're trying to stress test your infrastructure there are other ways to simulate loads.

    Well maybe I'm misinformed and going down the wrong path for this. I basically want to do a lot of testing without exactly putting it out to the public for testing. As much as is possible and reasonable. If you have some other suggestions let me know.


  • Options
    #8
    Graham
    Moderators, Society & Culture Moderators Posts: 17,642 Mod ✭✭✭✭Graham


    What are you trying to test?

    The functionality of the app, i.e. it works as you expect (no bugs) and the users can't break it.
    The backend infrastructure can cope with large volumes of users (if you have any back-end infrastructure).
    Something else app specific e.g. user to user communication.....


  • Options
    #9
    [Deleted User]
    Posts: 0 ✭ [Deleted User]


    Graham wrote: »
    What are you trying to test?

    The functionality of the app, i.e. it works as you expect (no bugs) and the users can't break it.
    The backend infrastructure can cope with large volumes of users (if you have any back-end infrastructure).
    Something else app specific e.g. user to user communication.....

    All of the above, plus wallet integration and payment processes.


  • Options
    #10
    bpmurray
    Registered Users Posts: 1,275 ✭✭✭bpmurray


    Sounds like you need to do two sets of testing. You need system testing with LoadRunner, connecting perhaps 100000 users simultaneously (I wouldn't start with that, but slowly work up to it), and functional beta testing, where some 50 people could hammer on the app and do silly things like normal users, to see if they can break it. The high numbers are usually used for stress testing, while the live testers are for checking how idiot-proof it is.


  • Options
    #11
    Graham
    Moderators, Society & Culture Moderators Posts: 17,642 Mod ✭✭✭✭Graham


    what bpmurray said +1


  • Advertisement
  • Options
    #12
    [Deleted User]
    Posts: 0 ✭ [Deleted User]


    bpmurray wrote: »
    Sounds like you need to do two sets of testing. You need system testing with LoadRunner, connecting perhaps 100000 users simultaneously (I wouldn't start with that, but slowly work up to it), and functional beta testing, where some 50 people could hammer on the app and do silly things like normal users, to see if they can break it. The high numbers are usually used for stress testing, while the live testers are for checking how idiot-proof it is.

    We decided after meetings today with our partners on this that I would do a non live testing of 10 users at a time on the different formats, and do it twice for each.
    Our partner which specialises in lead generation and acquisition is going to do the live testing whereby they will put 1000 people on the app and test it Live. So sounds similar to what you suggest. Good advice


Advertisement