HOW TO Set up an Unmoderated Usability Test with UXprobe

As this article is a bit long, feel free to jump along using the table of content underneath:

1. Create a new test project
2. Define your test project
3. Complete your test project info
4. Describe your tasks and questions:
a. Set the context of the test
b. Create tasks and associated questions
5. Create the post-test survey
6. Set up your invitations
7. Preview your usability test
8. Launch your usability test


First of all, please, log in into your UXprobe account. Now you can start!

1. Create a new test project


Click on the blue button “New Project”.

2. Define your test project


  • Give a name to your project and attribute it a version. See the examples underneath to understand how the versions can be used.
  • Or copy an existing project (you can select from the drop down menu).
  • Click Create Project.

Title: British Museum website            Version: October 2016
Title: Museums in UK                         Version: British Museum
British Museum                         Version: Prototype #1

3. Complete your test project info


  • Fill in the URL for your HTML website or prototype. Use https if possible; it will provide a better experience for your test users.
  • Select the language of your test. UXprobe provides the test environment in 5 languages (English, French, Dutch, German, Spanish).
  • Click Save & Next.

4. Describe your tasks and questions

For that part, we strongly recommend to write down your goals for the test and the scenario in advance.

You can download our free Word document template to help you prepare this.

a. Set the context of the test


EXAMPLE 1 – For a test user that still needs a basic introduction to the test concept
You have been invited by the British Museum to test their new website. They would like you to perform a test where you will be asked to find some information on their website.

EXAMPLE 2 – For a test user that already has been introduced to the test concept, and just need to understand the mood of the test
You’re in holiday in July in London, you’ve planned all your visits and you would like to visit the British Museum on a Tuesday. Just to be sure, you would like to check the opening hours of the museum.

b. Create tasks and associated questions


Click on “Edit”.
In the next window (Edit Task), you can fill in all the details for your task scenario and questions.

You will go through the following steps (click to jump ahead):

  1. Task title & instructions
  2. Verification question: To verify if participant completed the task successfully.
  3. Question to be asked after a successful test: What does the participant think of the task after successful completion?
  4. Question to be asked after a failed/abandoned testWhy did the participants abandon the task?




  • Give your task a title. This will be seen only by you.
  • Optional: Start URL is useful for example, if you want your participants to start a second task on a specific page (not the one they ended up at the end of the first task).
  • Write down instructions for the participants. This text will appear in the pop-up window when the participant starts the test. It will also stay at the top of the window while the participants  performs the task.




This question is important. Sometimes a participant will think he has completed the task successfully, but it is not the case. UXprobe’s system will automatically check whether or not the test participant was able to successfully complete the task.

  • Write down your question, provide different answers (for example: 1 correct, 2 wrong – you can add more if you want) and select the correct answer in the dropdown menu.

Question: What are the opening hours on a Tuesday in July?
Multiple answers: 10.00-17.30 / closed / 10.00-20.30
Right answer: 10.00-17.30


When people have successfully completed a task, it’s time to gather feedback about the task.


  • Use the default question, which is the basic one to collect satisfaction feedback: “Overall, how easy or difficult was it to perform the task?”
  • Or customize the question and all parameters: text of the question, type of the question, prepared answers, criterium for that question to be shown.


  • Use the default question: “Sorry you had to abandon the task, can you tell us why?”
  • Or customize the question and parameters.
  • Once you’re done with the questions, save the task by clicking “Save task”.

Back to the Project panel, you have an overview of your project so far. You are in the second tab “Tasks”.

  • To add a new task, click the “Add Task” button, otherwise just go to the “Survey” tab.

5. Create the post-test survey

The post-test survey is useful to get more insights on your test participants’ preferences.


  • Use the default question or customize it.

Would you recommend our service?

What is the thing that you liked the most?

What could we improve according to you?

6. Set up your invitations


  • Set up a limit to the number of tests you want to be made. Very useful if you invite test users through a social media and want to limit the number of people that will be able to perform a test.
    When the limit number is reached, new incoming testers will receive a message: “Thank you for your willingness to join our test. Unfortunately the maximum number of participants who can perform this test is already reached. We hope you are able to join next time!”

7. Preview your usability test


  • Before saving your project, you can preview it. A preview will not record the session.

It is really important to preview your test. It gives you a good sense of it, how it works, how well the tasks and questions are written.
You can even share the link of the preview with your colleagues to get their input.

8. Launch your usability test


  • Save your project.
  • Change the status of you project from Draft to Active by clicking the blue button “Draft” and selecting “Active” in the pop-up window.
  • A draft project can still be edited, an active project is locked to edits. You can change the status whenever you want.

  • Once your test project is active, copy the link for this usability test and paste it in an email or share it through your social media accounts (Twitter, Facebook, G+ or LinkedIn).

Happy testing!