Guide for User Acceptance Test
Goals
· Confirmation that what we have works for the users
· Confirm that what we have is ready to roll out
· Identify the actual scope we can present when rolling out the system
Requirements for Test
• Distraction-free room
• Booking 2h/user
• Sending an introduction mail to participants
• Users representing different permission levels/user groups - especially for
Salespeople/agents, ideally some new ones
Setup
• Silent room, no distractions
• Users should bring their own equipment, so they are familiar with the hardware and have a
realistic experience
• One or more users can work at the same time, one or two people from our side hover around
to help/answer questions
• Markos facilitates, Simon and Mikkel support with specific questions
Test Guide
Introduction (approx. 5 minutes)
The test will be conducted in two phases:
1. Validating areas within the March release scope
2. Feedback on WiP areas
For the Validation of the March release: We will explain what the scope of it is through presenting a
task, and you will have the opportunity to try out the flow independently with our support.
For the WiP areas: we would like to guide you in exploring some of the other areas that are nearing
completion, and hear how do they fit in your workflow.
In both cases we would like if you could use your own equipment that you are familiar with, so you
can also get a realistic view of how things will look like.
You are welcome to poke around freely, but we are here to help if you get stuck with anything.
Validating March Release (approx. 60 minutes)
Introduction
• Now we will look at the areas that we expect to release in March for a pilot programme.
• This means that these areas should be already in a satisfactory state to do what you need
them to do
• You are free to try to complete the task independently, but we are here to guide you if you
need it
• Some things you come up with may be outside of the scope, I’ll take a note of them and
we’ll go through them in the next part
Task 1a: Placing a presale Order (internally “Sales Visit”)
• Do you place orders in your work? Great, then you already know the gist of it!
• By following the button “Sales Visit”, you can check out how to put in an order for a
customer
• Try putting in an order for presale with a couple of items for customer “X” – feel free to
explore within the area!
Task 1b: Placing a stock Order (internally “Sales Visit”)
• Now let’s try something with a stock order?
• Try putting in a stock-order with a couple of items for customer “X” in a similar way with
before!
Task 1c: Placing a combined Order (internally “Sales Visit”)
• In SALES, you can do a combination order with stock and presale!
• Try putting in a combination order with a couple of items for customer “X” in a similar way
with before!
Allow for the tasks to complete, support if necessary before debriefing
• What was most difficult?
• What did you like most about it?
• Do you think you have what you need here to put in an order?
Task 2: View an order
• Putting in an order is of course only half the battle – we need to be able to follow along with
the order, right?
• You will of course be able to view all orders you put in in SALES as well
• Try to check out the Orders page and look at the orders that you just created and some of the
previous orders for this customer
Allow for the task to complete, support if necessary before debriefing
• What was most difficult to navigate?
• What did you like most about it?
• What else do you think would be nice to know about orders?
Task 3: Create a customer
• We are also going to enable you to create customers within SALES
• When/how do you usually create customers?
• In SALES, you can do this from the “Customers” page here
• Try and create a customer!
Allow for the task to complete, support if necessary before debriefing
• What was most difficult?
• What did you like most about it?
• Do you think you have what you need here to create a customer?
Task 4: B2B shop
• Customers are also able to put in their own orders through the B2B shop
• It is very similar in looks to the one in SALES, but is specifically developed to work better
for customers
• You can navigate to url and log in with user details to try it out
• Try to explore around and put in an order
Allow for the task to complete, support if necessary before debriefing
• What was most difficult?
• What did you like most about it?
• Do you think customers will be able to navigate this?
Checking on WiP (approx. 45 minutes)
• We can start by talking about some of the points that you brought up
We go through some of the things that they talked about that are not part of the March release plan
• Is there anything else that you would like to try doing in SALES that you do in your work
that is not within the March scope?
We encourage them to come up with some of the most important things that they do, and show them
how to do them if we have something – if not, we can encourage them with further questions:
• What are the things that you find most difficult in the current system you are using?
• Is there anything in specific that you would like to see in SALES in the future?
• What did you like the most overall in SALES?
Finishing up
• Do you have any questions for us?
• Would you mind sharing your contact details so we can ask you some questions in the
future?
• Thank you for your participation and good luck with the fair!
Post-test
After the test, we will analyse the outcomes in the following ways:
March Release Confirmation
• Look at the overall sentiment about the areas that we plan to release in March
• Is there anything that we need to prioritise in fixing before release?
• What are things that we should plan to fix after release?
• What are the things that we are not planning to implement in SALES for the near future?
Other feedback analysis
• What where the things the users came up as important to have?
• What specific feedback did the users have to the areas that we showed them?
• What are things that we need to prioritise in finalising and deploying asap after the March
release?
• What are things that we did not anticipate, but think should be within the scope of SALES in
the near future?
• What are things that we did not anticipate, but are not within the scope of SALES in the near
future?
• What are some long-term pointers that we got from this test?
