KEMBAR78
AI Chatbot Testing Report: All Test Results Are Based Upon Excel Files I Uploaded 1. Tested Our Bot's Conversational Flow | PDF | Internet Bot | Systems Science
Scribd
Upload
707 views2 pages

AI Chatbot Testing Report: All Test Results Are Based Upon Excel Files I Uploaded 1. Tested Our Bot's Conversational Flow

The document summarizes the results of testing a chatbot. It describes how the chatbot was tested on its conversational flow, critical use cases, and edge cases, and was found to understand questions, respond promptly and accurately. A custom domain-specific test was also run involving questions about user experience challenges, best practices for conversational design, and how to design natural conversations. The chatbot was evaluated on 7 metrics including understanding, answering, navigation, and personality, and was found to need improvement on personality and error management. Errors occurred including handling large files, only accepting one Excel file type, and needing more specific questions and answers.

Uploaded by

Harsh Ajmera
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
707 views2 pages

AI Chatbot Testing Report: All Test Results Are Based Upon Excel Files I Uploaded 1. Tested Our Bot's Conversational Flow

The document summarizes the results of testing a chatbot. It describes how the chatbot was tested on its conversational flow, critical use cases, and edge cases, and was found to understand questions, respond promptly and accurately. A custom domain-specific test was also run involving questions about user experience challenges, best practices for conversational design, and how to design natural conversations. The chatbot was evaluated on 7 metrics including understanding, answering, navigation, and personality, and was found to need improvement on personality and error management. Errors occurred including handling large files, only accepting one Excel file type, and needing more specific questions and answers.

Uploaded by

Harsh Ajmera
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 2

AI Chatbot Testing Report

In this respect, here’s a chatbot testing checklist — tools, ground-rules, best practices, techniques, key
considerations — aimed at helping us to set our own standardized testing plan.
All Test Results are based upon Excel Files I uploaded
1. Tested Our Bot’s Conversational Flow
a) Start with the broad – Yes
b) User-greeting questions – Yes
c) Critical use cases (or chatbot testing scenarios) – Yes
d) Then gradually tackle the edge cases – Yes
Our list of questions, as this stage of our chatbot testing process, included:
 Does our chatbot understand the user’s questions? – Yes
 Does it respond promptly to them? – Yes
 Are its responses accurate enough and relevant? – Yes
 Are there enough conversation steps or… too many? – Yes
 Does it keep the user engaged? – Yes

2. Runned a Custom, Domain-Specific Test

Now, I can imagine that including every single expression specific to our field and every possible question
related to our services/product is… mission impossible.
And yet, we can still provide broad classes when setting your context-specific questions for the bot to answer
to. Do pay great attention to how we formulate them and to what niche terms our include here:

a) what are the user experience challenges to expect when designing conversational user


interfaces (CUIs)?

b) what are the best practices to adopt for creating state of art conversational experiences?

c) how do we design a... conversation, after all? One that's natural, seamless, quick and ideally
convenient for the user?
And Most important Is it is influencing users for making their decisions…

3. 7 different metrics I used for evaluating our bot’s performance:


a) Understanding: does our chatbot understand any kind of user input —
curse words – No
small talk – Yes
idioms –No
emojis – No

b) Answering: are its answers context-relevant and accurate enough? – Yes


c) Navigation: is it intuitive enough for us to go through the conversation we’re having with our bot? –
Yes

d) Personality: does its tone suit our audience and the nature of the ongoing conversation? – Its Some
thing we need to work on
e) Onboarding: is it clear enough to the user what our chatbot’s functionality is, from the very start? Is
it intuitive enough how she should interact with the bot? – To be tested
f) Intelligence: does our chatbot “remember” certain details, key information that the user has provided
throughout the conversation? – Yes
g) Error management: how does your chatbot handle errors and exceptions? – Need to be work on.

Errors: -

1. Can’t handle large media files Error occur


2. Not taking any other excel file.
3. We have to do changes in excel file which is provided by bot for proper results
4. If we can provide link with every suitable problem solution it is good other wise it is no use
5. We need to be very specific with Q and A.

You might also like