AI Chat-Bot Testing

Problem Statement

• Client has developed an Artificial Intelligence enabled chatbot that is integrated with MS Teams. It’s a one-stop solution for employees to request any service, Create Help desk tickets, add Reminders, Schedule meetings, Know about peers, and the list goes on.
• Client approached CES to automate all the functional utterances and integrations with different applications in Chatbot
• Chatbot supports many utterances and takes more time to test the functionality for all the utterances with the given data.
• Chatbot also reads the data from different applications, and it is time-consuming to test manually

CES Solution

• CES leveraged ready to use in-house framework: Zyna which helped to kickstart automation in no time.
• Automate testing of complete chatbot web interface and validating all integrations and responses for a comprehensive list of utterances.

Business Outcome

• Leveraging Zyna saved around 400 hours of building framework and initial setup
• Automation reduced 20 days of manual efforts to 8 hrs.
• Solution was hosted on azure pipelines running weekly scheduled regressions tests.
• The framework can easily integrate with multiple web applications for automation runs.