This article is pointing out security threats and attack vectors of typical chatbot architectures — based on OWASP Top 10 and adversarial attacks.

This article shows you how to analyze and evaluate the quality of the training phrases for your chatbot intents with Botium. The purpose of this analysis is to avoid confusing the agent with phrases irrelevant to the intents supplied to, or more relevant to, other intents.

Botium Box and the Alexa Voice Service (AVS) connector can perform automated testing for Alexa skills – no speaking out loud necessary.

If you have an existing Watson Assistant skill and you want to analyze it for consistency as well as performance of the training data itself, you should read this article. It shows ways to improve the performance of your skill as well.

Did you know that it is possible to connect your Google Sheet to Botium Box?

This tutorial provides a step-by-step introduction how to use Botium Box to quickly build a regression test suite for an Amazon Lex chatbot and increase the test coverage by adding paraphrases to the test data.

This tutorial shows a way to establish the same methods to chatbot projects, especially for projects focused on training an NLU engine and/or a dialogue engine.

Quick installation instructions for running Botium Box (all flavours) on a bare bone AWS Linux server. Same principles apply for all other Linux servers.

What is a Confusion Matrix ? How to generate and read a Confusion Matrix ? How to calculate precision, recall and F1-Score for your NLU engine ?

So, you followed the installation instructions and you can see the Botium Dashboard, but you don’t know how to start ? Follow the steps in this tutorial to get your first Botium Box test project up and running!

We are super excited to announce that Botium Box 1.7 is out now! Discover great new features like Continuous Security Testing based on OWASP ZAP or our brand new Testcase Generator.

This is part 8 of the Botium in a Nutshell series of articles.

This is part 6 of the Botium in a Nutshell series of articles.

Testing a Google Action by talking to your device isn’t fun. In the age of agile development, the age of manual regression testing is over. Within 3 days, we developed a Botium extension to enable an agile developer team to run regression tests for a Google Action within their CI Pipeline.

Chatbots are driving the industry. With Botium we are driving chatbots. After months of hard work we are finally there: we are proud to announce the general availability of the newest Botium Stack member, the Botium Box.

This is part 1 of the Botium in a Nutshell series of articles.

This is part 3 of the Botium in a Nutshell series of articles.

It’s easy to make a chatbot fail. I am not talking about nonsense input, or input not related to the chatbot domain — literally all state-of-the-art chatbots will fail in these cases. No, I am talking about input making perfectly sense in the domain of the chatbot — simple and short instructions which should trigger one of the main use cases for the chatbot.