Blog

Stay informed with news, updates, how2s, best practices, …

This video tutorial shows how to use Botium Box and Botium Coach to evaluate the performance of an NLU model trained with Rasa. Read more
Google Spreadsheet
Did you know that it is possible to connect your Google Sheet to Botium Box? Read more
A Selenium Grid is a set of connected Selenium nodes each running your Selenium tests on a different kind of operating system on a different kind of web browser in a different version. We are using docker-selenium to boot our own Selenium Grid on our own server. Read more
This tutorial provides a step-by-step introduction how to use Botium Box to quickly build a regression test suite for an Amazon Lex chatbot and increase the test coverage by adding paraphrases to the test data. Read more
According to the report The State of AI 2019: Divergence there is a lot of Bullshit Bingo around the thing called Artificial Intelligence (AI). Read more
This tutorial shows a way to establish the same methods to chatbot projects, especially for projects focused on training an NLU engine and/or a dialogue engine. Read more
Botium Speech Processing combines the best Open Source speech processing tools in a single service and makes them accessible with a HTTP/JSON API. Read more
Quick installation instructions for running Botium Box (all flavours) on a bare bone AWS Linux server. Same principles apply for all other Linux servers. Read more
Ever wanted to know if your company chatbot would work better on IBM Watson than on Dialogflow ? Or should you give Wit.ai or Amazon Lex a try ? With the help of Botium you can easily benchmark and compare the performance of established chatbot platforms with your own data. Read more
What is a Confusion Matrix ? How to generate and read a Confusion Matrix ? How to calculate precision, recall and F1-Score for your NLU engine ? Read more
This is part 9 of the Botium in a Nutshell series of articles. Read more
So, you followed the installation instructions and you can see the Botium Dashboard, but you don’t know how to start ? Follow the steps in this tutorial to get your first Botium Box test project up and running! Read more
One of the questions we hear the most is how to integrate Botium Box with Jenkins. Read more
We are super excited to announce that Botium Box 1.7 is out now! Discover great new features like Continuous Security Testing based on OWASP ZAP or our brand new Testcase Generator. Read more
This is part 7 of the Botium in a Nutshell series of articles. Read more
This is part 8 of the Botium in a Nutshell series of articles. Read more
Chatbots are cool. They are driving the industry like hardly any other topic these days and are considered to be real game changers. Read more
This is part 6 of the Botium in a Nutshell series of articles. Read more
In the age of agile development, the age of manual regression testing is over. We developed a Botium extension to enable an agile developer team to run automated regression tests on a Microsoft LUIS model within their CI Pipeline. Read more
Testing a Google Action by talking to your device isn’t fun. In the age of agile development, the age of manual regression testing is over. Within 3 days, we developed a Botium extension to enable an agile developer team to run regression tests for a Google Action within their CI Pipeline. Read more
This is part 5 of the Botium in a Nutshell series of articles. Read more
Chatbots are driving the industry. With Botium we are driving chatbots. After months of hard work we are finally there: we are proud to announce the general availability of the newest Botium Stack member, the Botium Box. Read more
Testing an Alexa Skill by talking to your device isn’t fun. Some months ago I published an article showing several options for automating testing of your Alexa Skill: Read more
This is part 1 of the Botium in a Nutshell series of articles. Read more
This is part 2 of the Botium in a Nutshell series of articles. Read more
This is part 3 of the Botium in a Nutshell series of articles. Read more
This is part 4 of the Botium in a Nutshell series of articles. Read more
It’s easy to make a chatbot fail. I am not talking about nonsense input, or input not related to the chatbot domain — literally all state-of-the-art chatbots will fail in these cases. No, I am talking about input making perfectly sense in the domain of the chatbot — simple and short instructions which should trigger one of the main use cases for the chatbot. Read more
Today I was asked to build a proof-of-concept for using Tricentis Tosca to test an Alexa Skill — challenge accepted! Read more