Goal driven test automation

Vitaq AI Test Automation provides users with the ability to monitor and measure user journey coverage. The user defines the sequences of test actions that make-up their required journeys or use-cases. These are then used as Test automation goals. They are the test objectives which guide the Machine Learning AI Algorithms.  Vitaq then auto-generate tests to achieve these goals, aiming to reach 100% QA test coverage.

User journey coverage

The User Journeys are defined by the sequence of Test Actions in the Vitaq AI Test Automation Tool. Our Test Activity diagram essentially models these paths or Journeys that a user can go through to use the app under test. So we need to perform the same  tests on the web or mobile app to achieve their desired test requirements.

Let’s find out more about these User Journeys. Vitaq AI Machine Learning Algorithms and how it maps to QA Coverage through some visual representations.

1) In our last blog, we showed you how we create user journeys, so as a reminder let’s take a look below at the screenshots.

Mapping test requirements from Jira

Let’s say we have a test requirement called VTB_5 documented in Jira. This is our User Journey (or Use Case Sequence).  We want to see this happen at least once during our Test Automation run. So, we give our Vitaq AI sequence the name VTB_5 with a coverage target goal of 1 (i.e. needs to happen at least once). Then the user clicks on each test Action in turn on the Test Activity Diagram that makes up the user journey required. Here you can see the numbers in orange circles starting from 1 through to 7. Where action 1 in the sequence is Home, action 2 landingPage through to action 7 which is signOut. This sequence will be one of many user journey goals that the QA tester will want to cover during Test Automation.

2) We have creating all of our required User Journeys (or Use Case Sequences) and completed the test scripts inside each of the test actions. Now we need to enable Coverage and AI through the edit preferences section of Vitaq. For that we click on Edit and select Preferences in the top banner menu of Vitaq.

3) Edit Preferences dialog box will open and enable the Use Coverage and Use AI checkbox. Ensure that Database information should be prefilled and then click on the Ok button.

4) When using JavaScript (instead of Python or Scriptworks visual code) in our Vitaq Test Activity diagrams, we will need to run the Vitaq JavaScript Client. For this example we will use the WebDriverIO (https://webdriver.io/) configuration. We also need a Selenium Server in another command shell window. So we need to open two terminals separately. Click on System Tools and click on LX Terminal. Note that you can also run Selenium (or Appium) outside the container either on your host machine or in a private or public cloud service.

5) In one of the terminals out of two opened terminals. enter “./vitaq_client.js -w webdriverio” to run Vitaq Client with WebDriverIO and hit Enter or Return key from Keyboard.

6) In Another Terminal. Enter “./selenium_server.sh” to run Selenium Server and hit Enter or Return key from Keyboard.

Now we are all set to go and hit Run button in Vitaq AI.

7) Click on the Run Button with Blue Play Symbol present on the top of the Vitaq window. By Clicking on it, Vitaq’s Machine Learning AI Algorithm will Start running continuous highly-variable auto-generated tests. Each new ‘seed’ run it makes will inform the AI algorithms to learn how to focus in on the required User Journeys. It will rapidly learn the traversal paths, executing tests until it achieves 100% test Coverage.

8) To see the percentage of test coverage covered achieved at any given time we can click on Coverage Button. It will display our percentage of test coverage which has happened during the run till it gets completed and shows 100% Test Coverage.

This is how we can make sure we have not missed any traversal path present in User Journey and achieves 100% Coverage through the unique and powerful Machine Learning AI Algorithm in Vitaq AI Test Automation Tool.