Test Management Blog

Building a Framework with TestComplete

February 1, 2023
This three part blog series (with videos) walks you through building a test automation framework using the Keyword testing functionality within TestComplete. Just tiny bit of code but pretty much everything using just keyword tests. This is about showing you how to build a structure that's easier to scale and maintain. It's about showing you how to avoid you projects turning into a plate of spaghetti. **Note:** * when we talk about 'keywords' we're talking about the feature in TestComplete allows you to build tests with this graphical icon based, drag and drop approach to building automated tests. The approach to building automated tests that SmartBear have confusingly called 'keyword testing'. This is not to be confused with the other...
Read more...

Integrating TestComplete with Azure DevOps – Pipeline Configuration

January 28, 2023
This is last part in our three part series on Integrating TestComplete with Azure DevOps. We've completed the preparation steps  and we're now ready to build that first pipeline. To get this integration working we need to configure a pipeline then. And that pipeline we'll configure as we go through these steps.. 1. Select the Pipeline menu option 2. Create a New pipeline with the Yaml or Classic editor 3. Configure the following “tasks” for the pipeline Get SourcesSelect the repository and branch that holds your TestComplete code Configure Get Sources for TestComplete Azure DevOps Integration Agent JobDefine the automation job that will run on the agent and select the agent pool Configure the Azure DevOps Agent steps for TestComplete...
Read more...

Integrating TestComplete with Azure DevOps – The Preparation Steps

January 18, 2023
In the first part to this three part series we looked at what an Integrated TestComplete Azure DevOps setup  looked like. We set the context in that blog post so that we're ready to look what we need to configure and prepare to get this integration working. We take you through the following 4 preparation steps: Creating your ADO Git Repository  Binding TestComplete to ADO  Linking your tests between TestComplete and ADO  Setting up your agent machine So this first step walks you through setting up a Git repository in your Azure DevOps project and show you how to commit your TestComplete project/code to this repository. We need our TestComplete code in our Azure Git repo as we'll build our...
Read more...

Integrating TestComplete with Azure DevOps

January 9, 2023
In this series of 3 posts we're walking you through the process of integrating TestComplete with Azure DevOps. In this post we walk you through the end-to-end process. In the 2nd post we show you how to set up, configure and prepare all the different components. Then in the 3rd post we talk you through constructing your first pipeline and integrating your TestComplete automation run into your release. The overall process looks like this: The core aspects of this setup being: Our TestComplete project is stored in an ADO Git repo. We map our TestComplete Test Items to ADO Test Cases. Pipeline is configured to execute tests on an agent Test results are fed back to an ADO test run...
Read more...

Python Basics for Test Automation Engineers

May 29, 2022
Like it or not the most effective way to build automated tests is with code. Yes drag and drop, icon based, user friendly IDE's can be productive. Just that they'll never be as effective or productive as developing automated tests in code. This is why languages like Python are critical to a lot of test automation projects. So in a series of courses that will cover Python, Java Script and C# we start by taking you through the basics of Python. In a series of 14 modules You'll learn about Python …. Module 1 – Operations Module 2 – Variables Module 3 – Operators Module 4 – Lists Module 5 – Loops Module 6 – Functions Module 7 – Modules...
Read more...

How To …. Create a Continuous Testing Environment with the TestComplete REST Api and Virtual Machines

February 21, 2022
Create a Continuous Testing Environment with the TestComplete REST Api and Virtual Machines Stability and productivity are everything with automated testing. If you're going to be productive with TestComplete you must have a way to test and run your automated tests outside of your development machine. As your tests grow you cannot afford to waste time tying up your development machine as you run your automated tests. It’s crucial that you have separate environments where you can execute tests independently. We’re going to walk you through a simple'ish setup where you develop on one machine and run on a separate virtual machine using TestExecute. Execute a script, your tests run on a VM, results available on your development machine. What...
Read more...

Microsoft Azure DevOps Test Management Review

November 30, 2021
Introduction The Microsoft Azure DevOps Test Management component offers the possibility of a fully integrated development and test capability for QA and Development teams. It gives agile teams the capability of collaborating in one tool for all the different disciplines. Again, in this review of the test management component, we’ll be focusing on 7 of the most prominent features and assessing Azure DevOps against them. These features are: Assignment Version Control Parameterisation Libraries Results Aggregation Retesting Configurations and Releases Assignment When implementing a process or selecting a test management tool, you’ll always need to assign a test to a tester at some point. Question is do you need to assign at the step, case or cycle level. Do you need to allocate...
Read more...

Zephyr Scale Review

October 21, 2021
Introduction In our test management tool side-by-side feature comparison we identified well over 100 features that you can use to compare the different tools. Not all of the features are significant though. In this review we pick a few of those features and take a look looking at how Zephyr Scale addresses 7 complexities of test management. Those complexities and core features are: Assignment Version Control Parameterisation Libraries Results Aggregation Retesting Configurations and Releases Assignment Test cases are executed in cycles within Zephyr Scale. The cycle has an owner at the top level. Then you can assign individual test cases can to specific testers for execution. This is also supported with an 'Executed by' field that shows who actually ran...
Read more...

Xray Review

October 14, 2021
Introduction The functional analysis of test management tools can be broken down into more than 100 separate features. In fact, our our side-by-side test management tool feature comparison has identified well over 100 features. Having lots of features isn’t always a good thing. Let’s face it not all of them are significant. However, there are 7 core and complex features that every test management solution has to address in one way or another. The core features are: Assignment Version Control Parameterization Libraries Results Aggregation Retesting Configurations and Releases In this write-up, we’ll be seeing how Xray stands up to the 7 criteria listed above. Assignment Xray implements test cases as Jira issue types. When you start out with Xray, you...
Read more...

QMetry Review

October 7, 2021
Introduction QMetry is a test management tool that enables users to increase efficiency in managing their testing. Yes it delivers the basics of creating test cases but QMetry also has some clever ways to help with test case reuse.There are lots of aspects to a test management solution and our side-by-side test management tool feature comparison has identified more than 100 of them. However, there are 7 core and complex features that every test management solution must address in some way. The 7 core and complex features are: Assignment Version Control Libraries Results Aggregation Retesting Configurations and Releases In the following sections we look at how QMetry addresses each of these 7 features. Assignment The two ways to assign tests in...
Read more...