Is it just me or do you get this feeling too?

Posted by & filed under Test Management.

One of the stand out moments in 2015 has to be the high profile fall out in one of the biggest sports in the world. A fall out between one of the most successful partnerships of all time in Formula 1. A fall out that had many parallels with the way testers are treated in our… Read more »

Why Don’t We Thrash Out The API Design At The Start?

Posted by & filed under Test Management.

It’s the start of a new project. Everyone is throwing in design ideas. Lot of excitement. Bit of a buzz. High level architecture is taking shape. Wire diagrams for the GUI are nearly finished. ‘This’ system will talk to ‘that’ system. You know which systems are storing the different pieces of data. Front end will… Read more »

Why Don’t We Learn From Our Mistakes?

Posted by & filed under Test Management.

Chesley Sullenberger, the pilot who landed an Airbus A320 on the Hudson explained in an interview that “Everything we know in aviation, every rule in the rule book, every procedure we have, we know because someone somewhere died…. We have purchased at great cost, lessons literally bought with blood that we have to preserve as… Read more »

Tracking Results and Traceability for Automated Tests

Posted by & filed under Test Management.

You’ve configured your test hosts (Bringing Manual and Automated Tests Together) and you’ve set up and run automated tests from QAComplete (Setting Up Automated Tests in QAComplete). Now we’re running these automated tests how do we track the results and how do we follow the traceability back to our requirements? Traceability For many of our… Read more »

Setting Up Automated Tests in QAComplete

Posted by & filed under Test Management.

We’re going to continue with our look at how to combine manual and automated tests with QAComplete and TestComplete. We’ve already seen how to install and configure the Test Agent which connects QAComplete and TestComplete. Now we look at how to setup automated tests and execute them. You will need to configure the Test Manager… Read more »

Bringing Manual and Automated Tests Together

Posted by & filed under Test Automation, Test Management.

Bringing manual and automated tests together to deliver combined reporting and traceability is an important goal for many QA teams. Usually this means linking an automated testing process into a manual test tracking tool. With the new 9.9 release of QAComplete and release 10.0 of TestComplete implementing an integrated solution becomes possible without investing vast… Read more »

Integrating TestComplete and Quality Center

Posted by & filed under Test Management.

For many, integrating your test management system with your automation environment is a key aim. Whilst Quality Center integrates with UFT and QTP out of the box, many have other integration requirements. In cases where you might be looking to integrate TestComplete automated tests with Quality Center the following set up and execution instructions may… Read more »

Perspective

Posted by & filed under Test Management.

If you are ever in London, I highly recommend Kew Royal Botanic Gardens. It’s perfect on a warm Spring Sunday evening. Miles of stunning trees and plants in bloom. Amazing colours, rolling landscapes, parakeets, and great food. I particularly recommend the treetop walkway. For a relaxing day out, you can’t beat it. Except, that is,… Read more »

The Hidden Influence on Quality

Posted by & filed under Test Management.

Have you read Quiet by Susan Cain yet? In it Cain refers to studies that show just how much peer pressure influences our decisions — a concept that has some interesting ramifications for us as software testers. We’re all exposed to peer pressure. Even as testers we are subjected to peer pressure. Peers in development… Read more »

A Look at QAComplete's New Test Management Versioning Capabilities

Posted by & filed under Test Management.

With the release of the 9.8.1 version of QAComplete and ALMComplete SmartBear software have included two new key test management features. The first is a versioning feature that allows you to select which version of a testcase is used in a run. The second is an assignment feature that allows you to assign at the… Read more »

Integrating Quality Center and VersionOne

Posted by & filed under Test Management.

These days a large part of successful project management and test management depends on the integration of tools. Tools that are used across different business functions need to be integrated to provide visibility and traceability across the business. For example the Dev team and QA team might need different tools for test management and agile… Read more »

Test Management and Application Lifecycle Management Integration

Posted by & filed under Test Management.

I read an article the other day that questioned if collaboration actually impacts productivity. As software testers in the age of agile we’re encouraged to embrace the concept of collaboration as something that will improve the way in which we work. We’re pushed to collaborate within the test management process and other business processes. And… Read more »

What is Test Management?

Posted by & filed under Test Management.

I was asked by a colleague the other day to define what test management is. Having spent 20 years practicing it, I was surprised to discover that I couldn’t come up with a short pithy one liner to describe it quickly. With a bit of thought I came up with this though… “The discipline of… Read more »

50 Ideas to Improve your Test Management Process – Part 5

Posted by & filed under Test Management.

That week flew by and we’re already on the last 10 ideas to help improve your test management process. Hopefully you’ll get some inspiration from the last 10 ideas this week. Provide a portal for external parties – There are many other stakeholders interested in the QA process. If they’re interested, then the question is… Read more »

50 Ideas to Improve your Test Management Process – Part 4

Posted by & filed under Test Management.

Another 10 test management ideas for you to consider over the coming months. Integrate with automation tools – If you already have automation in place but haven’t looked at sync’ing this into your test management system yet then this is an easy win. Even if you have tools from different vendors you’ll find you have… Read more »

50 Ideas to Improve your Test Management Process – Part 3

Posted by & filed under Test Management.

So here we go for the next 10 ideas on enhancing your test management process. Split things up differently – Maybe you currently assign your staff based on projects. What about if you looked at a completely different approach and had a sub team that focuses on integration testing, some QA engineers that concentrated solely… Read more »

50 Ideas to Improve your Test Management Process – Part 2

Posted by & filed under Test Management.

So, to part 2. Another 10 ideas on how you might improve your test management process. No point waffling. So here we go. Write a usage guide – Often writing things down helps clarify the process. Processes grow up over time and morph into something that we never really expected. Something that’s never really efficient… Read more »

50 Ideas to Improve your Test Management Process – Part 1

Posted by & filed under Test Management.

We’re a month or two into 2013 now and with our new years resolutions some way behind us we thought we’d take a look at how you might improve your test management process over the remaining 10 months of the year. So over the next 5 days we’re going to look at 50 improvement ideas… Read more »

Integrating Defect and Test Management with Source Code Control

Posted by & filed under Test Management.

One critical aspect of test management involves completing the loop with defect fixes and source code control. It’s all very well raising bugs as part of the QA process. And it’s good to know that those bugs have been fixed. To be totally in control though you need to know what and how it was… Read more »

The Test Management / ALM solution Project Implementation

Posted by & filed under Test Management.

The implementation of a Test Management or Application Life Cycle (ALM) tool should be approached in the same way as any other IT project. These tools, once setup, will touch on, not only the software engineering team, but operations, project management, customer support and many other aspects of the business. Getting the implementation wrong can… Read more »

Sharing Project Artifacts within Test Management Tools

Posted by & filed under Test Management.

Sharing project artifacts across different projects within a test management tool tends to be difficult. For example, you create a project space within your tool of choice, develop lots of test cases and run them. However, you have another project running concurrently and they want to use the same test cases within a separate project… Read more »

Managing Retests with Quality Center

Posted by & filed under Test Management.

At some point in the test management process you’ll need to re-test fixes that have been made to resolve issues. This re-test process needs to be approached from two angles. Firstly, identifying failed test cases from previous test runs and then re-running those test cases in a subsequent cycle. Secondly, identifying defects that have been… Read more »

Test Result Aggregation with Quality Center

Posted by & filed under Test Management.

No test team can run every single test case on every single release of a product. So being able to aggregate results from different views or areas in your test management tool is essential when it comes to seeing the whole picture. However, how your test management tool deals with that aggregation might not be… Read more »

Managing a Library of Test Cases with Quality Center

Posted by & filed under Test Management.

Different test management tools use different terminology for the concept of having a library of reusable test cases. With Quality Center the term used is the test plan. Not quite sure why it’s referred to as the test plan as a test plan is far more than just a repository of reusable testcases you’ve written…. Read more »

Using Test Parameters with Quality Center

Posted by & filed under Test Management.

Scaling up your test cases effectively usually involves the practice of parametrization. That is, the concept of having one testcase and then feeding in parameter values to create variations of the test case at run time. So essentially you have the same testcase which you execute repeatedly with different data values. Defining parameters in Quality… Read more »

Tracking Configurations and Releases with Quality Center

Posted by & filed under Test Management.

An important part of our Quality Center test management process is tracking which releases and configurations our test cases are executed against. So for example, when we run a test we should record the fact that it was executed on Windows XP with IE9 and executed against version 1 build xyz of the product we’re… Read more »

Test Case Reuse

Posted by & filed under Test Management.

Reusable test cases that can be used across different projects can be a difficult to implement and manage. There are some good ways to approach this though. In this article we look at ways to configure your test management tool so that you can effectively handle main products and sub products effectively. As a practical… Read more »

How to Evaluate Test Management Tools

Posted by & filed under Test Management.

Selecting the right test management tool is critical to your business. Select the wrong tool and you’ll end up fighting and wrestling to get the benefits you know you should be gaining. Select the right tool and you’ve got a solution that will support and promote your QA process. Your approach to selection is not… Read more »

Versioning with Quality Center

Posted by & filed under Test Management.

Continuing with our look at the complexities of test management with Quality Center we’re looking at version control this time. At a basic level version control means tracking which changes have been made to a testcase, who made them and when. Furthermore version control can mean tracking which version of a testcase was run against… Read more »

Tracking Execution Time with QAComplete

Posted by & filed under Test Management.

One important aspect to monitor on any test management project is the time it takes to execute a number of test cases. Capturing and reporting this information usually drives the average QA engineer slightly mad (after all you only need to find one bug during the execution and all figures will be distorted). So yes… Read more »

Assignment of Test Cases with Quality Center

Posted by & filed under Test Management.

As part of our test management complexities series we’re looking here at assignment of testcases within Quality Center. Assignment within QC typically works at the “testcase” level within the Plan and Lab areas. We can extend assignment to sets and steps but this requires custom field set up (which we look at in the video)…. Read more »

Maintenance of Test Management Tools

Posted by & filed under Test Management.

A healthy test management system requires maintenance. When I say healthy I mean a system that gives you accurate reports, doesn’t add a significant overhead to the testers work load and accurately mirrors your real world process. Rarely does a company implement a test management tool then leave it untouched for years. You’re aiming to… Read more »

Tracking Configurations and Releases with Test Management Tools

Posted by & filed under Test Management.

It’s well known that keeping track of results from testcases against builds, configurations, environments, etc can become quite difficult to manage. It’s one of the reasons we usually implement test management tools. These tools enable us to log our results against these different aspects of our testing and then quickly produce traceability reports to show… Read more »

Identifying Retests with Test Management Tools

Posted by & filed under Test Management.

Re-running tests to check that bugs are fixed is an essential part of the test management process. Teams grow, the amount of data generated by completed testcases increases and the number of raised defects expands too. As a result it becomes more difficult to keep track of the retesting. There are several different ways to… Read more »

Aggregating Results with Test Management Tools

Posted by & filed under Test Management.

In many cases we’ll need our test management tool to aggregate and report on results from various perspectives. For example we may need to aggregate across different projects, application modules, runs or cycles. Whilst this sounds simple in theory, it’s not always so simple in practice. Much depends on how you structure things within your… Read more »

Test Management Libraries

Posted by & filed under Test Management.

Your ability to manage a library of testcases in your test management tool depends a lot on the relationship between the different instances of the testcases. The instances that resides in the library and the instances that are created to be executed and run. At a basic level you you will have two instances of… Read more »

Using Test Case Parameters in Test Management Tools

Posted by & filed under Test Management.

The ability to add parameters to testcases enables you to write testcases once and then run different instances multiple times with different parameters. It’s a key capability in test management that saves time, enables you scale up your testing more efficiently and helps avoid mistakes when writing repetitive testcases. It does add a degree of… Read more »

Version Control of Test Cases in Test Management Tools

Posted by & filed under Test Management.

It’s important to understand if and how version control of your QA artifacts is relevant to your test management process. If you work in a highly regulated environment then it likely that version control is very important. If you work in an environment where documentation and traceability aren’t so important then this may not be… Read more »

Assignment of Test Cases in Test Management Tools

Posted by & filed under Test Management.

All test management tools have the concept of assigning testcases. Some provide more capabilities than others. Certain tools provide just about every capability you can imagine but do this with a level of complexity which can be quite difficult to manage. Others have limitations that may or may not impact your ability to implement the… Read more »

Understanding the Complexities of Test Management

Posted by & filed under Test Management.

Over the next seven weeks we’re going to take a look in detail at 7 complex aspects of test management. We’re going to look at how we can address these complexities with some of the common tools available today. In doing so we’ll explore some of the weaknesses and strengths of popular tools and see… Read more »

Successful Test Management

Posted by & filed under Test Management.

Successful test management is about improving processes, technology and teams. However, if you don’t keep your eye on the end goal it’s easy to spend time and effort improving these areas yet see little difference in the quality of products you’re working on. And that’s the key. Any improvement efforts need to be targeted towards… Read more »

Managing Retests

Posted by & filed under Test Management.

Retesting is a key part of the test management process. However, there is a right and a wrong way to approach this. You run some testcases as part of one cycle. Some fail and you look to run them again as part of the next cycle. When they pass the temptation is to go back… Read more »

Test Management Activities

Posted by & filed under Test Management.

There are a number of core test management activities that you will be performing as part of any QA process.  What we cover here is good software testing practice and should form the bedrock of any QA teams setup.  The activities we’ll look at are : 1. Developing testcases in a library. 2. Defining releases… Read more »

Test Management Systems and User Adoption

Posted by & filed under Test Management.

This is a follow up to the previous post on Approaches to User Training for Test Management Systems. We thought we’d take a look at one of the most important reasons for training. That is increasing user adoption. Getting your QA team to use your test management system, and use it correctly, is key to… Read more »

Approaches to User Training for Test Management Systems

Posted by & filed under Test Management.

A large part of any new test management system implementation is training. Delivery of effective training is key to the uptake and correct usage of any system you put in place. There are several options or approaches to training that should be considered. Each approach having it’s own advantages and disadvantages. Training Mentors Typically delivered… Read more »

Top Software Failures and the Failure Cycle

Posted by & filed under Test Management.

It’s always interesting taking a look back over the year to examine some of the significant software failures. Whilst companies rarely allude to the causes behind these failures it’s easy to argue that poor software testing is likely to contribute significantly. The trouble with blaming this on software testing is that it usually means the… Read more »

Six New Test Management Features in QAComplete 9.7

Posted by & filed under Test Management.

The Test Management solution QAComplete 9.7 has been out for around 3 months now. In that time we’ve had the opportunity to implement for many clients and evaluate the new feature set in the real world. Billed as a solution comparable to HP’s Quality Center there are some interesting new features to help teams manage… Read more »

Exporting Test Management Results

Posted by & filed under Test Management.

All test management tools provide reporting to some degree. Most also support exporting of test results and test data. That data may include testcases, run status information, configuration settings, etc. Whatever the information you need to export the key question will be does the test management tool support the export format you need? Typically you… Read more »

The Aggregated Test Management Results Report

Posted by & filed under Test Management.

On a fairly regular basis we get asked for a specific test management report that will show the aggregated results from multiple runs. The idea behind this is that ultimately you can show that every testcase was run and that every one passed. So for example on test cycle 1 you may get… my_test_case_A:  … Read more »

Confusing Simplicity with Usability when selecting a Test Management Tool

Posted by & filed under Test Management.

A lot of companies that are evaluating test management tools say the tool must be easy to use. A reasonable request. It’s what’s behind this request that is interesting. In many cases it is the fact that the tool needs to be used by people that are not software testers. The reason for this? Companies… Read more »

What is the Difference Between a Test Manager and a Project Manager?

Posted by & filed under Test Management.

The 31st Test Management forum took place in the UK last week. For those of you based in the UK who have a fascination with this area of our discipline this is well worth attending. Attended by a number of prominent test mangers and consultants it makes for some very stimulating discussions (and in some… Read more »

Too Much Focus on the Test Management Technology Rather than the Implementer

Posted by & filed under Test Management.

When evaluating test management applications it’s easy to get carried away with the focus on the technology. Technology isn’t every thing though. Especially these days when the different products all seem to offer a similar feature set. Let’s face it most of the solutions these days cover pretty much the same ground. You may even… Read more »

31st Test Management Forum Coming Up

Posted by & filed under Test Management.

We’re two weeks away from the 31st Test Management forum in London this month. Usually a great live forum for picking up on some of the latest concepts and ideas surrounding this specialist discipline. Line up for this meeting are sessions on: Innovations in Test Automation – putting the case forward for IT innovations that… Read more »

Questioning the worth of your current test management tool?

Posted by & filed under Test Management.

Finding the right test management tool is difficult. Finding the right tool with the features you need to deliver the benefits you need to manage your process is even more difficult. Perhaps… Quality Center is costing you too much? You’ve outgrown TestLink? Excel and Word are not scaling up for you? If this is the… Read more »

Ways to Cut the Cost of your Test Management Project

Posted by & filed under Test Management.

For many these days, the almost unlimited budgets to spend on test management tools are long gone. However the importance of getting the right solution is no less diminished. If you’re looking to cut costs with implementing the right system then these suggestions may help. Do you really need a new application – many organisations… Read more »

Test Management Reports and Dashboards

Posted by & filed under Test Management.

The art of test management can be considered a niche topic within the realm of Software Testing. Yet we can drill down on test management further and look at the development of reports and dashboards as a topic in it’s own right too. All manner of data, statistics and information can be reported on. The… Read more »

Is your Test Management system really delivering results?

Posted by & filed under Test Management.

If you’re reading this I expect you’ve got a test management system in place in some form or another. The question is, how much value is that system delivering for you and your team. The answers to the following five questions should give you a pretty good idea. 1. What reports do you use? Reports… Read more »

The Test Management Retrospective

Posted by & filed under Test Management.

[jwplayer mediaid=”1281″] After the QA cycle there remains one stage that is vital to the test management process. That is a retrospective look at the testing process. Essentially, a retrospective is a post mortem, highlighting the positives and negatives of the testing. This may be useful to forthcoming releases and new projects. The post of… Read more »

Three Approaches to Test Case Management Version Control

Posted by & filed under Test Management.

Using a test management tool to control different versions of your testcases can seem like quite an innocuous point on the surface. However, there are many complexities to consider when you get below the surface. These complexities can have a serious impact your QA process. Ultimately you need to be able to ensure that the… Read more »

Five things the QA Director should understand before implementing a Test Management solution

Posted by & filed under Test Management.

Choosing a test management solution is easy. Implementing a solution is hard. It’s easy to select and configure one of the many great test management applications on the market today. We all understand the technology, the features are easy to evaluate and the configuration easy to set up (perhaps with a bit of trial and… Read more »

Time for Test Management

Posted by & filed under Test Management.

We all know that there’s never enough time to execute all of the testcases defined in our test management system. You can’t do everything when you’ve only got a finite amount of time. For this reason experts always seem to recommend prioritising your testing. Whilst prioritising seems like the obvious thing to do, the concept… Read more »

Optimizing Test Management Efforts

Posted by & filed under Test Management.

Part of an effective QA cycle depends on an efficient test management process. In this webinar we look at ways to allocate work to your team using Software Planner and the ways in which you can analyse how your QA cycle is progressing. Controlling time effectively will allow you to make the most of your… Read more »

The Test Management Octopus

Posted by & filed under Test Management.

There are some interesting comparisons between Octopuses and Test Management. For starters did you know that an octopus doesn’t have eight arms? Turns out that it has six arms and two legs (How Many Arms Does an Octopus Have?). Either way that’s a lot of limbs to manage. The management of the test process presents… Read more »

Manual and Automated Test Management

Posted by & filed under Test Management.

In this test management webinar recording we look at how to schedule automated tests to run daily during the QA cycle. Automating the execution of your testing and tracking those results in conjunction with your manual test efforts is key to maximising your resources. Integrating this process into an automated build process brings even more… Read more »

Manual Test Management – Planning

Posted by & filed under Test Management.

When it’s time to start planning your manual test efforts, being thorough in your preparation is the best way to ensure success. The most efficient way to begin developing your cases is to have your projects organized with test management planning tools such as Software Planner and TestComplete. These tools can help keep your tests… Read more »