Meetup And Learn, Debunking the QA KPI Myths And Make KPI Great Again — Tentamen Software Testing Blog


In the previous post, we gave a report on the Observability for Performance Testers by Mark Tomlinson. Today we present Lisette Zounon, Debunking the QA KPI Myths and making KPI great again. How observability IS different from monitoring. When it comes to software quality, KPI metrics can become a myth. Lisette will try to debunk that myth.


When it comes to software quality, KPI metrics can become a myth. Sometimes it works, sometimes you miss it. Attendees in this session will take away: Determine the purpose of the QA KPI for your needs. Adapt the KPI Metrics to your organization’s culture. Practical QA KPI metrics that bring value to everyone in the organization for the project’s health and the team’s health. Determine QA KPI Metrics for QA team only Define QA KPI metrics for your product quality health.

Define KPI

It all starts with defining the KPI for your organization. Lisette started the story on how to do that.

What Is Your Role

Lisette started making her’s presentation fascinating from the beginning by requesting feedback from the audience. How to get audience involvement in the remote presentation? With You get a number that is related to the current question. On, you enter that number and your question. The facilitator can watch all the answers on a dedicated panel page. Simple as that. Our first question was, What Is Your Role? You can see some of the answers in the above screenshot. Most of the audience was from QA.

Audience KPI’s

What do we measure in our organizations:

KPI Myths

Here are some of the audience KPI myths in

How To Start With KPI

First, try with a KPI Demo for the organization. Start with the Why? Why we want this particular KPI? The second ingredient is the KPI audience; who is interested in this KPI, team member, manager, or team leader? Team culture is critical in creating KPI.


KPI is a team activity. Start with the QA Score Card:

Based on that team QA Score Card you can pick one Demo KPI. Create for that KPI a Dashboard because that would increase KPI team visibility. When you set proper QA KPI in your organization, you will get the following team benefit:

Benefit team engagement strive to common goal


Here are some of the audience questions. KPI visibility includes easy accessibility. You do not need special system privileges to get the KPI. A list of No Go and backfire KPI should be established by the team. Those KPI could cause more damage than benefit. Rejected bugs are valuable KPI. And do not link KPI value with the specific person! This is the mother of all backfires KPI’s!

Testivator Session Score

For this session, I was using the Testivator Mobile application. I took 26 notes and 5 screenshots.

Here are note types by duration. Till the end is 2.7 %, and it is the ratio of duration from last note to session end and session duration.

Originally published at on December 12, 2020.




Founder of Tentamen, software testing agency.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Multithreaded HTTP requests in Python

Are there some takeaways from programming to management?

Fight Exploratory Testing Anti Patterns With Testivator — Tentamen Software Testing Blog

Spring Boot — print Hibernate SQL statements and parameters during integration tests without…

SRE / DevOps / Kubernetes Weekly Collection#37(Week 42)

Spotify iOS SDK: Authentication

TestBash Home 2020 — Explore Black Box Puzzle #35

KB4577064 — Breaks Windows Server 2008 DNS

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Karlo Smid

Karlo Smid

Founder of Tentamen, software testing agency.

More from Medium

Manual Testing Vs Automated Testing — Top Considerations

What’s the origin of the term ‘bug’? | Agilitest blog

17 Excuses Every Website Tester Should Get Rid Of Immediately