Measurement Must Have A Purpose


Measurement must have a purpose. Use a “five-why” question analysis to determine real measurement purpose. The post is aligned with the Black Box Software Testing Foundations course (BBST) designed by Rebecca Fiedler, Cem Kaner, and James Bach.

For every measurement in software testing, you first need to determine the purpose of this measurement. The “five-why” analysis method could help you with this task.

Five whys (or 5 whys) is an iterative interrogative technique used to explore the cause-and-effect relationships underlying a particular problem.[1] The primary goal of the method is to determine the root cause of a defect or problem by repeating the question “Why?”. Each answer forms the basis of the next issue. The “five” in the name derives from an anecdotal observation on the number of iterations needed to resolve the problem [Wikipedia].

You need to question measurement purpose with five Why questions that will force you to provide five possible measurement purposes. Doing that, you could determine the real use of this measurement.

Let’s take, for example, the percentage of code coverage with unit tests measurement.

Why do you care how much is the percentage of code coverage with unit tests?

  1. Do developers write unit test code?
  2. A number of statements covered with unit tests.
  3. A number of branches covered with unit tests.
  4. Is mocking applied?
  5. Do we miss any code?
  6. Bug-free code.

Using a five-why analysis method, you could not resolve all bad software measurement problems. But your software testing measurement could be five times better. Also, you could reveal not possible expectations. Bug-free code purpose could not be determined with code coverage.

Originally published at on April 17, 2020.




Founder of Tentamen, software testing agency.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Teach Functional Programming First!

How to Get the Most out of Your Java Application

Android studio — Tips & Tricks

Introduction to Network — #12 IPv6 Addressing

SRE / DevOps / Kubernetes Weekly Collection#89(Week 41, 2021)

Summer 2020 Intern Spotlight: Parallelizing Bulk Back Translation with Nikash

Architecting the AstraZeneca vaccine booking site

Beginners Guide to Pandas and Numpy: Data Manipulation Lesson

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Karlo Smid

Karlo Smid

Founder of Tentamen, software testing agency.

More from Medium

How to Prepare for ISTQB certification in 3 steps

How to get mobile testing right?

Metrics in SDLC: Let the Truth Prevail

The world of Testing from Lisa & Laveena’s point of view