Measurement Must Have A Scope

Measurement Must Have A Scope

Reading Time: < 1 minute

TL;DR

To have precise measurements, we must determine the measurement scope. The post is aligned with the Black Box Software Testing Foundations course (BBST) designed by Rebecca Fiedler, Cem Kaner, and James Bach.

It is crucial to define a measurement scope because as the scope broadens, more measurement variables are introduced. More variables cause a higher probability of measurement error.

We gave an example for code coverage measurement. In code coverage, we could have the following scopes:

  • statement
  • branch
  • path

So we could have 100% statement coverage and still miss a lot of known bugs because our branch coverage could be at the same time, 50%.

Or what do we include in the coverage report? Do we include all libraries used in our project? In that case, our 100% statement coverage could significantly drop. If library developers had not written unit tests, for that library code, we have 0% statement coverage. Does our code coverage tool have an option to include multiply source code folders?

Originally published at https://blog.tentamen.eu on April 22, 2020.

--

--

--

Founder of Tentamen, software testing agency.

Love podcasts or audiobooks? Learn on the go with our new app.

The future of 5G service architecture

What is Filebase and How do you use it?

Scaling Up Your Jitsi with Jitsi Bridges

Gig Economy

How to fix Flutter stuck at “running pod install…” when running on vscode building on simulator

How to fix Flutter stuck at “running pod install…” when running on vscode building on iPhone simulator.

How and why to use a feature branch in Github

Windows Live Meeting MSI Installer Download

Spring to pick up git commit via Maven plugin or CI/CD variables (gitlab)

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Karlo Smid

Karlo Smid

Founder of Tentamen, software testing agency.

More from Medium

Manual Testing Vs Automated Testing — Top Considerations

Test Ideas — Input Methods

What’s the origin of the term ‘bug’? | Agilitest blog

Why do we test at all?