# Hyper-expanding test cases

In the law of cascading problems, let’s say we have data sets where our data accuracy levels are as follows:

• Locations are 90%
• Pits are 95%
• Ducts are 90%
• Cables are 90%
• Joints are 85%
• Patch panels are 85%
• Active devices are 95%
• Cards are 95%
• Ports are 90%
• Bearer circuits are 85%

That all sounds pretty promising doesn’t it (we’ve all seen data sets that are much less reliable than that)? If we create an end-to-end circuit through all of these objects, we end up with a success rate of less than 30% (ie multiply all these percentages together).

The same principle applies for the law of hyper-expanding test cases. If each of your data set examples above has a number of distinct variants (eg there are 10 different styles of joints, 6 styles of bearer circuits, etc), you can multiply them together to get your total number of test combinations.

As you can guess, this could end up in a lot of possible combinations to test. I recently had an example where “full” test coverage equated to over 2 million combinations, and that was only including positive tests (ie excluding intentionally invalid data to test for possible unhandled defects).

Writing and conducting 2 million test cases sounds crazy enough, but the effort becomes even greater because each one of these tests needs to be underpinned by test data. Clearly full coverage isn’t viable in such a situation,

In these cases,

1. I start with a Venn diagram of each set and determine the variants within each set
2. l then try to build a test case for each variant but lock down other sets
3. For example
1. Set A – all variants of A, other sets only 1 common variant
2. Set B – all variants of B except the one locked for set A, other sets only 1 common variant including a single variant from A
3. And so on through all sets
4. Prioritise which variants are not important and / or rare (thus filtering the list downfurther)

### Can LLMs help us to reimagine what the OSS of the future looks like?

I love blogs. One of the amazing things about them is that it allows you to hear the wisdom of exceptional individuals who you’d otherwise

### Monthly OSS / Telco In-Person Meetup

Passionate about OSS and Telco – Locals Lunch Held at Noon on the Second Friday of Each Month. Held at the Golden Hills Brewery – 25

### Getting A/B comparisons running automatically in the minds of all your OSS evaluators

Are you familiar with David Heinemeier Hansson (DHH) and Jason Fried, the Co-Founders of 37signals (Makers of Basecamp and other software solutions)? As far as

### Steve Jobs Said 1 Habit Separates the Doers From the Dreamers

This article by Jeff Haden in Inc Magazine, “30 Years Ago, Steve Jobs Said 1 Habit Separates the Doers From the Dreamers,” has made me

This site uses Akismet to reduce spam. Learn how your comment data is processed.