Introducing
Your new presentation assistant.
Refine, enhance, and tailor your content, source relevant images, and edit visuals quicker than ever before.
Trending searches
121% improvement
77% improvement
73% improvement
436% improvement
datafloq.com
www.developsense.com
Mike Bolton
A System Analysis Study Comparing Reverse Engineered Combinatorial Testing to Expert Judgment
ieeexplore.ieee.org/document/6200163/
Thursdays
2^34 = 17 billion ways to test
word processor test
We can cover it all with
33 tests (3-way interactions)
or
85 tests (4-way interactions)
Practical Combinatorial Testing - D. Richard Kuhn, Raghu N. Kacker, Yu Lei
nvlpubs.nist.gov/nistpubs/Legacy/SP/nistspecialpublication800-142.pdf
underlined, not strikethrough
Real life setup example
www.freequality.org/documents/tools/Tagarray_files/tamatrix.htm
pairwise.org
not Bold, Italic, Underlined
datafloq.com
cost
(124)
48
setups
48
setups
40
setups
18
setups
value
Example for parameters of input
147k tests for exhaustive suite
covered in..
48 tests
(or 125)
Setups...
setup_1
setup_2
....
setup_18
Ideas Involving
Test Inputs and Configurations Combined
other new
functionality
29 tests
schedules
96 tests
graphics
.....
....
...
..
.
2 tests
2 tests
...
..
.
.
.
.
2-3 tests
5 tests
5 tests
...
..
.
.
.
.
5-6 tests
setup_1
setup_2
...
..
.
.
.
.
setup_18
inputs?
77% improvement
https://github.com/usnistgov/combinatorial-testing-tools
18 setups
71 setups
another 14 additional formats/new pcs
14 additional formats/new pcs
21 formats/new pcs already needed
136 setups...
improvement over proposed validation cycle
93% 2 way coverage - 26% improvement
59% 3way coverage - 118% improvement
74% 2way, 27 % 3way
over current test cycles
121% 2way improvement
436% 3way improvement
Current test cycles
42% 2way coverage
11% 3way coverage
murat.ozcan@siemens.com