Introducing 

Prezi AI.

Your new presentation assistant.

Refine, enhance, and tailor your content, source relevant images, and edit visuals quicker than ever before.

Loading…
Transcript

coverage

effectiveness

121% improvement

77% improvement

73% improvement

436% improvement

Exploratory

To be

Application of Practical Combinatorial Testing Methods at Siemens Building Technologies Desigo CC Project

Automation

ideas

Proustian Spider

datafloq.com

Uses

Sporadic damage on F-16 flights

www.developsense.com

Mike Bolton

the theory

A System Analysis Study Comparing Reverse Engineered Combinatorial Testing to Expert Judgment

ieeexplore.ieee.org/document/6200163/

34 switches

Thursdays

Fridays

2^34 = 17 billion ways to test

word processor test

We can cover it all with

33 tests (3-way interactions)

or

85 tests (4-way interactions)

csrc.nist.gov/groups/SNS/acts/index.html

Practical Combinatorial Testing - D. Richard Kuhn, Raghu N. Kacker, Yu Lei

nvlpubs.nist.gov/nistpubs/Legacy/SP/nistspecialpublication800-142.pdf

underlined, not strikethrough

Real life setup example

www.freequality.org/documents/tools/Tagarray_files/tamatrix.htm

pairwise.org

not Bold, Italic, Underlined

datafloq.com

cost

(124)

48

setups

48

setups

40

setups

18

setups

value

Example for parameters of input

147k tests for exhaustive suite

covered in..

48 tests

(or 125)

Setups...

setup_1

setup_2

....

setup_18

Any system under test

Ideas Involving

Test Inputs and Configurations Combined

18 setups

other new

functionality

29 tests

schedules

96 tests

graphics

Test set idea

.....

....

...

..

.

864

2 tests

2 tests

...

..

.

.

.

.

2-3 tests

5 tests

5 tests

...

..

.

.

.

.

5-6 tests

setup_1

setup_2

...

..

.

.

.

.

setup_18

inputs?

48 tests

96..?

77% improvement

https://github.com/usnistgov/combinatorial-testing-tools

18 setups

71 setups

another 14 additional formats/new pcs

14 additional formats/new pcs

21 formats/new pcs already needed

136 setups...

improvement over proposed validation cycle

93% 2 way coverage - 26% improvement

59% 3way coverage - 118% improvement

74% 2way, 27 % 3way

over current test cycles

121% 2way improvement

436% 3way improvement

Current test cycles

42% 2way coverage

11% 3way coverage

murat.ozcan@siemens.com

theprimes.com

Learn more about creating dynamic, engaging presentations with Prezi