Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Poster - APPLICATIONS OF PRACTICAL COMBINATORIAL TESTING METHODS AT SIEMENS BUILDING TECHNOLOGIES DESIGO CC PROJECT

No description
by

Murat Ozcan

on 26 November 2016

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Poster - APPLICATIONS OF PRACTICAL COMBINATORIAL TESTING METHODS AT SIEMENS BUILDING TECHNOLOGIES DESIGO CC PROJECT

Automation

www.developsense.com
Mike Bolton

Th
ur
sda
ys

Application of Practical Combinatorial Testing Methods at Siemens Building Technologies Desigo CC Project
Uses
Sporadic damage on F-16 flights
A System Analysis Study Comparing Reverse Engineered Combinatorial Testing to Expert Judgment

ieeexplore.ieee.org/document/6200163/

csrc.nist.gov/groups/SNS/acts/index.html
2^34 = 17 billion ways to test
34 switches
We can cover it all with

33 tests
(3-way interactions)
or
85 tests
(4-way interactions)
the theory
word processor test
Practical Combinatorial Testing
- D. Richard Kuhn, Raghu N. Kacker, Yu Lei

nvlpubs.nist.gov/nistpubs/Legacy/SP/nistspecialpublication800-142.pdf
Real life setup example
cost
Example for parameters of input
147k tests for exhaustive suite
covered in..
48 tests
(or 125)
Any system under test
864
96..?
48 tests
18 setups
Exploratory
ideas
Proustian Spider
To be
murat.ozcan@siemens.com
value
Setups...
setup_1
setup_2
....
setup_18
96 tests
graphics
setup_1
setup_2
...
..
.
.
.
.
setup_18
5 tests
5 tests
...
..
.
.
.
.
5-6 tests
29 tests
schedules
2 tests
2 tests
...
..
.
.
.
.
2-3 tests
other new
functionality
Test set idea
.....
....
...
..
.
theprimes.com
Fridays
effectiveness
coverage
pairwise.org
www.freequality.org/documents/tools/Tagarray_files/tamatrix.htm
datafloq.com
datafloq.com
datafloq.com
Ideas Involving

Test Inputs
and
Configurations
Combined
77% improvement
inputs?
18 setups
71 setups
21 formats/new pcs already needed
another 14 additional formats/new pcs
14 additional formats/new pcs
74% 2way
, 27 % 3way
improvement over proposed validation cycle
93% 2 way coverage -
26% improvement
59% 3way coverage -
118% improvement
136 setups...
Current test cycles
42% 2way coverage
11% 3way coverage
over current test cycles
121% 2way improvement
436% 3way improvement
(124)
not Bold, Italic, Underlined
https://github.com/usnistgov/combinatorial-testing-tools
underlined, not strikethrough
77% improvement
73% improvement
121% improvement
436% improvement
18
setups
40
setups
48
setups
48
setups
Full transcript