Send the link below via email or IMCopy
Present to your audienceStart remote presentation
- Invited audience members will follow you as you navigate and present
- People invited to a presentation do not need a Prezi account
- This link expires 10 minutes after you close the presentation
- A maximum of 30 users can follow your presentation
- Learn more about this feature in our knowledge base article
Test and Evaluation TRR
Transcript of Test and Evaluation TRR
Enhancing the Test Readiness Review
(TRR) Process During the last year, ten readiness reviews were conducted. All ten TRRs were conducted with one or more of the following conditions: Matthews, S. A.
Director, Test and Evaluation
April 28, 2013 •Clearly documented panel membership;
•Well defined procedures for voting; and
•Identification of a panel chair The current Department of Defense Instruction (2011) mentions TRR only two times and both forms were in a brief context of the Navy’s responsibility to conduct an independent assessment.
Department of the Navy (2009) discusses the purpose of TRRs, entrance and exit criteria and overall guidance. TRRs are held approximately 1 month prior to the test.
A voting session determines whether a test can proceed or not. The panel considers all information presented and all discussion from the participants and stakeholders before deliberating and voting on whether the test proceeds or not which commits the expenditure of valuable resources. Documented? Defined? Requirements Mandatory Technical Process Rigor & Discipline Clear? •Multiple voting members from a single organization
•Limited panel participation
•Unidentified chair •Specific criteria for the number of voting members per organization
•Roles and responsibilities of panel members Rigorous and disciplined Test Readiness Review process needs to be enhanced. TRR effectiveness is significantly reduced when resources are committed and expended needlessly. Panel voted to proceed: 10 out of 10 TRRs
Eight of the ten tests were unsuccessful (Matthews, 2013). Effectiveness? TRRs are being conducted and resources are being expended for test events BUT the level of fidelity within the decision to proceed is now at risk. The test and evaluation process was documented in 1998 after changes were made to a Navy ship and systems did not operate as expected. Why We Need a TRR? The test and evaluation process is designed to determine if the operation, suitability, sustainability and survivability. Test scenarios are designed by a select core group of engineers to address the criteria. Prior to conducting a live fire test on a Navy asset, a TRR is convened with a panel of experts to determine if the ship is ready to proceed safely to testing (Matthews, 2013). •Identification of a single authority to chair the panel
•Defined authority, responsibility and accountability into a revised instruction Clearly documented panel membership What needs to be done? •Specific criteria for deferring a vote due to inadequate panel membership
•Notification responsibilities of TRR stakeholders Where We Want to Be Bottom Line Up Front Identification of a single authority to chair the panel Well defined procedures for voting Documented?
Clear? Matthews, S. A. (2013). Navy Test and Evaluation: Enhancing the Test Readiness Review Process. Memorandum. Port Hueneme, CA: Test and Evaluation Office.
Navy Ship. (n.d.). In TurboSquid. US Navy Ships V7 [Photograph]. Retrieved from http://www.turbosquid.com/3d-models/navy-h-ship-3d-model/549801 Works Cited The Navy's Test and Evaluation Test Readiness Review Process is a critical component to ensuring a ship's effectiveness. With a few modifications, the Test Readiness Review Process can get back on track. Matthews (2013) discusses how: