Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Dev Ops & Continuous Integration Environments

Continued version of http://prezi.com/ro1dcu09ng-y/performance-testing-in-continuous-integration-environments/
by

Sambuddha De

on 11 December 2014

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Dev Ops & Continuous Integration Environments

Sharing
Dev Ops & Continuous Integration
at Move

Today
Integrating Tests In CI

Sambuddha Kishore De

1 year ago
Waterfall / Agile methodology
One large team of QA and Devs
Lack of communication between QA, Devs and Ops
1 release every 30 ( + delays)
Manual builds to QA/Prod environments
Partial automated tests
Long and tense integrations
Painful deployments
lack of monitoring
...
Late performance tests would delay release
Agile
Smaller teams
Better communication among team
Every day releases
Continuous deploy-ability
Visibility into build process and status
Automated tests
Reliable deployments
...
Early performance issue discovery

Teamcity Nightly Tasks
Server Side Performance Tests
Tools:
1. Neoload for load generation
2. Dynatrace for troubleshooting

Client Side Performance Test
Tools:
1. Cucumber and Selenium: browser side testing
2. Dynatrace : browser metric gathering
Reports
Push "master" branch to performance environment
Run Unit Tests
1.
web application
Run load test scenario
Dynatrace + Neoload
Reports
2.
Metrics
Server Side performance
Response times (Average and Median)
Throughput
Error rate
Number of external service calls
Number of DB calls
Monitoring
CPU usage
Memory
Disk
Network

web application
Run test
Dynatrace + Cucumber
Reports
Metrics
Browser Metrics
Onload time
Timer duration
Number of requests
Number of domains


JS activities
Render time
Number of exceptions
Server time
...

+
@performance

Feature: Measure Front-end Performance for Not For Sale User Scenario

Scenario: Measure Performance for Not for Sale Search Page
Given I am a new user
And I am in "Not For Sale" Landing page
And I want to measure performance for "RDC_NotForSale_Search_Page"
Given I am in "Not For Sale" SRP on "Las Vegas, NV" search
Then measure performance
3.
4.
4.
Start and Stop Timers
Thank you
Sambuddha Kishore De

sambuddhakishorede@brillio.com

CAMS
Culture
Automation
Measurement
DevOps Practices
Checks & Balances
Agile
How do we do it?
Journey to Agile and DevOps
Future work

Expand automation to other teams at Move
Put up on monitors in the office
Automated analysis of data
Integration with Brillio's CMMi L5 practice.
Agile training for the team

Move.com®
realtor.com®
Moving.com
TOP PRODUCER® Systems
ListHub
TIGERLEAD
SocialBios.com
Builders Digital Experience
Featuredwebsite.com
Automatic Builds - Octupus Deploy
CI - Teamcity
Standard Test Automation Framework
WIKI
Office rearrangements
Interactive layout
Whiteboards
Communication areas

Adopted Agile Culture
Scrum and daily stand ups
Continuous involvement of the Ops team
Involvement of dependent teams
Hackathons!!
Senior Housing
Agile - Across the Organization
GitHub
Squad branching and daily merges
Squad Branches
Master Branch
Automated and Manual testing
Manual testing for tickets
Automated Code review using Resharper
Automated BAT and Regression (70-80% coverage)
Automated performance testing
Deployment and Monitoring
Feature switching
Octopus deployment
New Relic Monitoring
Advanced manual and automated alerts
Full transcript