Downloaded 206 times
Uploaded byRichard Bishop
Cloud Performance Testing with LoadRunner
The document discusses cloud performance testing using LoadRunner, emphasizing its evolution, capabilities, and integration in the cloud environment. It highlights key features, decision factors for selecting testing tools, and provides use cases along with a case study for practical understanding. The document also mentions the challenges and benefits associated with cloud testing, along with tips for effective execution.
In this document
Powered by AI
Overview of the presentation titled 'Cloud Performance Testing with LoadRunner' led by Richard Bishop & Gordon Appleby.
Introduces Richard Bishop and Gordon Appleby, their roles in Vivit, and their extensive experience in performance testing.
Details the agenda covering introductions, cloud timeline, LoadRunner history, tool selection, Use Cases, and more.
Defines cloud computing and its evolution over the years, highlighting the hype surrounding its adoption.
Chronicles the evolution of LoadRunner and related products, emphasizing multi-protocol support and cloud integrations.
Decision factors for selecting a performance testing tool, with a focus on cloud-based options and specific LoadRunner configurations.
Explains the concept of Load Generators, detailing setups for on-premise and cloud performance testing.
Compares different LoadRunner products, focusing on use cases, testing frequency, and reporting capabilities.
Describes features of LoadRunner in the cloud, including flexible licensing, user capacity, and integration with HP ALM.
Discusses the reliability and performance concerns of cloud testing, and raises questions about its efficacy.
Presents various scenarios for using cloud services in testing, including budget considerations and agile environments.
Provides insights on virtual user limits with specific examples, along with a case study from a UK financial organization.
Offers tips and strategies to optimize cloud testing, addressing common concerns and advocating for thorough testing.
A demonstration of LoadRunner capabilities in the cloud was presented.
Wraps up the presentation, providing contact information for further inquiries.
More Related Content
Similar to Cloud Performance Testing with LoadRunner
![UiPath Automation Suite Installation (Hands-On) [2/3]](https://cdn.slidesharecdn.com/ss_thumbnails/automationsuitecommunitysession2-251015095633-a6d862f1-thumbnail.jpg?width=600ounds&width=560&fit=bounds)
Cloud Performance Testing with LoadRunner
- 1. B6424 Cloud PerformanceTesting with LoadRunner Richard Bishop & Gordon Appleby 3rd December 2014
- 2. Cloud Performance Testingwith LoadRunner Richard Bishop & Gordon Appleby © Copyright 2014 Vivit Worldwide
- 3. Trust IV •Richard Bishop • Vivit Leader in UK, Board Member • Performance Tester since 2000 • Background: IT Infrastructure > MCSE > Automated Software Testing • Gordon Appleby • Vivit Co-Leader in UK • Performance Tester since 2000 • Background: Ops > Dev > Infrastructure > Messaging / Collaborative Technology > Consultancy > Automated Software Testing
- 4. Agenda Introductions Cloud timeline and hype LoadRunner history and development Choosing the right test tool LoadRunner in the Cloud Testing from the Cloud • Use Cases • Case Study Cloud testing tips Demo Q&A / Discussion
- 5. What is theCloud? “Cloud is a style of computing where scalable and elastic IT-related capabilities are provided as a service to external customers using Internet technologies” Gartner 2010 1968 1990 1998 Last 10 years 1962 1989 1992 1999 2006 2014
- 6.
- 7. LoadRunner and relatedproducts LoadRunner 6.0 2008 2010 2014 Performance Center 9.0 1990s On-Premise In-cloud 2006 Performance Center LoadRunner in the Cloud V2 StormRunner LoadRunner 8.0 LoadRunner 9.0 2012 LoadRunner 11.0 LoadRunner 12.0 Performance Center 11.0 Performance Center 12.0 LoadRunner in the Cloud V1
- 8. What does LoadRunneroffer ? Features such as TruClient make scripting easier. Simple record / replay Multi-protocol support, unlike most competition. Single tool for Mobile, Ajax, Flex, HTML / HTML5, .Net, Java, Silverlight, SOAP, Citrix, ERP and legacy Browser and mobile device emulation built in. Options to extend testing with network and service virtualisation. Various cloud options: Integration with Amazon & HP Cloud or other third parties. SaaS options with StormRunner and Performance Centre. Integration with multiple IDEs as well as CI and automated build systems. Real time analytics built in, options to extend with SiteScope. Diagnostic tool support, HP Diagnostics & third party tools. Excellent reporting.
- 9. LoadRunner and relatedproducts LoadRunner 12.0 LoadRunner in the Cloud V2 StormRunner Performance Center 12.0 Best of breed performance test tool Integrates with other ALM products Multi-protocol support, excellent reporting capabilities Alternative to LoadRunner (on-premise) On-demand licensing and hardware Detailed reporting Multi-protocol support Cloud only On demand usage Uses standard LoadRunner scripts (web only) Less detailed reporting but great for “burst testing” Enterprise testing Better integration with HP ALM suite Dashboards, shared assets, ideal for global “follow the sun” operations
- 10. Which tool shouldI choose? Decision factors • Application Under Test • Comms protocols • Virtual user numbers • Virtual user locations • Tester locations • Tester skillset • Existing test assets • Script complexity • Test data requirements • Security • Budget • Timescales • Cloud?
- 11. Choosing a cloud-basedtest tool StormRunner LoadRunner in the Cloud LoadRunner 12.0 Performance Center SaaS Load Generators Performance Center On-premise Load Generators
- 12. LoadRunner on-premise LoadGenerators Load Generators LoadRunner 12.0
- 13. LoadRunner in theCloud LoadRunner in the Cloud Load Generators Load Generators
- 14. Performance Center on-premise Load Generators Performance Center On-premise Load Generators
- 15. Performance Center SaaS Performance Center SaaS Load Generators Load Generators
- 16. StormRunner StormRunner LoadGenerators
- 17. So which productshould I choose? StormRunner LoadRunner in the Cloud LoadRunner Performance Center Quick, high volume tests Web only Remote load generation Short-term engagement (s) Any protocol Remote and local load generation Advanced use e.g. NV, diagnostics etc. More frequent testing C of E approach Remote and local load generation Detailed reporting and analysis Very frequent testing Larger C of E / “follow the sun” Dashboard for stakeholders Integration with ALM etc.
- 18. LoadRunner in theCloud Web-based VM admin console • Pre-configured servers, flexible license options. • 100, 200 & 500+ vUsers on-demand • Support for any other number • All LR protocols supported • Controllers and Load Generators • CPU / RAM / HDD configurable • With or without firewall • Remote or local LGs • All HP ALM integrations supported • ALM / QC / UFT • NV software pre-installed • UFT and other software available • On-demand availability and pricing • PayPal or Account • Pay for what you use • Efficient license use
- 19. Is “The Cloud”any good for testing? “Cloud computing is a model for enabling convenient, on-demandnetwork access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction.” Source: The National Institute of Standards and Technology BUT…. • Unproven technology for testing: reliability/repeatability • Steep learning curve • Costs difficult to quantify • Security concerns • Performance
- 20. But does itwork?
- 21. Use Case 1 Variable / unanticipated demand Ad-hoc testing at short notice
- 22. Use Case 2 Small organisation, limited budget Possibly considering open-source Performance Center LoadRunner LoadRunner in the Cloud StormRunner
- 23. Use Case 3 Users outside firewall Better end to end tests
- 24. Use Case 4 Agile Dev/Ops Developers do own testing, limited budget, pay-per-use desirable Multi-protocol support. SOA testing Component-level testing Service Virtualisation etc. Integration with multiple IDEs as well Integration with CI and automated build systems.
- 25. Use Case 5 High Virtual User Numbers Lots of load generators needed Virtual User Type vUsers per Load Generator Web (HTTP / HTML) 2000 TruClient 50 RDP 200 Citrix ICA 20 SAP GUI 20
- 26. Anon Case Study UK Financial organisation 250 vUser tests Citrix and Web Needed “outside firewall testing” Needed remote testing
- 27. Tips when testingfrom cloud Valid concerns 1 - “You don’t know what you’re getting with virtual machines” 2 - “Performance of load generators is too variable” 3 - Understand your application 4 - Time synchronisation Avoid pitfalls Know your platform’s capabilities Over provision Smoke test AUT and test platform Re-validate tests, test and re-test (best practice) Use diagnostics software to simplify performance engineering Monitor all infrastructure closely Optimise test tool for virtualisation platform Use benefits of the cloud/virtualisation Low cost On-demand Flex up & down Over provision Research the subject
- 28. Demonstration LoadRunner inthe Cloud
- 29. Thank you Pleaseask / get in touch if you have any more questions: Richard Bishop @richardbishop richard.bishop@trustiv.co.uk http://uk.linkedin.com/in/richardbishop Gordon Appleby @trustiv gordon.appleby@trustiv.co.uk http://uk.linkedin.com/in/gordonappleby www.vivit-worldwide.org blog.trustiv.co.uk © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.