In this episode of the XP Series, ๐๐จ๐ง๐จ๐ฏ๐๐ง ๐๐ฎ๐ฅ๐๐๐ซ, Chief Executive Officer at Kinetic Skunk, explores how Real User Monitoring (RUM) is reshaping the way teams approach software quality and testing. Whether you're a QA leader, DevOps engineer, or Digital Strategist, this episode unpacks how RUM, observability, and TestOps together are reshaping modern testing and why itโs no longer just about finding bugs, but optimizing experiences.
Using the AARRR framework, Lucy unpacks how to evaluate the real impact of AI on:
โ Test automation effectiveness
โ Engineering productivity
โ Team collaboration across QA
00:00 Welcome
01:14 Guest Introduction
03:59 Understanding the AARRR Framework
13:15 Key Organizational Challenges in AI Implementation
17:23 Maturity Assessment for AI Adoption
20:52 Self-Healing Tests and AI Integration
27:12 Guardrails for AI Usage in QA
33:01 Transforming the Role of QA Engineers
39:40 Wrapping Up
Real User Monitoring (RUM) vs. Synthetic Monitoring
Exploring the differences between RUM, which captures real user interactions, and synthetic monitoring, which simulates user behavior to test application performance. Dynatrace
Implementing Feedback Loops in Testing
Discussing the importance of integrating continuous feedback into the testing process to improve software quality and responsiveness.
Utilizing RUM Data for Business Insights
Demonstrating how RUM data can provide valuable insights into user behavior, aiding in business decision-making and performance optimization.
Correlating User Behavior with Performance Metrics
Analyzing how user actions can be linked to performance data to identify bottlenecks and enhance user experience.
Challenges for Global Distributed Teams
Addressing the unique challenges faced by distributed teams, such as communication barriers and coordination issues, and strategies to overcome them.
Skills for QA Professionals in Observability
Highlighting the essential skills QA professionals need to effectively implement and leverage observability tools and practices.
Resources for QA Professionals
Providing information on resources and tools available to QA professionals to enhance their skills and knowledge in observability.
Future Trends: AI in Observability and Software Quality
Discussing the role of artificial intelligence in the future of observability and its impact on software quality assurance.
A Guide to Implementing Test Observability for Enhanced Software Quality
How to Use Test Observability to Improve Test Orchestration and Coordination

Integrating Testing into Agile Workflows: Enabling Faster, Smarter Software Delivery | Episode 55
Experience (XP) Series Webinars
AARRR...Are you Test-Ready for AI? Discover If AI Can Transform QA Process | Episode 54
Experience (XP) Series Webinars
Testing LLMs: Why It Matters, Common Data Challenges, and Proven Testing Strategies | Episode 52
Experience (XP) Series Webinars
Building Resilient Quality Engineering Teams: Exploring Emerging Trends and Best Practices | Episode 51
Experience (XP) Series Webinars
Quality First: Implementing Shift-Left Testing for Future-Ready Products | Episode 50
Experience (XP) Series Webinars
See Why Your Testing Framework Is Incorrect, Incomplete, or Inefficient โ And Iโll Show You Why | Episode 49
Experience (XP) Series Webinars
Transitioning from Manual Testing to Test Automation with Cypress | Episode 48
Experience (XP) Series Webinars
Shift Happens: Driving Quality LeftโA Real-World Journey Across Five Teams | Episode 47
Experience (XP) Series Webinars
Building AI-Driven Test Automation Frameworks for QA Excellence | Episode 46
Experience (XP) Series Webinars
How ProductSquads Redefined QE: Challenges with Agile, DevOps, and AI-driven Testing | Episode 44
Experience (XP) Series Webinars
Simulating Real-World Scenarios: Balancing Precision and Practicality in Testing | Episode 43
Experience (XP) Series Webinars
Collaborative Remote Testing: How to Set Up & Run Effective Ensemble Sessions | Episode 42
Experience (XP) Series Webinars
GenAI in QA: Tiket's Approach to Evolving Quality Engineering | Episode 41
Experience (XP) Series Webinars
Why Do We Have Bugs, and Why Do They Happen? | XP Series | LambdaTest | Episode 40
Experience (XP) Series Webinars
Building High-Quality Teams: People, Process & Proof for QA Leadership | Episode 39
Experience (XP) Series Webinars
Building a Test Automation Framework for TV Apps & Scaling at FX Digital | Episode 38
Experience (XP) Series Webinars
Leading the Charge in Software Quality with Zero Bug Revolution | Episode 37
Experience (XP) Series Webinars
AI-Readiness: Are You Building the Future or Falling Behind | Episode 36
Experience (XP) Series Webinars
Upskilling Quality Engineers: A Success Story in SDET Transformation | Episode 35
Experience (XP) Series Webinars
Creating Reliable and Scalable Test Automation Frameworks | Episode 34
Experience (XP) Series Webinars
Building Quality Software: AI-based testing approach with Jira and QMetry | Episode 30
Experience (XP) Series Webinars
The Power of Generative AI in Reducing Maintenance and Enhancing Speed | Episode 28
Experience (XP) Series Webinars
Optimize Issue Tracking: Integrating SpiraTeam with LambdaTest | Episode 27
Experience (XP) Series Webinars
Innovation Accelerated: The Intersection of AI and Quality Engineering | Episode 26
Experience (XP) Series Webinars
From Brainwave to Inbox: Avo's Whimsical Adventure through AI-Native Test Automation | Episode 23
Experience (XP) Series Webinars
Mastering User-Centric Mindset Unlocking Your Potential as a Tester | Episode 22
Experience (XP) Series Webinars
Future Trends and Innovations in Gen AI for Quality Engineering | Episode 21
Experience (XP) Series Webinars
Testing Tomorrow: Unravelling the AI in QA Beyond Automation | Episode 19
Experience (XP) Series Webinars
Shifting Accessibility Testing Left with LambdaTest and Evinced | Episode 18
Experience (XP) Series Webinars
Building Products that Drive Better Results with Shortcut | Episode 17
Experience (XP) Series Webinars
How Codemagic Mitigates Challenging Mobile App Testing Environments | Episode 10
Experience (XP) Series Webinars
Revolutionizing Testing with Test Automation as a Service (TaaS) | Episode 9
Experience (XP) Series Webinars
Crawl, Walk, Run...Fly - Take your build and test pipeline to the next level | Episode 8
Experience (XP) Series Webinars
Fast-Tracking Project Delivery:Tips from a Recovering Perfectionist | Episode 7
Experience (XP) Series Webinars
Shift-Left: Accelerating Quality Assurance in Agile Environments | Episode 5
Experience (XP) Series Webinars
Testing AWS applications locally and on CI with LocalStack | Episode 3
Experience (XP) Series Webinars