Skip to main content

Analytics Modules - Test Overview

SmartUI Analytics - Visual Regression Testing Insights

The SmartUI Analytics module provides a suite of widgets to help you analyze and optimize your visual regression testing efforts on the LambdaTest platform. By leveraging these widgets, you can gain valuable insights into the scale, coverage, and performance of your visual testing initiatives, enabling you to make data-driven decisions and ensure the highest quality of your application's visual integrity.

note

The SmartUI Analytics module is currently in BETA. If you have any feedback or suggestions, please feel free to reach out to us at support@lambdatest.com.

SmartUI Snapshot​

The SmartUI Snapshot widget provides a comprehensive overview of the Visual Regression tests run on the LambdaTest platform. It offers key metrics to help you understand the scale and efficiency of your visual testing efforts.

How It Works​

  • The widget calculates the total number of projects, builds run, and screenshots compared on the platform.
  • It presents these metrics in a clear and concise format, giving you a quick snapshot of your visual testing activities.

Value Proposition​

By leveraging the SmartUI Snapshot widget, you can easily track the volume of your visual testing initiatives. This information helps you assess the coverage and completeness of your visual regression testing, ensuring that your application's visual integrity is thoroughly validated across different projects and builds.

Builds Summary​

The Builds Summary widget offers a detailed breakdown of the status distribution for the Visual Regression tests run on the LambdaTest platform. It provides valuable insights into the overall health and success rate of your visual testing builds.

How It Works​

  • The widget categorizes the builds based on their status, such as Approved, Pending-Approval, Rejected, Partially-Rejected, and Error.
  • It calculates the percentage distribution of builds across each status category.
  • The widget presents the status distribution in a clear and intuitive format, allowing you to quickly assess the quality of your visual testing builds.

Value Proposition​

By analyzing the Builds Summary widget, you can gain a deeper understanding of the effectiveness and reliability of your visual testing process. The status distribution helps you identify any potential issues or bottlenecks in your visual testing workflow, enabling you to take corrective actions and optimize your testing efforts.

The Builds Trends widget provides a visual representation of the status trends for the Visual Regression tests run on the LambdaTest platform over time. It allows you to analyze the performance and consistency of your visual testing builds.

  • X-Axis: Represents the time intervals at which the build trends are measured.
  • Y-Axis: Represents the number of builds categorized by their status (Current and Previous).

How It Works​

  • The widget tracks the number of builds and their respective statuses over a specified time period.
  • It presents the build trends in a graph format, displaying the number of builds for the current and previous time intervals.
  • You can hover over specific data points to view the exact number of builds for each status at that particular time.

Value Proposition​

By examining the Builds Trends widget, you can identify patterns, fluctuations, or anomalies in your visual testing build status over time. This information helps you assess the stability and reliability of your visual testing process, allowing you to proactively address any emerging issues and ensure the consistent quality of your builds.

The Screenshot Trends widget provides a visual representation of the screenshot comparison trends for the Visual Regression tests run on the LambdaTest platform over time. It allows you to track the volume and progress of your visual testing screenshots.

  • X-Axis: Represents the time intervals at which the screenshot trends are measured.
  • Y-Axis: Represents the number of screenshots compared (Current and Previous).

How It Works​

  • The widget tracks the number of screenshots compared over a specified time period.
  • It presents the screenshot trends in a graph format, displaying the number of screenshots compared for the current and previous time intervals.
  • You can hover over specific data points to view the exact number of screenshots compared at that particular time.

Value Proposition​

By analyzing the Screenshot Trends widget, you can gain insights into the volume and velocity of your visual testing efforts. This information helps you understand the scale and coverage of your visual regression testing, allowing you to optimize resource allocation and ensure comprehensive visual validation across your application.

Screenshots Browsers/Device Coverage​

The Screenshots Browsers/Device Coverage widget provides a detailed breakdown of the browser and device coverage for the Visual Regression tests run on the LambdaTest platform. It helps you understand the distribution of your visual testing efforts across different browsers and devices.

How It Works​

  • The widget calculates the total number of screenshots compared for each supported browser or device.
  • It presents the coverage distribution in a visual format, such as a bar chart or pie chart, allowing you to easily identify the browsers and devices with the highest screenshot coverage.

Value Proposition​

By leveraging the Screenshots Browsers/Device Coverage widget, you can ensure that your visual testing efforts are well-distributed across different browsers and devices. This information helps you identify any gaps in your visual testing coverage and make informed decisions to optimize your testing strategy, ensuring a consistent visual experience for your users across various platforms.

Screenshots Viewport Coverage​

The Screenshots Viewport Coverage widget provides a comprehensive overview of the viewport coverage for the Visual Regression tests run on the LambdaTest platform. It helps you understand the distribution of your visual testing efforts across different viewport sizes.

How It Works​

  • The widget calculates the total number of screenshots compared for each supported viewport size.
  • It presents the coverage distribution in a clear and concise format, allowing you to easily identify the viewport sizes with the highest screenshot coverage.

Value Proposition​

By analyzing the Screenshots Viewport Coverage widget, you can ensure that your visual testing efforts are well-distributed across different viewport sizes. This information helps you identify any gaps in your visual testing coverage and make informed decisions to optimize your testing strategy, ensuring a consistent visual experience for your users across various screen sizes and resolutions.

Build Status Ratio​

The Build Status Ratio widget provides a visual representation of the status ratio trends for the Visual Regression tests run on the LambdaTest platform over time. It allows you to track the proportion of builds with different statuses and monitor the overall health of your visual testing process.

  • X-Axis: Represents the time intervals at which the status ratio trends are measured.
  • Y-Axis: Represents the ratio of builds categorized by their status (Approved and Pending-Approval).

How It Works​

  • The widget tracks the ratio of builds with different statuses over a specified time period.
  • It presents the status ratio trends in a graph format, displaying the proportion of approved and pending-approval builds at each time interval.
  • You can hover over specific data points to view the exact ratio of builds for each status at that particular time.

Value Proposition​

By examining the Build Status Ratio widget, you can gain insights into the overall quality and efficiency of your visual testing process. The status ratio trends help you identify any shifts or imbalances in the approval process, allowing you to take corrective actions and optimize your visual testing workflow to ensure a higher proportion of approved builds.

The SmartUI Analytics widgets provide a comprehensive suite of tools to analyze and optimize your visual regression testing efforts on the LambdaTest platform. By leveraging these widgets, you can gain valuable insights into the scale, coverage, and performance of your visual testing initiatives, enabling you to make data-driven decisions and ensure the highest quality of your application's visual integrity.

Unlock the full potential of SmartUI Analytics today and take your visual regression testing to the next level!

Last updated on