Zebrunner and LambdaTest: Smart test execution and transparent test analytics

Agile development pushes out incremental software updates faster than traditional software releases. But the faster you release, the more tests you have to write and run – which becomes a burden as your accumulated test suites multiply. So a more intelligent approach to testing is needed for fast releases. This is where Smart Test Execution comes in.

About the Webinar

In this webinar, our special guests, Irina Tsvirko, Software Development Team Lead at Zebrunner, and Veena Devi, Lead Engineer Developer Relations at LambdaTest, discusses effective test automation and provide a unique combo solution that enables QA engineers to execute testing more efficiently.

Since you got the Webinar overview, here’s the webinar video to acquaint yourself with the knowledge bombs that it holds!

Let’s dive into the world of effective test automation with this webinar!

Here’s the agenda for the Zebrunner and LambdaTest: Smart test execution and transparent test analytics webinar:

Introduction to LambdaTest

The webinar kicks off with Veena introducing the LambdaTest platform to the audience, explaining how it enables users to perform various software testing activities like mobile app testing, automated testing, visual regression testing, and more.

She further explains how Selenium testing tools like LambdaTest allow its users to automate Selenium testing across 3000+ browsers and operating systems along with 100+ integrations. LambdaTest supports over 40+ browsers for Cypress testing, including the latest versions of Chrome, Firefox, Safari, Opera, IE, etc. In addition, she also gives an in-depth tour of the LambdaTest platform. Finally, she discusses LambdaTest integrations with third-party tools and how users can leverage the data available in the automation dashboard.

If you use the Selenium or Cypress framework, we recommend checking out our go-to guide for both Selenium and end-to-end Cypress testing with LambdaTest.

Introduction to Zebrunner

Irina Tsvirko, Software Development Team Lead at Zebrunner, introduces the audience to the Zebrunner platform and its offerings. She further explains how the integration of LambdaTest and Zebrunner can help developers run tests through LambdaTest Selenium Grid, present test results directly into Zebrunner, and quickly analyze them with various artefacts (video, screenshots, test logs), AI/ML failure classification, and quality trend reports.

Benefits of LambdaTest and Zebrunner Integration

Going forward, Veena presents a live example of integrating a simple TestNG framework test case first with LambdaTest and then Zebrunner. She explains how users can leverage the LambdaTest integration by changing their local Chrome driver into a remote driver. She also describes how users can access the required capabilities, access key and the hub URL on the LambdaTest platform. After the test case has started to run, users can check the execution status under the automation tab on the LambdaTest platform and the Zebrunner platform.

LambdaTest and Zebrunner Accounts Configuration

In this section, Veena explains how to configure LambdaTest and Zebrunner accounts and perform smart test execution. Next, she walks the audience by showcasing how the local project gets integrated with LambdaTest. Finally, the test case is executed on the cloud platform, and users will validate the results on the Zebrunner platform.

She further explains how users can check out test case history that contains test video recording, input config, etc. and how the issues can be shared with their team members through LambdaTest’s integration with multiple bug-tracking platforms like Jira, Notion, Datadog, etc.

Advanced Test Analysis and Customized Test Reporting

After this, Irina explains how users can make the best of the Zebrunner platform. First, she walks the audience through how users can get their tests executed and reported there with the help of an inbuilt automation launcher. Then, with the help of a sample test case, she explains how users with LambdaTest and Zebrunner integration can leverage the data and dive deep into the errors and issues.

To help the users analyze the tests with the lowest stability percentage, Zebrunner provides an insightful feature called the automatic failure recognition feature. Irina also talks about Zebrunner’s synchronization with test case management tools and how users can play around with them. Next, she briefly explains the platform’s dashboard for a higher level of analysis, proving to be highly useful for the QAs.

Now let’s jump into the Q&A session!

Q&A Session

Before wrapping up, Veena and Irina answered a number of questions raised by the viewers. Here are some of the insightful questions:

How long does the test typically take to run from Zebrunner using the LambdaTest platform?

Veena – So the moment you integrate LambdaTest within the Zebrunner platform, we have a test case already triggered from your existing Maven project to LambdaTest as well as Zebrunner. Like Irina had already showcased how to configure the launcher, in the same way, I can configure my GitHub project. After giving your platform keys, these keys and configurations are user-defined. You can pick them up from a configuration file or define them within the project structure only to configure. After that, you need to press the Launch button, and it will be queued for a few seconds.

The moment you see that it has started the test cases, the exact moment you’ll see the results being executed on the LambdaTest platform. You can also see the commands executed from the Zebrunner tool. The time depends on the number of steps. Although the kick-starting of the test happens at the exact moment for both Zebrunner and LambdaTest, you can see the results once the tests get executed.

What is the benefit of Zebrunner if you are a non-developer?

Irina – So probably from the side of manual testing, you can see the coverage and how many test cases are already automated if you get integrated with your test case management system. So our tool is more for automation testing, but manual testers can also use it and see the analytics or progress.

How do you define transparent test analytics for a black box test engineer?

Irina – So I’ll try to answer this question. So in the scope of our system, we provide transparency for the whole team; thus, allowing engineers to see and analyze all the results in real-time. Also, the management can monitor their process and improve it if necessary.

How can one test engineer maintain these automation test scripts for finding potential defects?

Veena – When you talk about test case maintenance, we have integrated many test case management tools in LambdaTest and Zebrunner.

Irina – Probably your automation scripts can be fixed from the code in your IDE if they require some fixing. So from our side, we cannot edit your automated test code, but you can edit them and report them again to see the results.

Veena – Yes, so LambdaTest also helps you execute, but no direct code editor is present on the platform. So all you can leverage are the available script management tools.

Can LambdaTest only be used for UI Testing or can it be extended to API?

Veena – So LambdaTest is basically for mobile app testing. If you want to test your API, whose validation can happen through UI, you can easily do it on the LambdaTest platform.

Can you suggest any source for this topic?

Veena – So as I mentioned, LambdaTest has a lot of blogs and YouTube videos from a lot of QA influencers. You can check the LambdaTest blogs and LambdaTest YouTube channel, and along with this, both platforms have documentation for every feature they offer.

In LambdaTest, can you split a test suite on multiple browsers – basically can I parallelize 10 test suites at the same time?

Veena – Okay, so here is a test suit (XML); rather than providing a single.xml file, you can give a folder. Adding *.xml will pick all the .xml files under the folder, and if you see the suit file, it can have multiple test classes based on the available parallel threads for your LambdaTest account. You can leverage this thread count and execute your test cases from here. It is not necessary to have multiple test suites. A single test suit can have various classes, and each class may have different browser capabilities. If you see here, class one will run on Windows 11 Firefox, and another class is executing on macOS Safari. So in this way, you can achieve your parallelism within LambdaTest, providing a definite capability.

Irina – We have a limited number of browsers on parallelism, but you can run your tests in a very large number of threads. If your need for parallelism is very high, you can integrate with LambdaTest and benefit from that.

Hope You Enjoyed The Webinar!

We hope you liked the webinar. In case you missed it, please find the recording of the Webinar above. Make sure to share this article with anyone who wants to learn more about smart test execution. Stay tuned for more exciting LambdaTest Webinars. You can also subscribe to our newsletter Coding Jag to stay on top of everything testing and more!

That’s all for now, happy testing!

Devansh Bhardwaj

Devansh works as a Product Marketing Executive at LambdaTest. With a degree in Business Administration and a keen interest in technology, he loves to write about the latest technology trends.

See author's profile