Automated Cross Browser Testing With Jasmine Framework & Selenium

Posted by Kritika Murari | June 22, 2021
Automation β€’ Cross Browser Testing β€’ JavaScript β€’

118271 Views | 12 Min Read

In today’s fast-paced world of software development, we have new technologies and languages for development coming on very frequently. With this comes several testing and automation tools and frameworks in the related market. Choosing the right set of tools and frameworks becomes an absolute necessity because it impacts the accuracy and TTM (Time to Market).

JavaScript is one of the widely used programming languages for web automation testing. It also supports a number of Selenium automation testing frameworks for web UI testing. Of all the available ones, Jasmine JavaScript testing framework turns out to be the best-suited, as it provides a stable and functional architecture. It is easy to get started with Jasmine and is also easy to implement test scenarios with the same.

In this Selenium automation testing tutorial, we look into the nitty-gritty of the Jasmine JavaScript testing framework from an automation testing standpoint. We will also learn how to set it up, followed by a sample code writing and execution. In subsequent sections of this Selenium Jasmine tutorial, we will also learn how to run Jasmine JavaScript tests at scale on a cloud-based Selenium Grid like LambdaTest.

So let’s get started!!

Introduction to Jasmine

Jasmine is an open-source JavaScript testing framework. It is a behavior-driven (BDD), development-inspired framework that is independent of any other frameworks. It is used for unit testing of both synchronous and asynchronous JavaScript test scenarios. In addition to its outstanding support for JS, it also provides extensive support for Python, Ruby, and other JavaScript-based languages. Furthermore, it is available for different versions like standalone, node.js, etc. An additional benefit of using Jasmine is that it is an independent framework with minimal (to no) dependency on language, browser, and platform.

Jasmine JavaScript testing framework does not require a DOM and is very easy to set up. Also, it provides an immaculate and easy to read syntax like below example-

Why use Jasmine as a Testing Framework for JavaScript Tests?

Having understood what Jasmine is, let us look at the key features (or advantages) of using JavaScript Selenium automation testing for Web UI testing:

  • Easy to set up and easy to write tests.
  • Very fast as it has almost zero overhead and no external dependencies for Jasmine core.
  • It comes with out-of-the-box support to fulfill all the test needs.
  • Can run the browser and node.js tests with the same framework.
  • An extensive & active community and regularly updated documentation for support and development.
  • Support for usage of spies for test doubles implementation in the framework.
  • It even supports testing of front-end code using the Jasmine-jQuery extension.
  • It also supports test-driven development in addition to behavior-driven development.
  • Unlike other JavaScript testing frameworks, the Jasmine testing framework has built-in assertions.
  • It comes with an inbuilt test runner, which can be used to run browser tests.
  • Provides a rich number of built-in matchers that can be used to match expectations and add asserts to the test cases. Some examples are toEqual, toBe, toBeTruthy, toBeFalsy, toContain, toBeDefined, toBeUndefined, toBeNull, toBeNaN, etc.

Advantages of using Jasmine JavaScript Testing Framework with Selenium

Jasmine and Selenium are popularly used for JavaScript automation testing and web UI automation testing respectively. When working on a JavaScript-based web UI project, it is better to combine both the forces to take the advantage of both of them:

  • Jasmine JavaScript testing framework and Selenium automation testing complement each other in being open-source, easy to implement, and scale.
  • Their capacity to work with almost all browsers and platforms is another added advantage.
  • By using a Selenium Grid, Jasmine tests can be executed more quickly through parallel execution. You can refer to our earlier blog on Importance of Parallel Testing in Selenium to get a detailed understanding about the advantages offered by parallel test execution.

Getting Started with Jasmine

Having gathered some knowledge around the what & why of the Jasmine testing framework in JavaScript, let us now dig deeper and get our hands dirty with the implementation. In this section of the Selenium Jasmine tutorial, we will learn about the workflow of Jasmine and understand the basics of writing test scenarios.

Let us assume we need to test a file test.js using Jasmine JavaScript testing framework. SpecRunner.html would be the output file that will run all test cases from spec.js taking Lib as an input and then show the results in the browser.

Group

  • Lib : Consists of built-in JavaScript files that help to test varied functions and other JS files within the project.
  • SpecRunner.html : A usual html file that will render the output of the test run in the browser.
  • test.js : This file comprises the actual functionalities/code under test, which is to be tested with the help of spec.js and lib file.
  • spec.js : Also referenced as the test case file, this contains all the testcases in a prescribed format for the file to be tested.

Here are the basic building blocks of Jasmine tests:

  • Suite Block
  • Suite forms the basic building block of the Jasmine JavaScript testing framework. One suite is composed of test cases or specs written to test a particular file and is made up of two blocks: the describe() block and it() block.

  • describe()
  • This is used to group related test cases written under it(). There is only one describe() at the top level, unless the test suite is a nested one. In which case, it takes a string parameter to name the collection of test cases in that particular describe() block.

  • it() – contains specs/test cases
  • This is used to define the specs or the test cases inside the describe() block. Like a describe(), it takes similar parameters – one string for name and one function that is the test case we want to execute. A spec without any assertions is of no use.

    Each spec in Jasmine consists of at least one assertion, which is referred to as expectation here. If all expectations pass in a spec, it is called a passing spec. On the other hand, if one or more expectations fails in a spec, it is called a failing spec.

    Note: Since both it() and describe() blocks are JavaScript functions, all the basic variable and scope rules apply to them as per js code. Also, they can contain any valid executable code. This means variables at describing() level are accessible to all and it() level within the test suite.

  • Expectations or Matchers
  • Expectations or matchers are a way to implement assertions in the Jasmine JavaScript testing framework. This is done with the help of expect function, which takes the actual value produced by the test case as output.

    It is then chained with a matcher function that takes expected results for that test case and then evaluates them to give a boolean result. The returned value is true if the expectation matches, else it is false. Jasmine also provides the utility to check for negative assertions by adding not before the matcher for a required expect function.

    All the expect functions come under it() block, and each it() block can have one or more expect() blocks. Jasmine provides a wide range of in-built matchers and lets you extend matchers via custom matchers.

    Here is a small example to understand the usage and implementation of describe(), it(), and expect() blocks. We will be testing a file named Addition.js having a corresponding spec file with test cases as AdditionSpec.js.

Jasmine JavaScript testing framework also provides support for nested suites utilizing nested describe() blocks. Here is an example of a spec file with nesting for the same Addition.js.

Using Standalone Jasmine Distribution For Selenium Automation Testing

To get started with Jasmine, follow the below mentioned steps to complete the system setup.

Step 1 : Download the latest version of Jasmine from the official website.

Selenium Automation Testing

Step 2: Download the standalone zip for the selected version from this page.

Step 3: Create a new directory in your system and then add a sub directory to it.

Step 4: Move the downloaded standalone zip inside this sub directory and unzip it here. Once unzipped, your directory structure should look something like this.

Step 5: In order to verify the setup, load the SpecRunner.html in your web browser. If you see an output something like below, it means that you have completed the setup for Jasmine on your system.

Let’s see how to modify this to run our test case for Addition.js using AdditionSpec.js and Nested_AdditionSpec.js.

Firstly, we will remove all the existing files from src and spec folder and add the files for our example which we have understood already. After doing this, the folder structure would look something like this.

Having updated the files, we need one more step to execute our specs, which is to update references to files under spec and src folder as per our changes in SpecRunner.html.

For this open the SpecRunner.html and it would look like this.

Just update the file name in the src and spec section and save it, and you are ready to load the SpecRunner.html again to see the results.

Setting Up Jasmine Environment using npm for Selenium Automation Testing

In order to get started with Selenium automation testing using Jasmine framework in JavaScript, we need to have some prerequisite setup in our system:

Step 1: Make sure the latest JavaScript version is installed on the system. Also, check for node.js and npm on your system and upgrade to the newest version if required.

Step 2: Navigate to the directory where you want to create your test case, execute it, and install Jasmine by triggering the npm command.

Step 3: Once this is done, we will install Chrome Driver and Selenium WebDriver in the same directory to execute Jasmine Selenium test cases on the local Selenium Grid.

Step 4: Once all this is done, we are good to initialize our Jasmine project using the init command.

jasmine init

You should be able to see a spec folder which will be further used for adding test case files. For this Selenium Jasmine JavaScript tutorial, we will be using the following .js file.

In this example file, we have automated a scenario to navigate to the LambdaTest login page and then verify the welcome message on the page. We have used a local Selenium WebDriver and running the tests on the Chrome browser. To execute the test case, use the following command if you are at the same directory level as the file.

Once triggered, you will see a chrome browser tab open up on your system and get redirected to a given page, and after successful verification, the browser is closed, and the terminal shows logs like below.

Using Jasmine JavaScript Framework to run Selenium Tests on cloud-based Selenium Grid

Running tests on a local Selenium Grid is not a scalable and reliable approach. You would need to invest significantly in building the test infrastructure if the tests have to be run across a number of browsers, platforms, and device combinations. This is where cloud testing can be useful as it offers the much-needed benefits of scalability, reliability, and parallel test execution.

Read – What Are The Benefits Of Website Testing On The Cloud

We will run the Jasmine tests on Selenium Grid Cloud on LambdaTest. You would need to have your LambdaTest username and access token handy to continue with the execution, details are available in the LambdaTest profile section. Set the following environment variables on your machine:

  • For Mac/Linux
  • For Windows

Once this is done, we modify the spec file to have a remote web driver configuration for the LambdaTest Hub to execute test cases on the grid.

For this, we will be adding the required browser capabilities for execution on the LambdaTest Grid and use a remote web driver on their grid. Modified exampleSeleniumSpec.js as per our requirements would look like this:

This would also have a similar command to execute and would give the same output as follows on the terminal.

You can now navigate the LambdaTest dashboard for the user account and view the execution results and logs on various tabs.

Under Recent Tests on the left side, you can see the latest execution on the Dashboard tab.

Cross browser testing with jasmine

To analyze the complete timeline for your different test case runs, we can navigate to Automation Tab.

utomation testing with jasmine and selenium

On Automation Tab only, go to the Automation Logs section to view the entire execution logs and the video of our test case. This helps in debugging the issues by analyzing the run.

jasmine framework and selenium

You can also navigate to other tabs and per the requirement to add/view data for the execution.

With this, we have completed our Jasmine JavaScript Selenium tutorial to understand the setup and execution with Jasmine on the local and LambdaTest Grid cloud. Check out JavaScript video tutorials on LambdaTest YouTube channel to get a deeper understanding about test automation with JavaScript.

It’s a Wrap

It’s a Wrap

So, in this Jasmine JavaScript testing framework tutorial with Selenium, we learned about the whats and whys of Jasmine and Selenium, how they make a good combination for automation web UI-based code using JavaScript, and all advantages it provides. Having done the setup and understanding the test case basics, we have successfully executed our test case on local and Selenium Grid with the help of LambdaTest, which provides us with 200+ browsers and OS combinations to fulfill all our testing needs. So, get started and write your first Selenium automation testing code with Jasmine and JavaScript.

Happy Testing!!

Written by

Related Articles

TDD vs. BDD: Choosing The Right Framework

106800 Views | 19 Min Min Read

Leave a Reply

Your email address will not be published. Required fields are marked *