- Real Time Testing
- Automation Testing
- Automated Screenshots
- Realtime Native Mobile App Testing
- LT Browser
- Data & Security
- Plans & Billing
Would I need to install a software or extension to use LambdaTest virtual machines?
No. You don't need to install any software or extension or plugin or setting configurations of any type. Just need to login to LambdaTest.com, open the virtual machine through launcher, and start testing. That's the beauty of cloud. It gets you started super quick.
Which operating systems, browsers, and browser versions are you providing for cross browser testing?
There are 2000+ browsers, browser versions, operating systems, devices, and resolutions to choose from. To find out about the complete list of available browsers, checkout this page here.
Are the sessions really running on real browsers or are they just emulators?
All desktop session right now are running on real browsers real operating system and are powered by real machines. Mobile browsers right now are running on emulators. We are working right now to bring real mobile devices as well.
Why are you running windows server edition? It is the same as windows desktop edition?
Microsoft Windows Desktop Editions licences does not support remote access to users. So we use Windows Server editions and implement Desktop experience in it. It has exactly the same experience as Windows desktop editions and they are running Internet Explorers made for desktop editions.
How much time it takes LamdaTest to add new browser version when it's released?
Whenever a new stable browser version is released we usually implement it in our platform within a week. We also test them ourselves first before providing it to customers to make sure that testing experience is optimum for all users.
Are operating systems 32 bit or 64 bit?
Here are the operating systems and browsers running on 32 Bit Operating systems. Windows XP: Internet Explorer 8 , Firefox, Chrome, Safari, Opera Windows 7: Internet Explorer 8, Firefox, Chrome, Safari, Opera Here are the operating system and browsers running on 64 Bit operating systems. Windows 7: Internet Explorer 10, Firefox, Chrome, Safari, Opera Windows 8: Internet Explorer 10, Firefox, Chrome, Safari, Opera Windows 10: Internet Explorer 11, Firefox, Chrome, Safari, Opera All Mac Operating systems run on 64 Bit operating systems.
Which Rich Internet Applications (RIA) would be pre-installed in the browsers?
All our virtual machines comes with pre-installed latest versions of Adobe Flash, Adobe Shockwave, Adobe Reader, JAVA Runtime Environment, Microsoft Silverlight, and Quicktime.
Would I be able to use keyboard shortcuts like copy paste in remote desktops?
You would have full access to all keyboard shortcuts. For people using same operating systems on both their local computer and virtual machine won't have any problems. However people who are using Mac machines to access Windows VM or Windows machine to access Mac VM, would have to careful about OS specific shortcuts. For example when working on Mac OS, use Control Key instead of command key for copy pasting.
Would I be able to download and upload files in the remote browser?
Yes you can. You would have full access to download and upload functionalities. You can access Downloads folder through File - Open file, or Control+O shortcut. Be advised however, each downloaded file will be automatically erased on shutting down the sessions.
Would I be able to change browser settings?
You would have full access to all browsers settings. Be advised however, if you need very specific browser settings, you would have to re-configure browser settings on starting each new session.
I am not able to properly hear the sound in the virtual machine. What is happening?
For Chrome and Firefox browsers, you should be able to access audio streaming and therefore should be able to hear sounds properly. For mobile emulators, Internet Explorer, and Safari, we currently dont have support to provide you access to Audio. It's because of the inherent technology involved in these browsers. We are working on a workaround though so let's see.
How many simultaneous sessions can I start using one account?
In the free plan you can run only one session at a time. Paid plan users can run multiple sessions depending upon their plan. Click here to checkout multiple session plans and their pricing.
It is showing 'Session Limit reached' error even though I am not running a session.
The number of sessions is limited by number of sessions running by a organisation, not by user. Therefore it is entirely possible that you reach out of session limit even if only one or two users are using LambdaTest tool. Co-ordinate with your teammates in this case. If you are sure there is session issue from our end, you can raise a ticket at our support portal here. Don't worry, we have a very fast turnaround time.
What happens when I leave the session idle?
By default, if you leave the Lamdatest Live session idle for 5 minutes, the app will prompt a reminder. If no action is taken then LambdaTest would close the live session. You can change this setting from Live settings options. Checkout this link to understand more about it.
What happens when I switch to another tab in my browser?
Switching tab won't stop or pause the Live session. If left idle for 5 minutes or more, Lambdates will prompt a reminder and if unanswered will close the session.
When you give the machine to somebody else would they be able to access my history and saved passwords?
The moment you close the session, LambdaTest automatically sanitize the whole virtual machine. What that means is that we delete all historical data, downloads, installed extensions, saved passwords, etc. We reset the browsers to factory settings. This automatically logs you out of all pages and auto deletes all data that you may have saved. You would still have access to screenshots and issues you may have generated during the session.
Would i have to reset and re-configure browser settings everytime i create a new session?
Right now yes. Every time you close a session we would reset all settings. We are working on a way to help you change and save a set of customized default browser settings. If your need is critical and changing browser settings in each new session takes a lot of your time, send us a message from here. We will try to find a solution for you.
It is showing that my IP is blocked. Why did this happen? How do i unblock it?
It is showing parallel user limit reached. What does that mean?
LambdaTest test system allows only a limited number of concurrent running sessions per organisation. This limit is defined by the plan that you have subscribed. If you need more concurrent sessions, you can change your plan here, or contact one of our sales executive by leaving a message here.
I found a bug and now I want to take a screenshot of the webpage running on LambdaTest real time browser. How can I do that? Where are they saved?
It's simple. In real time browser, on left side you will find multiple action buttons in the controller. One of them will be a screenshot button with camera icon. Just click that and in no time your screenshot will be recorded. Once recorded, an image editor will pop up where you can edit the screenshot, mark it as a bug and comment about the details. Lastly, you can find them anytime in test logs section of the menu.
How do I report the issue to my team? How can I check the issues created by my organization and team? And can I still report a bug if I am the only one in team?
By going to the issue tracker, you can add your teammates as watchers for the particular issue and you can also assign them the issue by marking them as 'assignee'. Incase the team-mate is not added yet, you will also find an option in the tracker to invite them.
What developer tools come pre-installed in each LambdaTest Live remote session browser?
LambdaTest Live has all major developer debugging tools like Firebug, Web Developer, YSlow etc. For complete list of Developer tools that comes pre-installed with the browsers, checkout this page here.
Can I install any additional tool that I like
Yes. You have full access to browser extensions and therefore can install any additional tool you like. However that tool be deleted once you close the Live session and you would have to reinstall it again in next session to use. If you are facing any problem around installing a tool on browser, raise an issue in LambdaTest Support portal and we would be glad to help you out.
What is WebDriverIO
WebdriverIO is a browser and automation test framework based in Node.js. Adding helper functions in WebDriverIO is really simple in WebDriverIO. Also, it can run both on WebDriver protocol and Chrome Devtools protocol, making it efficient for both Selenium Webdriver based cross browser testing or Chromium based automation. To top it off, since WebDriverIO is open source, you get a bunch of plugins for your automation needs.
Can I Mark My Test As Pass Or Fail?
The LambdaTest Selenium grid doesn’t identify if you test ‘passed’ or ‘failed’. It only identifies whether a test has executed to it’s last command or whether it has stopped/timed-out before it. The user would have to pass on these parameters to LambdaTest platform to make it possible for tracking these values at LambdaTest platform. Make use of LambdaTest API or LambdaTest Annotations, for pushing additional metadata to LambdaTest or to track the pass/fail status of a test.
Can I Run Parallel Testing using JUnit Framework?
Yes! One of the key features of LambdaTest Selenium grid is the ability to run your test cases in parallel. Which means you can execute numerous automation test cases altogether and enable you to cut down on test times. With LambdaTest selenium grid you can run a single test scenario across different browsers or different test scenarios with the same browser (or any other combinations). Wondering how many parallel test cases can you run? That depends entirely on the number of concurrent sessions under your opted plan.
What Is The Maximum Queuing Capacity?
Maximum number of test cases that can be queued = n + 150 Here, n = number of concurrent sessions. For instance, if you are opting for pricing where you can avail up to 10 concurrent sessions. Then the maximum number of test cases that can be queued will be equal to 10 + 150 i.e. 160 queued test cases. LambdaTest would automatically schedule and execute test cases for you. We have added a capacity constraint on the number of tests that can be queued to prevent over-exploitation of the platform. Refer LambdaTest Queuing Policy to know more.
How Many Parallel Sessions Do I Need?
LambdaTest Concurrency Calculator is here to help you calculate the number of parallel sessions you need for your test coverage. Feed the information to our Concurrency Calculator, and it would suggest to you the appropriate number of parallel sessions.
What resolutions, browsers, operating systems and devices are supported by the LambdaTest Automated Screenshot product?
To know more about browsers os devices and resolutions supported by LambdaTest checkout this page here.
Can I share these screenshots with my team?
Yes. You can share these screenshots with your team. To know more about how you can do it, check out this tutorial guide here.
Is there anyway I can take screenshot of pages behind firewall or authenticated pages?
LambdaTest comes with enterprise level local tunneling features. You can connect your local or production servers with LambdaTest Servers via secure SSH protocols and test your secure pages easily.
What happens when I switch tabs during when screenshots are being generated?
LambdaTest won't stop or pause the screenshot generation process. LambdaTest automatic screenshot tool will generate screenshots and then will wait for your further actions.
What type of file formats does LambdaTest Realtime Native App testing support??
Currently, we support the following file formats for Realtime Native Mobile App testing:
- For iOS,
- For Android-x86,
Can I test apps from Google Play Store/App Store on emulators/simulators?
Currently, we don’t support the testing of apps from the Google Play Store/App Store on emulators/simulators.
Can I test ipa file on Realtime Native App testing?
For now, we don’t support ipa files on iOS simulators.
What privileges do I get with the freemium plan?
As a part of the freemium plan, you get one-time, non-renewable access to a limited set of devices (emulators and simulators). It limits to a maximum of 5 app uploads and 100 free minutes.
Can I access the camera and the mic on emulators/simulators?
Accessing hardware peripherals like camera and mic is currently not supported on emulators/simulators.
Do you support gestures like pinch to zoom in, double tap on emulators/simulators?
Gesture is currently not supported on emulators/simulators.
Can I use Developer Tools for Realtime Native App testing?
Yes! you can use Developer Tools for viewing the device logs, network logs, and app logs. Inspect element is currently not available on emulators/simulators.
Why I am getting ‘App Not Found error’ ?
As ipa files are not supported on iOS simulators, you would encounter ‘App Not Found error’.
Can I test my app that uses dependent app (e.g. Google Maps) using Realtime Native App testing?
You need to install the app being tested and the dependent app (e.g. Google Maps) in the same session.
How long does my app remain uploaded on LambdaTest cloud?
As per our data retention policy, all uploaded apps will be deleted after sixty days.
Which architecture do you support for
.apk file for App testing?
Emulators on which App testing is performed work on the x86 architecture. Hence, your .apk file should be built for x86 architecture to ensure seamless testing on LambdaTest platform.
Which plan do I need to buy to get access to Realtime Native App testing?
Any premium plan will allow you to test apps on emulators/simulators. The number of parallel sessions will depend on your parallel session plan. Refer to our plans and pricing page for further information.
Does On-demand pass covers access to Realtime Native App testing on emulators/simulators?
Through On-demand pass you can get 120 minutes of manual testing time on LambdaTest platform at $10 for 30 days. Currently, On-demand pass is not covered for Realtime Native App testing.
How does the concurrency for Realtime Native App testing works?
You need not opt for a seperate App Testing Plan, as parallelism (or concurrency) for app testing is synced with Realtime Browser testing. To run native mobile app tests parallely (or concurrently) with Realtime Browser testing, you need to ‘at least’ be on a two (or more) parallel session plan.
Can I record video of a test session?
Yes. Open you website in any device and click on the video recording button, a timer will start and you will be able to record your interaction of the website within the device. The timer will continue to run unless you stop the recording by clicking over the same video recording button.
Where can I find recorded videos & highlighted images?
To access any of your captured screenshots or recorded video, visit the Media. In Media, you’ll find tabs for Images & Videos. You can download, share, and delete any image or video from the Media tab. And similar to in-built image editor, you can mark a bug from an image stored in Media as well.
Can I test locally hosted websites using LT Browser?
Yes. All you need to do for testing your locally hosted web-apps or websites, is to provide the localhost string as the URL in the header of your LT browser and you’ll be able to access your localhost server.
How To Debug My Website In LT Browser?
With LT Browser, not only can you evaluate how your responsive web design might look over 25+ devices but you can also debug your web-application to figure out the root cause behind a browser or UI bug. To debug your website, click on the button with the debug icon.
Briefly describe your security policies.
LambdaTest is a firm believer in secure experience and multifaceted security protocols, to ensure that every aspect including architecture, engineering, testing, and deployment, follows and complies with industry leading standards of security. As first line of defense, LambdaTest application is protected by AWS’s firewalls which are tasked with countering regular DDoS attacks and malicious network intrusions. The next line of defense is LambdaTest’s own application firewall protocols which are tasked with protecting the application against spam, ill-intent users, and malicious IP. We have also implemented secure user access policies for accessing LambdaTest platform and only users with valid user credentials can access the application. We have also implemented role based access to the application, each role having different access levels.
Whenever a user initiates a test at LambdaTest platform, they are allotted a thoroughly sanitized virtual machine. And as soon as a session ends, all data including cookies, registry, caches, and running processes are deleted and all browser settings are reset to default values. Each virtual machine has to pass a series of automated tests before it is used again. Any machine that fails a test gets redacted from the pool for auditing and manual cleaning. At the time of test only the user has access to machine and not even LambdaTest has access to the user’s running test session. All machines have strict security protocols that prohibit any user from installing any external software in the machines.
In our application we have implemented HTTPS by default, and use VNC protocols for secure data transfer. This data is also encrypted to ensure that data is not compromised in-transit.
All our hosting centers are chosen based on their record of established security policies and excellent history. Our selection process is rigorous and we partner with only the best providers across globe that have been certified by major compliance regulators.
All data saved in our application like login credentials, secure access keys, usage logs, test history, and billing details, are stored in an encrypted format.
We have implemented strict 24×7 security protections at our on-premise development centers. Only authorized individuals have access to building and LambdaTest office premises. Our application data is hosted on industry leading hosts like Amazon Web Services, who have been thoroughly tested by multiple third party auditors for security. You can also read more about Amazon Web Service’s Security Here
Do you have a disaster recovery (DR) or Business Continuity Plan (BCP) plan? How often is it tested?
All our data is hosted and stored in Amazon Web Services infrastructure, which has multi-level disaster recovery features. We implement all AWS guidelines and protocols on Disaster Management as advised in this document by here.
Do your employees sign/agree to a confidentiality statement?
Yes. All our employees sign confidentiality agreements which extends to user agreements between LambdaTest and Clients. Also, we have strict user role based access to all our customer data therefore, only most important employees have access to only relevant data.
Do you hold any certifications related to information or system security? Can we see the audit reports?
We do not have any information or system security certificate at this moment. We have however, applied for Service Organisation Control (SOC) 2 Report compliance certification from US agencies.
How is your application architected, in particular is it separated between publicly accessible parts of the application from the data storage?
Our application is micros-services based product. Database is restricted from public access. It is only accessible to the application though encrypted authentication based APIs and that also over a secure private network.
Describe your coding, testing, and deployment practices.
We here at LambdaTest follow Agile development methodologies with dedicated teams for automated deployment and testing. We use Jenkins as our preferred Continuous integration platform and use Sonar Cube for automated code quality control. We ensure maximum possible code coverage in our automated tests and each release is passed only before it pass all test scenarios.
Do you perform web application vulnerability testing or intrusion detection?
We periodically tests our applications for vulnerability both through automated and manual means. We perform regular audits of databases to check for irregularities, and our ELK stack implementation gives real-time insights on any possible attacks.
How do you manage access to production systems? Do you have a staff termination/offboarding policy and process? What is it? Do you log and audit performance of this process?
Access to production system is strictly controlled though role based authentication access. No LambdaTest employee has complete access to all data, each having their relevant role based access to data. Each employee has his/her own email based authentication passwords for accessing applications and after termination we revoke their complete access to the application. In addition we maintain automated logs of each database ingress and regularly monitor the logs to find discrepancies.
Do you have an enforced password policy for admin accounts? Do you require MFA for admin accounts?
All user access is password protected. In addition user sign-ups are verified through a two-step verification workflow.
What logging do systems perform? How are logs protected? What encryption is used? Do you have BI systems? Do they hold PII?
At LambdaTest, we maintain a variety of logs such as syslog (system logs), auth (authentication) logs, firewall logs, web server logs, application server logs, database server logs, netflows etc. We have an inhouse implementation of ELK stack for logging and business intelligence. Our implementation gathers and consolidates data from all micro-applications into a secure private network. The data is used for product analysis by product team through our custom log processing and BI system. The BI system in turn is secured thorugh a IP based access policy. In addition only authorized LambdaTest employees has access to relevant pieces of data based on their role. All log data is saved in encrypted format private storage volumes that is encrypted usign DM-Crypt disk encryption system
What is your system patching regime?
We follow SemVer versioning standards and publish hot-fixes and patches as it is required.
Do you have separate production, qa, test, dev environments?
Yes. We have separate Production, Dev, and Test Environments. Each Environment is hosted in separate instances and is secured behind a private network.
Are these systems separated from your corporate network and each other?
All environments are hosted on independent AWS instances. Only Live environment has critical user data. Rest of the environments have dummy or simulated data that covers all use cases.
Do you perform system vulnerability scans and penetration testing?
We perform periodic system vulnerability scans, both automated and manual, using a OpenVAS based solution. We check for all major vulnerabilities and security risks as enlisted in open source databases like https://nvd.nist.gov/.
What type of firewalls/DDoS defense do you use?
Our application is hosted on Amazon Web Services and we follow all DDoS mitigation guidelines detailed by AWS in this documentation paper. We use services such as Amazon Route 53, Amazon CloudFront, Elastic Load Balancing, and AWS WAF to control and absorb traffic, and deflect unwanted requests. We also have a Cisco ASA firewall in place as added security measure. In additon to all this we have put into place custom firewall and security measures based on Fail2Ban intrusion protection framework to prevent brute-force attacks.
How do you monitor your systems and networks?
We have implemented advanced analytics using Kibana, Kubernetics, and AWS data tools. We monitor all our networks constantly for suspicious activity. We also use Elastic.co’s Beats product for shipping data. Beats comes with in-built monitoring and data visualization tools that help in real-time monitoring of application.
Are user passwords stored in manner compliant with NIST Special publication 800-63B Digital Identity Guidelines
Yes. All user credentials are stored in a manner compliant with all NIST guidelines as defined here
How is user data stored? What encryption is used for data at rest? What about data in transit?
All user data is stored as encrypted data in secure AWS storage hosted databases. We use AWS S3 for data storage and have enabled advanced 2048bit Public Key encryption standards for Data at Rest. For Data in transit we use VNC and WSS security and encryption protocols.
Can unprotected user data be accessed by your staff? Is this access audited?
All data such as user credentials are secured in encrypted format and no LambdaTest employee can access it, including administrators. User data such as company details, user contact details, test logs, etc. can be access by only relevant developers. We have strict user role based data access and only relevant developers have access to parts of user data. This security access is audited every month based on development and testing sprint plans.
How are backups managed? What encryption is used? How are they destroyed when no longer needed?
We use AWS services like AWS S3 to store and take backups of our data. All data stored on AWS instances are stored using advanced AES256 encryption standards. Any data that is not critically required gets deleted through standard DELETE requests on S3 buckets. However we have implemented versioning and rollback steps to prevent accidental deletion of data. Therefore, even delete requests do not immediately delete all data. For that we have implemented provisions to scrub all data including the historical backup data on client requests.
Do you operate physical infrastructure? If so what certifications do they hold related to physical security? Can we see the audit/certification reports?
Our application is hosted entirely on third party hosting providers like AWS, Hetzner, etc. All our hosting partners have very high security protocols. For example checkout AWS security protocols here, or Hetzner Security protocols here
What is your incident response process?
We, here, at LambdaTest follow a 6 step incident reponse process. The various stages of the response proces are prepration, identification, containment, eradication, recovery, and learning. We use industry leading practices for each step and test our response workflow once a month.
What are your policies and processes around notification of a security breach?
In case of an identified breach, all related users are notified of the breach immediately so that they can take necessary measures to prevent further loss. We share this information with our signup users through our email channels, and also notify users through social media platforms like LinkedIn, Facebook, and Twitter.
Lambda Tunnel connects your servers with my system. How much of our local PC is exposed to your system?
None. Only web requests initiated on LambdaTest platform are transported to your localsystem via SSH tunnel created by our tunnel binary. The data at rest and data at transit are both encrypted. Only web browsing data generated by a webbrowser selected on LambdaTest platform can send data to your system. As such your system is not exposed to public. In addition, every tunnel created using Lambda Tunnel binary is isolated to users of the same account. All Information of the remote tunnel is secured by accesstoken and we employ latest technology in encrypted tokens. This information is only provided to the browser fired the user. With that said, LambdaTest recommends using test data instead of production data as best practice.
What do I get with a Free Trial?
When you sign up with LambdaTest, you receive 60 mins/month Realtime Browser Testing (6 Sessions of 10 minutes each), 100 Automation Minutes for 15 days, 10 Screenshot Tests per month, 10 Responsive Tests per month, 30 Mins Daily Access To LT Browser, 24x7 Support, and 3rd Party App Integrations. The Free Trial is the best way to get a feel for LambdaTest and how it works. LambdaTest is ideal for teams, and therefore you can invite any number of users to be part of your LambdaTest Team for testing.
How does the FREE trial work?
When you sign up, you instantly get access to our Freemium plan. This plan has no trial time limit, it's there for you for Life. In the freemium plan you get 60 minutes of LambdaTest Live testing usage which gets renewed per month. You can anytime upgrade your plan for more robust features and unlimited access to LambdaTest Live Testing machines.
How can I upgrade my LambdaTest subscription?
You can add more user accounts to your existing plan, or upgrade to another plan from the Pricing page. Upgrades can be done any time, and are charged on a prorated basis. Thus, if your subscription is changed during a billing cycle, your billed amount for the month will be prorated. To know more about managing subscriptions, visit here.
What forms of payment do you accept?
We accept all types of credit and debit cards for payment. We have provision of payment using PayPal payment method as well.
Will I get invoice for my subscription?
Yes, you will receive the invoice for the subscription opted. Invoice will be sent by default to the email ID that was used during sign up. You can also download the invoice from from your user account.
What do you mean by parallel session?
Live parallel sessions indicate the number of tests you can conduct at the same time. For example, if you have opted for 2 parallel sessions, two members of your team can execute live testing simultaneously. Or a single member can run 2 parallel sessions.
Is the pricing based on users or parallel sessions?
Pricing is purely based on parallel sessions. User limit is an add-on which comes along with the editions.
Can I upgrade or downgrade my subscription later?
LambdaTest price is based on plan level and the no. of parallel sessions. As per your need you can upgrade and downgrade at any time. However, changes will not take effect until your next billing cycle.
What is a On Demand Pass and how does it work?
An On Demand Pass is a one time payment option for to those who wish to use LambdaTest for a shorter duration. With On Demand Pass, you get 120 Minutes of testing time with full access to LambdaTest features for 30 days at a price of just $10. This is a non recurring payment ,i.e. if you wish to continue this plan you would have to purchase On Demand Pass again.