Testsigma vs Applitools

Testsigma vs Applitools

5 February 2024 Stephan Petzl Leave a comment Tool comparisons

In the dynamic landscape of test automation, Testsigma and Applitools stand out as powerful AI-driven platforms. Testsigma offers a low-code, user-friendly approach with comprehensive support for mobile, web, and API testing across devices, while emphasizing ease of use and integration with CI/CD pipelines.

On the other hand, Applitools harnesses Visual AI and computer vision technology, focusing on visual testing efficiency across multiple platforms, and integrates with device farms like AWS Device Farm. Both platforms provide no-code solutions and free plans, catering to a broad spectrum of testing needs.

Latest update: 1/31/2024, 5:18:29 PM
We do not guarantee the accuracy, reliability, or completeness of the information presented on our website. This includes prices, product specifications, and availability, which are subject to change. The reviews on this site are collected from g2.com and crozdesk.com and summarized by us.

Feature comparison of Testsigma and Applitools

Free Plan
On Premise
Device FarmN/A
Test RecorderN/A
Physical Device TestingN/A
No Code
Uses Ai
Generates Reports
Uses Computer VisionN/A
Ease Of Usevery easy to learneasy to learn
Is Open Source
Support Included
Review Pros 1. Rapid Test Automation: Users can automate most test cases quickly without needing expertise in specific languages or frameworks.
2. Customer Support: The support team is highly responsive and easily accessible directly through the platform.
3. Ease of Use: The platform is user-friendly, requiring minimal training to handle.
4. Test Step Grouping: This feature streamlines the development of new scripts by grouping test steps.
5. No-Script Automation: Offers a codeless approach to test automation, making it accessible to non-technical users.
6. Integration Capabilities: Testsigma allows for seamless integration with various tools, enhancing the automation suite.
7. Natural Language Processing (NLP): Testsigma uses NLP for test cases, making it intuitive to write tests in plain English.
8. Accessibility: It caters to users with non-technical backgrounds, allowing them to learn and use the platform effectively.
9. End-to-End Testing: It supports comprehensive testing, including validation of OTPs via Email and SMS.
10. Custom Functionality: Users can import custom code to extend functionality when required actions are not available.
1. Easy to use and implement into existing automation workflows.
2. Customer-focused support and assistance.
3. Facilitates the detection of unintended changes, especially in large applications.
4. Shallow learning curve, making it accessible for QA teams with less coding experience.
5. Enhances cross-browser and cross-device testing capabilities.
6. Visual regression testing moves beyond simple visibility checks to ensure visual perfection.
7. Integration with popular frameworks like Cypress for immediate feedback on changes.
8. Offers multiple SDKs for ease of creating and comparing visual snapshots.
9. Features like self-healing capabilities for cloud runners improve user experience.
10. Supports visual validation for accessibility and early component validation in the delivery cycle.
Review Cons 1. Limited Database Testing: Currently, Testsigma does not support direct database testing, though some validation can be done using custom functions.
2. Reporting Features: The reporting capabilities are somewhat limited and could be improved.
3. Performance Issues: Some users have reported slower execution times and non-functional cloud devices.
4. End-to-End Testing Complexity: While possible, some users find end-to-end testing to be challenging.
5. Salesforce Integration: There is a need for improved integration features with Salesforce.
6. Ticket Tracking: Improvements could be made in how user-raised tickets are tracked.
7. Desktop Application Automation: Testsigma does not currently support the automation of desktop applications.
8. Element Inspection Limitations: Some elements cannot be inspected directly, requiring workarounds like Sikuli for interaction.
9. Occasional Errors: Users have encountered intermittent errors, sometimes due to platform maintenance or upgrades.
10. Lack of Transparency: There is a need for better communication regarding maintenance and updates that may affect test performance.
1. The platform can be sluggish on slower connections or computers.
2. Initial maintenance and setup may require some time to get used to.
3. Error reporting can be problematic for automated report generation.
4. Snapshot quality issues have been observed, although updates have addressed them.
5. Lack of built-in support for Azure DevOps Server on pipelines (though now available and updated).
6. Misuse of the tool due to a lack of understanding of its collaborative potential.
7. Branch and baseline management can be confusing, especially for non-technical team members.
8. The cost of Applitools can be prohibitive, especially for large companies requiring many accounts.
9. The GUI, while user-friendly, may oversimplify for advanced users or specific use cases.
10. While the tool is mature and comprehensive, its powerful features come with a high price tag.

Pricing Overview: Testsigma vs. Applitools

Testsigma Pricing Model

Testsigma provides an AI-driven testing platform with a tiered pricing structure that includes:

  • Free Plan: Suitable for smaller projects with limited testing needs.
  • Pro Plan: Offers unlimited automated testing minutes and extensive device/browser combinations, aimed at fast-growing teams.
  • Enterprise Plan: Tailored for large teams with advanced security, unlimited storage, and dedicated support.

Both Pro and Enterprise plans require custom pricing, and Testsigma encourages direct contact for a personalized quote.

Applitools Pricing Model

Applitools delivers automated visual testing through its Visual AI platform, with several pricing tiers:

  • Free Account: Allows for 100 checkpoints per month for a single user.
  • Starter Plan: Provides unlimited tests for up to three users, limited to public cloud use.
  • Eyes and Ultrafast Test Cloud Plans: Designed for enterprises with unlimited tests and users, supporting over 20 parallel tests on various cloud options.

Applitools also offers discounts for startups and open-source projects, with all plans accommodating a range of project sizes.

Comparison of Pricing Models

When comparing the pricing models of Testsigma and Applitools, several common points and differences emerge:

Common Points

  • Tiered Pricing: Both offer a variety of plans to cater to different user needs, from free or limited options to comprehensive enterprise solutions.
  • Custom Enterprise Pricing: Both Testsigma and Applitools provide customized pricing for their enterprise plans, requiring direct contact for quotes.
  • Free Options: Each has a free tier, allowing users to test the platforms with basic functionality before committing to a paid plan.

Key Differences

  • Plan Structure: Testsigma’s Pro plan offers unlimited automated testing minutes and more advanced features for growing teams, whereas Applitools’ free account and Starter plan are more limited in scope but offer unlimited tests within those constraints.
  • Parallel Testing: Applitools includes parallel testing capabilities in its plans (with up to three in the Starter plan and over 20 in enterprise plans), while Testsigma mentions parallel execution as a feature without specifying limits in its Pro plan.
  • Cloud Options: Applitools provides more flexibility with cloud options (public, dedicated, and on-premise) for enterprise plans, whereas Testsigma does not explicitly differentiate between cloud options in its pricing model.
  • Support for Startups and Open Source: Applitools offers discounts for qualified startups and open-source projects, an option not mentioned by Testsigma.
  • Dedicated Support: Testsigma specifically highlights dedicated support in its Enterprise plan, while Applitools mentions enterprise support without specifying if it’s dedicated.

In summary, while both Testsigma and Applitools offer structured pricing models to accommodate a range of user needs, Testsigma emphasizes tailored solutions for growing and large teams with a focus on unlimited automated testing and custom enterprise features. Applitools, on the other hand, focuses on providing a range of testing capabilities with an emphasis on visual testing and support for different cloud environments, as well as special considerations for startups and open-source projects.

Like this article? there’s more where that came from!