Testsigma vs Waldo

Testsigma vs Waldo

5 February 2024 Stephan Petzl Leave a comment Tool comparisons

In the realm of test automation, Testsigma and Waldo stand out as two progressive platforms, each with distinct features catering to different needs. Testsigma is a versatile, low-code option supporting web and mobile apps, equipped with AI-driven capabilities and extensive integrations.


It’s designed for teams seeking a comprehensive tool with physical device testing and a codeless approach. On the other hand, Waldo, a subsidiary of Tricentis, focuses exclusively on mobile app testing with a no-code platform that leverages computer vision, appealing to users who prioritize an intuitive interface for both technical and non-technical personnel.


Latest update: 1/31/2024, 5:18:29 PM
We do not guarantee the accuracy, reliability, or completeness of the information presented on our website. This includes prices, product specifications, and availability, which are subject to change. The reviews on this site are collected from g2.com and crozdesk.com and summarized by us.


Feature comparison of Testsigma and Waldo

FeatureTestsigmaWaldo
Free Plan
On Premise
Device Farm
Scheduler
Test RecorderN/A
Physical Device TestingN/A
No Code
Uses Ai
Generates Reports
Uses Computer VisionN/A
Platformsweb,Android,iOSAndroid,iOS
Ease Of Usevery easy to learnvery easy to learn
Is Open Source
Support Included
Review Pros 1. Rapid Test Automation: Users can automate most test cases quickly without needing expertise in specific languages or frameworks.
2. Customer Support: The support team is highly responsive and easily accessible directly through the platform.
3. Ease of Use: The platform is user-friendly, requiring minimal training to handle.
4. Test Step Grouping: This feature streamlines the development of new scripts by grouping test steps.
5. No-Script Automation: Offers a codeless approach to test automation, making it accessible to non-technical users.
6. Integration Capabilities: Testsigma allows for seamless integration with various tools, enhancing the automation suite.
7. Natural Language Processing (NLP): Testsigma uses NLP for test cases, making it intuitive to write tests in plain English.
8. Accessibility: It caters to users with non-technical backgrounds, allowing them to learn and use the platform effectively.
9. End-to-End Testing: It supports comprehensive testing, including validation of OTPs via Email and SMS.
10. Custom Functionality: Users can import custom code to extend functionality when required actions are not available.
1. Tests from a real user’s perspective, making it less sensitive to UI changes.
2. Finds elements even if they change position, ID, or size, leading to more successful test completions.
3. Assertion feature alerts when changes are detected that may need review.
4. Includes a flakiness score to identify and improve flaky tests.
5. Advanced features like deep linking and branch testing enhance testing capabilities.
6. Contributes to faster and more efficient development cycles by catching bugs earlier.
7. Allows for confidence in releasing new updates without full manual regression.
8. Scalable and reliable technology that mimics real user interactions.
9. Excellent customer support with proactive outreach and dedicated communication channels.
10. Reduces manual testing time significantly, allowing for faster feedback loops and quicker bug fixes.
Review Cons 1. Limited Database Testing: Currently, Testsigma does not support direct database testing, though some validation can be done using custom functions.
2. Reporting Features: The reporting capabilities are somewhat limited and could be improved.
3. Performance Issues: Some users have reported slower execution times and non-functional cloud devices.
4. End-to-End Testing Complexity: While possible, some users find end-to-end testing to be challenging.
5. Salesforce Integration: There is a need for improved integration features with Salesforce.
6. Ticket Tracking: Improvements could be made in how user-raised tickets are tracked.
7. Desktop Application Automation: Testsigma does not currently support the automation of desktop applications.
8. Element Inspection Limitations: Some elements cannot be inspected directly, requiring workarounds like Sikuli for interaction.
9. Occasional Errors: Users have encountered intermittent errors, sometimes due to platform maintenance or upgrades.
10. Lack of Transparency: There is a need for better communication regarding maintenance and updates that may affect test performance.
1. Continuous evolution of the product can require frequent adaptation of testing methods.
2. Some users experience slower execution speed of test suites.
3. Edge cases may be challenging to automate with the current toolset.
4. No-code approach may lead to updating tests only after new code breaks them.
5. Learning curve associated with adopting new developer tools like Waldo.
6. Can’t automate 100% of tests, as certain scenarios may still require manual attention.
7. End-to-end tests, particularly on mobile, can be inherently slow.
8. Dependency on the tool’s updates and improvements for better performance.
9. Some initial setup and familiarization with the technology are necessary.
10. May not be as intuitive for teams accustomed to traditional code-first testing approaches.


Pricing Models of Testsigma and Waldo

Testsigma Pricing Overview

Testsigma provides an AI-driven test automation platform with three main tiers: Free, Pro, and Enterprise. The Free tier is aimed at smaller projects with limited testing requirements. The Pro plan is designed for growing teams and includes features like unlimited automated testing minutes and extensive device and browser support. The Enterprise plan is tailored for large organizations and offers advanced security, unlimited storage, and dedicated support. Both Pro and Enterprise plans are customized, with pricing available upon request.

Waldo Pricing Overview

Waldo’s testing plans are also structured to accommodate different user needs. The free option focuses on manual testing, while the ‘Release’ plan introduces automated end-to-end testing with single concurrency. The ‘Develop’ plan further enhances testing capabilities with multi-concurrency support and additional features. Waldo’s plans include a suite of standard features with advanced options available in higher tiers. Users can start with the free plan or book a demo to explore the full offerings.

Comparison of Pricing Models

Commonalities:

  • Free Options: Both Testsigma and Waldo offer free plans aimed at users with basic testing needs or those who wish to try the platform before committing to a paid plan.
  • Scalability: Each service provides scalable options for growing teams and larger enterprises, indicating a focus on accommodating a range of business sizes.
  • Customization: Pro and Enterprise tiers in Testsigma and the higher-tier plans in Waldo are tailored to the specific needs of the user, emphasizing a personalized approach to pricing.
  • Advanced Features: Both platforms reserve more advanced features and capabilities for their higher-paid plans, including better security, support, and integration options.

Differences:

  • Pricing Transparency: Testsigma requires potential customers to contact their sales team for pricing on Pro and Enterprise plans, suggesting a highly customized pricing strategy. Waldo, while also offering customization, seems to provide more upfront information about what to expect before contacting sales.
  • Automation Focus: Testsigma’s free plan offers limited automated testing, whereas Waldo’s free plan is strictly for manual testing. Automation is a key component of Waldo’s paid plans.
  • Concurrency: Waldo specifically highlights multi-concurrency testing in its ‘Develop’ plan, a feature that is particularly beneficial for teams looking to execute multiple tests simultaneously to increase efficiency.
  • Dedicated Support: Testsigma’s Enterprise plan mentions dedicated support options, which may appeal to larger organizations with complex testing requirements and a need for more direct, ongoing assistance.

Conclusion

In summary, both Testsigma and Waldo offer tiered pricing models that cater to a range of users, from individuals and small teams to large enterprises. The core difference lies in the level of pricing transparency and the emphasis on automated testing and concurrency in their respective plans. Testsigma appears to focus on a more personalized pricing strategy, while Waldo provides a clearer upfront distinction between manual and automated testing capabilities across its plans.

Like this article? there’s more where that came from!