5 February 2024 Leave a comment Tool comparisons
In the dynamic world of test automation, Testsigma and Autify emerge as leading platforms, each with distinctive features tailored for quality assurance. Testsigma offers a low-code, AI-driven approach, supporting a wide range of environments and devices, including a free plan and on-premise options.
Conversely, Autify provides a no-code solution with AI-powered maintenance and cross-browser testing, though it lacks a free tier and device farm capabilities. Understand the nuances of each platform as we delve into their capabilities, ease of use, and how they cater to QA teams’ needs for efficient testing workflows.
Latest update: 1/31/2024, 5:18:29 PM
We do not guarantee the accuracy, reliability, or completeness of the information presented on our website. This includes prices, product specifications, and availability, which are subject to change. The reviews on this site are collected from g2.com and crozdesk.com and summarized by us.
Feature comparison of Testsigma and Autify
| Feature | Testsigma | Autify |
|---|---|---|
| Free Plan | ✔ | – |
| On Premise | ✔ | N/A |
| Device Farm | ✔ | – |
| Scheduler | ✔ | ✔ |
| Test Recorder | ✔ | N/A |
| Physical Device Testing | ✔ | N/A |
| No Code | ✔ | ✔ |
| Uses Ai | ✔ | ✔ |
| Generates Reports | ✔ | N/A |
| Uses Computer Vision | N/A | N/A |
| Platforms | web,Android,iOS | web,Android,iOS |
| Ease Of Use | very easy to learn | very easy to learn |
| Is Open Source | – | – |
| Support Included | ✔ | ✔ |
| Review Pros |
1. Rapid Test Automation: Users can automate most test cases quickly without needing expertise in specific languages or frameworks. 2. Customer Support: The support team is highly responsive and easily accessible directly through the platform. 3. Ease of Use: The platform is user-friendly, requiring minimal training to handle. 4. Test Step Grouping: This feature streamlines the development of new scripts by grouping test steps. 5. No-Script Automation: Offers a codeless approach to test automation, making it accessible to non-technical users. 6. Integration Capabilities: Testsigma allows for seamless integration with various tools, enhancing the automation suite. 7. Natural Language Processing (NLP): Testsigma uses NLP for test cases, making it intuitive to write tests in plain English. 8. Accessibility: It caters to users with non-technical backgrounds, allowing them to learn and use the platform effectively. 9. End-to-End Testing: It supports comprehensive testing, including validation of OTPs via Email and SMS. 10. Custom Functionality: Users can import custom code to extend functionality when required actions are not available. |
1. No Coding Required: Autify allows users to create and execute test cases without any programming knowledge, thanks to its no-code, visual test editor. 2. Time and Resource Efficiency: The platform’s no-code approach saves time and resources, allowing for quick design and implementation of test scenarios. 3. AI-Powered Maintenance: Autify uses AI to maintain and automatically update test scenarios, reducing the risk of human error. 4. Facilitates Agile Methodologies: Teams using Autify can complete sprints more efficiently, as it aids in testing scenarios and highlights when a review is needed. 5. Quality Assurance with AI: Autify leverages AI for next-generation quality assurance testing. 6. Rapid Test Framework Creation: Users can set up their test automation framework quickly due to Autify’s user-friendly interface and support channels. 7. Test Recorder Feature: Autify’s test recorder simplifies the process of creating tests by recording user interactions. 8. Intuitive Review Process: When Autify detects anomalies, it prompts for a review, showing screenshots for easy comparison of expected and actual results. 9. Facilitates Continuous Testing: Autify can be integrated into release cycles for smoke-testing and can be triggered daily to ensure end-to-end test coverage. 10. Supports Complex Applications: Autify is capable of handling end-to-end testing between complex systems like a NextJS frontend and a Rails backend. |
| Review Cons |
1. Limited Database Testing: Currently, Testsigma does not support direct database testing, though some validation can be done using custom functions. 2. Reporting Features: The reporting capabilities are somewhat limited and could be improved. 3. Performance Issues: Some users have reported slower execution times and non-functional cloud devices. 4. End-to-End Testing Complexity: While possible, some users find end-to-end testing to be challenging. 5. Salesforce Integration: There is a need for improved integration features with Salesforce. 6. Ticket Tracking: Improvements could be made in how user-raised tickets are tracked. 7. Desktop Application Automation: Testsigma does not currently support the automation of desktop applications. 8. Element Inspection Limitations: Some elements cannot be inspected directly, requiring workarounds like Sikuli for interaction. 9. Occasional Errors: Users have encountered intermittent errors, sometimes due to platform maintenance or upgrades. 10. Lack of Transparency: There is a need for better communication regarding maintenance and updates that may affect test performance. |
1. Limited Integrations: Autify’s integration options are limited, which could be expanded for better collaboration and workflow integration. 2. Learning Curve: Despite its no-code approach, users may still need to invest time to deeply understand how to fully leverage Autify’s features. 3. Lack of Self-Tutorial Videos: The absence of self-tutorial videos can make it challenging for new users to familiarize themselves with the platform. 4. Challenges with Complex Data: Users have found it difficult to manage complex data such as product pricing and discounts during CPQ automation. 5. Limited Customization for Metrics: There is a need for more control over customizing metrics to improve the customer experience. 6. Initial Test Setup Required: Despite its ease of use, users still need to set up the initial tests, which may be a minor inconvenience. 7. Potentially Overshadowed Manual Review: The AI’s prompt for reviews when anomalies are detected might lead to an over-reliance on the tool, potentially overshadowing manual quality assurance. 8. Possible Overfitting to Previous Test Executions: While AI matching element characteristics is helpful, it may sometimes overfit to previous test results, leading to less flexibility in adapting to new changes. 9. Limited Support for Certain Use-Cases: Some specific use-cases, especially those involving complex user interactions, may not be as easily automated with Autify. 10. Dependence on Platform Updates: Users are reliant on frequent updates from Autify to improve UI responsiveness and compatibility, which may not always align with their needs. |
Pricing Model Comparison: Testsigma vs. Autify
Testsigma Pricing Overview
Testsigma’s pricing structure is designed to support a range of users, from individuals and small teams to large enterprises. It offers three main tiers:
- Free Plan: Best for small projects, it provides limited testing capabilities.
- Pro Plan: Tailored for growing teams, it includes unlimited testing minutes and extensive device/browser support.
- Enterprise Plan: Aimed at large organizations, offering advanced security features and dedicated support.
Both Pro and Enterprise plans are custom-priced, requiring direct contact with the sales team for quotes.
Autify Pricing Overview
Autify presents a more straightforward tiered pricing model with clear monthly and annual rates:
- Starter Plan: Priced at $120/month or $99/month (annual), suitable for smaller teams with limited testing needs.
- Pro Plan: Costs $550/month or $450/month (annual), offering unlimited tests and users, targeting professional users.
- Enterprise Plan: Custom pricing for larger organizations with more complex requirements.
Each plan scales up in terms of parallel test executions, test volume, and user access, with the option to add professional services.
Comparison of Pricing Models
Common Points:
- Both Testsigma and Autify offer tiered pricing models, ensuring that there are options for different organization sizes and needs.
- Each provides a tailored Enterprise plan to accommodate the specific demands of large teams and organizations.
- Both offer integration capabilities and support parallel test execution.
Differences:
- Transparency: Autify provides clear pricing for its Starter and Pro plans, with a discount for annual commitments. Testsigma opts for a more customized approach, requiring contact with their sales team for Pro and Enterprise plan pricing.
- Free Plan: Testsigma includes a Free plan, targeting users with minimal testing requirements, a feature not offered by Autify.
- Billing Flexibility: Autify allows customers to choose between monthly and annual billing, with significant savings on the latter, while Testsigma does not publicly detail its payment options.
- Feature Access: Autify sets limits on test executions and user access in its Starter plan but offers unlimited testing in its Pro plan. In contrast, Testsigma’s Pro plan includes unlimited automated testing minutes but does not specify limits on user access or test executions.
- Support: Autify’s support varies by plan and includes chat and onboarding, with the option to purchase professional services. Testsigma, while not specifying the levels of support for the Free and Pro plans, offers dedicated support for Enterprise clients.
Conclusion
Readers interested in either platform should consider the size of their team, testing needs, and budget. Testsigma may appeal to those seeking a customizable solution with a Free option, while Autify offers clear, straightforward pricing with scalable features for growing teams. Both platforms require reaching out for Enterprise pricing, suggesting a high level of customization and support for larger organizations.
