31 January 2024 Leave a comment Tool comparisons
In the dynamic world of automated testing, Katalon and Testsigma emerge as robust contenders. Katalon is a comprehensive software quality management platform that blends AI-augmented testing with a mix of low-code and no-code capabilities, designed for various industries and team sizes.
It offers integrations like AWS Device Farm for enhanced multi-platform testing. Conversely, Testsigma positions itself as a user-friendly, low-code test automation platform focusing on codeless operations and AI-driven testing for web, mobile, and APIs. Both platforms provide free plans, on-premise options, and claim to simplify the testing process, but with different approaches and feature sets.
Latest update: 1/31/2024, 3:45:24 PM
We do not guarantee the accuracy, reliability, or completeness of the information presented on our website. This includes prices, product specifications, and availability, which are subject to change. The reviews on this site are collected from g2.com and crozdesk.com and summarized by us.
Feature comparison of Katalon and Testsigma
| Feature | Katalon | Testsigma |
|---|---|---|
| Free Plan | ✔ | ✔ |
| On Premise | ✔ | ✔ |
| Device Farm | ✔ | ✔ |
| Scheduler | ✔ | ✔ |
| No Code | ✔ | ✔ |
| Uses Ai | ✔ | ✔ |
| Generates Reports | ✔ | ✔ |
| Uses Computer Vision | ✔ | N/A |
| Platforms | web,Android,iOS | web,Android,iOS |
| Ease Of Use | easy to learn | very easy to learn |
| Is Open Source | – | – |
| Support Included | ✔ | ✔ |
| Review Pros |
– Reduced Effort in Test Maintenance: Users report that Katalon simplifies the creation and maintenance of reusable methods, which can reduce time and effort significantly. – Built-in Reporting Features: The platform automatically captures snapshots on test failures, which enhances the efficiency of reporting. – Comprehensive Test Features: Offers features like Record, Object Spy, and Frame Handling, which streamline the testing process. – Low Learning Curve: Katalon is accessible to manual testers, allowing them to transition to automation testing with minimal training. – Cross-Functional Testing Support: It supports UI, API, and Mobile testing within a single platform, reducing the need to manage different tools for different types of testing. – Community and Customer Support: There is strong community support for the free version and dedicated customer support for the paid version. – Facilitates Cross-Functional Roles: Enables testers to handle both manual and automated testing, effectively becoming cross-functional team members. – CI/CD Integration: For those who opt for the paid version, it offers Continuous Integration/Continuous Deployment integration. – Codeless Automation: Provides a codeless automation option, making it accessible for teams with limited coding knowledge. – Efficiency in Test Execution: Users find that Katalon allows for faster test execution compared to manual testing, enabling more extensive and frequent testing. |
1. Rapid Test Automation: Users can automate most test cases quickly without needing expertise in specific languages or frameworks. 2. Customer Support: The support team is highly responsive and easily accessible directly through the platform. 3. Ease of Use: The platform is user-friendly, requiring minimal training to handle. 4. Test Step Grouping: This feature streamlines the development of new scripts by grouping test steps. 5. No-Script Automation: Offers a codeless approach to test automation, making it accessible to non-technical users. 6. Integration Capabilities: Testsigma allows for seamless integration with various tools, enhancing the automation suite. 7. Natural Language Processing (NLP): Testsigma uses NLP for test cases, making it intuitive to write tests in plain English. 8. Accessibility: It caters to users with non-technical backgrounds, allowing them to learn and use the platform effectively. 9. End-to-End Testing: It supports comprehensive testing, including validation of OTPs via Email and SMS. 10. Custom Functionality: Users can import custom code to extend functionality when required actions are not available. |
| Review Cons |
– Separate Licensing: Some users find the need for separate licenses for different features to be a disadvantage. – Cost for Advanced Features: Advanced features like CI/CD integration and Visual Testing require a paid license. – Mobile Execution Issues: There have been reports of instability during mobile test execution, where sessions unexpectedly close. – High Resource Usage: Users with less powerful hardware have experienced performance issues, indicating the platform may require substantial system resources. – Lack of Support for Legacy Systems: Katalon currently does not support automation testing for legacy Java UIs, which can be a limitation for some organizations. – Limited TestOps Analytics: The free version has limitations on the analytical results available through TestOps, pushing users towards the paid version for full functionality. – Separate Licensing for Cloud Features: Features like Parallel Cloud Execution and Cloud Tunnelling require additional licensing, which can increase costs. – Limited Free Features: Some users feel that the most valuable features are locked behind the paid version, which can be a barrier for smaller teams or individual users. – Hardware Demands: The platform’s demand on hardware resources can lead to slower performance on less capable machines. – No Bundled Packages: Users would prefer bundled packages for the various Katalon products to simplify licensing and possibly reduce costs. |
1. Limited Database Testing: Currently, Testsigma does not support direct database testing, though some validation can be done using custom functions. 2. Reporting Features: The reporting capabilities are somewhat limited and could be improved. 3. Performance Issues: Some users have reported slower execution times and non-functional cloud devices. 4. End-to-End Testing Complexity: While possible, some users find end-to-end testing to be challenging. 5. Salesforce Integration: There is a need for improved integration features with Salesforce. 6. Ticket Tracking: Improvements could be made in how user-raised tickets are tracked. 7. Desktop Application Automation: Testsigma does not currently support the automation of desktop applications. 8. Element Inspection Limitations: Some elements cannot be inspected directly, requiring workarounds like Sikuli for interaction. 9. Occasional Errors: Users have encountered intermittent errors, sometimes due to platform maintenance or upgrades. 10. Lack of Transparency: There is a need for better communication regarding maintenance and updates that may affect test performance. |
Pricing Comparison: Katalon vs. Testsigma
Katalon Pricing Overview
Katalon presents a tiered pricing model for its Software Quality Management Platform, designed to accommodate various team sizes and testing requirements:
- Starter Plan: Free, ideal for small teams or beginners, offering basic test automation features.
- Premium Plan: $167/month (billed annually), for professional-grade test creation and dynamic workflows.
- Ultimate Plan: Custom pricing, offering enterprise-grade features.
- Discounts are available for annual billing (up to 25%) and for new customers on initial licenses, with additional package deals for various licenses and test results.
Testsigma Pricing Overview
Testsigma employs an AI-driven approach for its unified test automation platform with a pricing structure that serves diverse team needs:
- Free Plan: Limited testing capabilities, suitable for small projects.
- Pro Plan: Tailored for growing teams, offering unlimited automated testing minutes and extensive device/browser combinations. Pricing on request.
- Enterprise Plan: Advanced security and support options for large teams and TCOEs, with unlimited storage and custom data retention. Pricing on request.
- Personalized pricing quotes and consultations are available upon contacting their sales team.
Comparison of Pricing Models
Both Katalon and Testsigma offer free plans designed for small teams or individuals just starting with test automation, which is a common entry point in the market. These free offerings provide basic functionalities to cater to minimal testing needs.
Common Points:
- Free Plans: Both platforms offer a no-cost tier with basic testing capabilities.
- Advanced Plans: Tailored to professional and enterprise teams, with more sophisticated features.
- Annual Savings: Discounts are offered for longer-term commitments (Katalon explicitly mentions up to 25% off for annual billing).
- Custom Enterprise Solutions: Both provide custom pricing for their top-tier plans, implying a personalized approach to enterprise needs.
Key Differences:
- Pricing Transparency: Katalon provides specific pricing for its Premium plan, whereas Testsigma requires interested parties to contact them for Pro and Enterprise plan rates, indicating a more customized pricing strategy.
- Billing Structure: Katalon’s pricing is available on a per-month basis when billed annually, while Testsigma encourages direct contact for details on plan upgrades, downgrades, and payment methods.
- Package Deals: Katalon offers package deals combining various licenses and test results options, which can be particularly appealing for teams looking for bundled solutions.
- Dedicated Support: Testsigma’s Enterprise plan specifically mentions dedicated support, which may be an important factor for larger organizations requiring immediate and specialized assistance.
In summary, Katalon offers a more straightforward pricing structure with explicit costs for its mid-tier plan and potential package deals, catering to customers who prefer clear-cut options. Testsigma, on the other hand, opts for a personalized approach, especially for its Pro and Enterprise plans, suggesting a focus on tailoring to the specific needs of larger or more complex testing environments. Both platforms seem to value scalability and adaptability, but they approach pricing and customer engagement differently.
