31 January 2024 Leave a comment Tool comparisons
Choosing the right software quality management platform can be a pivotal decision for any development team. In this article, we compare Katalon—a versatile platform that blends AI-augmented testing with visual testing capabilities, suitable for various industries and team sizes, offering both no-code solutions and on-premise deployment—to Perfecto, an enterprise test automation platform that emphasizes cloud-based testing labs and AI-driven analytics, catering to mobile and web applications.
Both platforms support Android and iOS, but while Katalon provides a free plan and is known for its ease of creating and maintaining tests, Perfecto offers a robust device farm and integrates seamlessly with modern development workflows. Let’s delve into the differences to help you make an informed choice.
Latest update: 1/29/2024, 3:34:32 PM
We do not guarantee the accuracy, reliability, or completeness of the information presented on our website. This includes prices, product specifications, and availability, which are subject to change. The reviews on this site are collected from g2.com and crozdesk.com and summarized by us.
Feature comparison of Katalon and Perfecto
| Feature | Katalon | Perfecto |
|---|---|---|
| Free Plan | ✔ | – |
| On Premise | ✔ | – |
| Device Farm | ✔ | ✔ |
| Scheduler | ✔ | – |
| No Code | ✔ | ✔ |
| Uses Ai | ✔ | ✔ |
| Generates Reports | ✔ | ✔ |
| Uses Computer Vision | ✔ | ✔ |
| Platforms | web,Android,iOS | web,Android,iOS |
| Ease Of Use | easy to learn | easy to learn |
| Is Open Source | – | – |
| Support Included | ✔ | ✔ |
| Review Pros |
– Reduced Effort in Test Maintenance: Users report that Katalon simplifies the creation and maintenance of reusable methods, which can reduce time and effort significantly. – Built-in Reporting Features: The platform automatically captures snapshots on test failures, which enhances the efficiency of reporting. – Comprehensive Test Features: Offers features like Record, Object Spy, and Frame Handling, which streamline the testing process. – Low Learning Curve: Katalon is accessible to manual testers, allowing them to transition to automation testing with minimal training. – Cross-Functional Testing Support: It supports UI, API, and Mobile testing within a single platform, reducing the need to manage different tools for different types of testing. – Community and Customer Support: There is strong community support for the free version and dedicated customer support for the paid version. – Facilitates Cross-Functional Roles: Enables testers to handle both manual and automated testing, effectively becoming cross-functional team members. – CI/CD Integration: For those who opt for the paid version, it offers Continuous Integration/Continuous Deployment integration. – Codeless Automation: Provides a codeless automation option, making it accessible for teams with limited coding knowledge. – Efficiency in Test Execution: Users find that Katalon allows for faster test execution compared to manual testing, enabling more extensive and frequent testing. |
1. Integration with Automation Frameworks: Perfecto seamlessly integrates with leading test automation frameworks such as Selenium and Appium, enhancing the efficiency of scripting and execution of automated tests. 2. Device Availability: Offers a comprehensive array of real and virtual devices, enabling teams to test their applications on a variety of devices and operating systems. 3. Ease of Use: The dashboard is user-friendly, clean, and straightforward, making it easier for teams to navigate and control required device functionalities. 4. Remote Accessibility: Enables distributed teams to access and share devices for testing purposes, regardless of their geographical location, solving the problem of device sharing among teams in different regions. 5. Real Device Testing: Provides access to real devices, which is crucial for realistic testing scenarios such as opening a camera or toggling Wi-Fi settings. 6. Support for macOS Devices: In addition to mobile devices, Perfecto offers macOS devices for testing, reducing the need for physical devices. 7. Efficiency in Execution: Perfecto has shown to significantly reduce the effort required during test execution, with reports of saving up to 95% of effort in regression testing suites. 8. Versatility: The tool is versatile and has been successfully employed for testing various types of applications in real-world scenarios. |
| Review Cons |
– Separate Licensing: Some users find the need for separate licenses for different features to be a disadvantage. – Cost for Advanced Features: Advanced features like CI/CD integration and Visual Testing require a paid license. – Mobile Execution Issues: There have been reports of instability during mobile test execution, where sessions unexpectedly close. – High Resource Usage: Users with less powerful hardware have experienced performance issues, indicating the platform may require substantial system resources. – Lack of Support for Legacy Systems: Katalon currently does not support automation testing for legacy Java UIs, which can be a limitation for some organizations. – Limited TestOps Analytics: The free version has limitations on the analytical results available through TestOps, pushing users towards the paid version for full functionality. – Separate Licensing for Cloud Features: Features like Parallel Cloud Execution and Cloud Tunnelling require additional licensing, which can increase costs. – Limited Free Features: Some users feel that the most valuable features are locked behind the paid version, which can be a barrier for smaller teams or individual users. – Hardware Demands: The platform’s demand on hardware resources can lead to slower performance on less capable machines. – No Bundled Packages: Users would prefer bundled packages for the various Katalon products to simplify licensing and possibly reduce costs. |
1. Cost Concerns: The cloud-based testing service can be costly, which might be a barrier for smaller teams or projects with limited budgets. 2. Learning Curve: New users may face a learning curve when transitioning from other tools or methodologies to Perfecto. 3. Regular Expressions Complexity: Users have found the regular expressions used for device selection to be confusing and unclear. 4. Device Update Frequency: There is feedback suggesting that the range of leading devices should be updated more frequently to keep up with the latest models. 5. Availability Issues: Occasionally, there are issues with device availability, where specific devices or versions are not accessible or encounter errors after updates or restarts. 6. Lack of Negative Feedback: Currently, there is a scarcity of specific negative feedback, which could be due to users not encountering significant issues or the platform not being extensively reviewed in certain aspects. |
Comparison of Katalon and Perfecto Pricing Models
Katalon Pricing Overview
Katalon provides a tiered pricing structure for its Software Quality Management Platform, which includes:
- A Starter Plan at no cost, suitable for small teams or newcomers to test automation.
- Premium Plan at $167 per month (billed annually), targeting professional users with advanced features.
- Ultimate Plan with custom pricing, aimed at enterprises requiring comprehensive capabilities.
Katalon emphasizes savings for annual billing and offers package deals along with discounts for new customers. Their platform supports a range of testing types, including AI and visual testing.
Perfecto Pricing Overview
Perfecto’s subscription-based pricing model includes:
- Live Plan at $83 per month (billed annually) for manual testing.
- Automate Plan at $125 per month (billed annually) for both manual and automated testing.
- Scriptless and Enterprise Plans with pricing available upon request.
Perfecto’s plans feature unlimited users and testing minutes and cater to a broad spectrum of devices and browsers. A minimum 12-month commitment is required, with a 60-day cancellation notice for public cloud customers. Support and professional services are available to assist with automation.
Comparing the Pricing Models
Common Points:
- Flexible Subscription Models: Both Katalon and Perfecto offer pricing plans that cater to different team sizes and testing requirements.
- Annual Savings: Customers can save by opting for annual billing with both platforms.
- Support for Various Testing Types: Both platforms support a range of testing including web, API, mobile, and desktop.
Key Differences:
- Free Tier Availability: Katalon offers a Starter Plan that is free of charge, which is ideal for small teams or individuals starting with test automation. Perfecto does not provide a free tier.
- Pricing Transparency: Katalon has clear pricing for its Premium Plan, whereas Perfecto requires contact with sales for its higher-tier Scriptless and Enterprise plans.
- Commitment and Cancellation: Perfecto requires a minimum 12-month commitment with a specified cancellation notice period for public cloud customers, which indicates a more rigid contract structure compared to Katalon’s approach.
- Unlimited Access: Perfecto includes unlimited users and testing minutes in all its plans, unlike Katalon, which may have limitations based on the chosen plan.
- Enterprise Plan Pricing: Katalon requires custom pricing for its highest-tier plan, which could suggest a more tailored and potentially scalable enterprise solution compared to Perfecto’s enterprise offerings.
In summary, while both Katalon and Perfecto offer flexible and tiered pricing models designed to accommodate a variety of testing needs, there are differences in terms of free tier availability, pricing transparency, contract flexibility, and the scope of unlimited access. Katalon could be more appealing to those just starting out or operating on a tight budget, while Perfecto may be more suited for teams prioritizing a wide device and browser coverage with an emphasis on unlimited testing resources.
