Katalon Studio

Amazing product for collaborative API Testing

Vorteile:

Team Collaboration, Test Management, Code snippets functionality.

Nachteile:

UI could be improved to have less clutter and Test Verification tab should have facility to open in side window for easy code writing.

Automation Tools that makes newby Automation Engineer can play around like a pro

Kommentare: its very easy tools to use especially if you don't have any experience with automation tool. Pretty easy to install and configure so junior team can easily install and create automation for your service (web,api, and mobile). Basically if you are newby once you try this tools your manager or other peers can see you like a pro.

Vorteile:

- Easy to use because it has feature record and play so no need coding skill to use their feature - Good user interface - No need to worry about web driver like other automation tools - Katalon has feature to support Web , Mobile, API automation testing - It has feature to support Continuous Integration testing tools - It has ability to handle cross browser testing

Nachteile:

- Its use pretty big memory so some times its impact to performance issue (like crash or slow) when run many scenario - only Katalon 7+ version licensed owner, that able to use debugging feature - its limited to Java and Groovy

Not very much compatible with Salesforce

Kommentare: I would say average for initial config its good but for overall complicated scenarios its not

Vorteile:

the ease of use - its very user friendly

Nachteile:

It is not very useful in case of shadow dom's

Katalon Studio for Automation

Vorteile:

It's automation capability. Integration with Jenkins and support for CI CD

Nachteile:

High Price Lack of support for Linux Object spy is not that great and helpful

Front end web testing, with ease

Kommentare: We have to deploy software to numerous systems, numerous times per month. Katalon offers the flexibility to run some basic sanity checks to ensure our deployments were successful, without a ton of manual testing hours to verfiy.

Vorteile:

Learning curve is relatively quick and easy to get going with your first few basic tests. There is also a lot of documentation out there if you get stuck on something.

Nachteile:

The design is horrible. It feels like interacting with an app built in the early 2000s. BUT, it works well.

Good tool for API Automation but not so good for mobile UI

Kommentare: API Automation - It is good
UI Automation - Not good

Vorteile:

Well organized and easy to use. For APIs its straight forward

Nachteile:

Mobile UI automation is quite tough to setup. Android automation, once we make a script using the a particular mobile using the recorder, we were not able to use it on another model phone. When recording, the ids which the Katalon Studio is creating were changing for the next phone and hence it is not recognizing the on other phones. On the Iphone UI automation, most of the Iphones are not getting recognized. We spent 2 months on doing research and it is pretty inconsistent. Finally we moved just to Appium and manually create the scripts which is the reliable solution from years.

Makes life easy

Kommentare: We have managed to fill in the gaps that Postman has left wide open in being able to share reports with teammates, using BDD/Cucumber in API testing, and being able to integrate with Jira. To be able to produce anything similar with postman would require tons of custom Node.js which would be difficult to use for our less technical team members.

Vorteile:

What I like about this software is the fact that I can perform API, Web UI, and Mobile Applications testing all in one suite. I like the fact that the software is based on Eclipse, Java, and Selenium, and comes with all the drivers ready to go. It makes life easier for me who have to deal with a lot of the more technical components, but allows others on our team, who aren't as technical, drag and drop my scripts using the UI provided. I like the fact that the software encourages the Page Object Model and also makes Cucumber much easier.

Nachteile:

You guys are making improvements on your reporting tool, but it used to be a major headache. Other than that, no major headaches.

Good option for automation

Kommentare: Despite I've had to deal with many issues using Katalon Studio, I think it is a great tool with a lot of potentials that need to mature. That's why I bet for Katalon Studio instead of other tools like ReadyAPI.

Vorteile:

1- that you can use cucumber scripts along with groovy for automating test cases 2- Katalon Analytics is great

Nachteile:

1- you can not open more than one project at a time 2- it's very heavy, it consumes a lot of resources. I think it could be improved in terms of RAM and CPU management. 3- katalon analytics needs more improvement, there are some issues in the UI. 4- the logging motor can be better, right now is very unusual if you run multiple test suites at a time with suite collection and try to watch the logs for each and every test suite, you get lost and it's hard to know even when it finished executing. 5- The Katalon Studio UI (at least mac version) it's complicated to use when you create a Request, it's hard to define the variables and params since the components used are very archaic, some time you think you save (according to the common behavior in most of the tool) but you actually dont and lost all changes. That can be improved. 6- The way Katalon manage the project files etc. it's very complicated to deal with those non-sense files (for end user) and the repos, it generates a lot of conflicts everytime.

KS opinion

Kommentare: Currently we've implented execution of several SC that must be executed every 5min,each SC has UI tests and Data Base tests.

Vorteile:

Self healing is just great, Katalon testops is really good it has everything a I need all in one platform.

Nachteile:

The possibility of analyzing a report should not be KSE's thing.

User Friendly software for Automated testing

Kommentare: My overall experience is that I could easily begin using the software without training (as a non-developer). I like that it records every step that is taken while navigating throughout an app to create the test scenarios. It makes for the perfect regression testing after a deployment, and before sharing with the client.

Vorteile:

Katalon is user friendly, even for a non-developer. It records the steps within an app to create the test scenarios with ease. You could also manually write the test scenarios, step by step.

Nachteile:

The only con with the software is resolving issues sometimes requires a developer to help fix the test case.

Ultimate tool for automated and overall testing.

Kommentare: I found it really good as it even provides screenshots where the error occurs and has helped our firm to create the whole process easily testable through katalon .

Vorteile:

The browser/desktop recording helps to automatically record scripts and helps a lot in saving time to create automation scripts, plus it helps in parallel execution to save time.

Nachteile:

It can't handle the load of a large number of test cases under one suite and consumes a lot of time. Rest functionality is good.

app for developer

Vorteile:

this app is very easy to use with tool od developed and you will make automation frameworks in an easy way

Nachteile:

this app is very simple to use to develop your tools and make structured framework

Friendly enough for junior testers and flexible enough for advanced engineers

Vorteile:

You're able to start creating UI scripts right away and then be able to figure out how you want things laid out as you go along. To get Katalon to work the way you want, you do have to do a fair amount of customization. By that I mean figuring out how you want to model your tests and test objects, whether it's UI, API, or a hybrid. This may sound bad, but there's enough there to start out with that you're not hindered by initial setup if you're already coming from another tool or similar framework. Groovy AND Java work well in Katalon with Groovy being the main language for scripting. Groovy is VERY forgiving.

Nachteile:

Refactoring is probably my biggest gripe. You can easily refactor variables and shared code in Eclipse, but that seems to be a thing that is missing in Katalon. When it comes to updating test case names or the web objects, those get updated across the board enough, but not when it comes to passing variables and keywords around. The need to customize a fair amount for satisfactory integration with something like JIRA/Zephyr. Updating doesn't always work (I use a Mac). When I start executing tests, there's usually a delay/lag when things actually start or report.

Katalon Studio, great tool to get introduced to Testing Automation, as well experienced users

Kommentare: We had very little test automation in place, and actually was using as an intern till the "purchased" product was up to speed. It surpassed my expectations the more I used it. Very reliable, easy to maintain and update. Was able to build out a decent library of smaller reusable modules, that have greatly decreased the time it takes to create new testcases. It took the frustration out of tool itself, making it enjoyable to work in.

Vorteile:

Very fast to get up and running. Fits a variety level of users, flexible enough to allow advanced users to pretty much setup how they please at the same time enough of all the base needs for the new user. With it being free product, they update it regularly and are very attentive to user requests. Their application is actually fun to use. The setup and options are intuitive. Not hard to figure out how to do and implement even more complex, complicated operations with custom code. Very portable. The install being as isolated from the code, can easily install on another machine, and open project and be running tests, no special build, or install requirements to do this as I've seen in other tools.

Nachteile:

Not a fan of the Object Repository handling, doesn't do well of detecting dupes, can get quick messy if user of the object spy. The code repository integration is basic, the interface to it not very robust. Its scripting language is Groovy, which is not as popular as others.

Feedback and Experience by user

Kommentare: Finally, this tool is more comfortable to people who will like to handle it with single tool.

Vorteile:

The tool is suitable to all people who will know and don't know the code, framework, error handle, data driven and deployment.

Nachteile:

1. I have faced some issue on sometime, like not able to call the method from keyword to test case. 2. Request to Katalon team to provide more reference.

Good tool for Functional and Automation testers.

Kommentare: I am very happy for UI and API automation testing. UI supports with all browsers option is good.

Vorteile:

I liked Record and Playback feature. Sauce labs, chrome and Firefox execution. API execution is also very good and easy to implement for functional Testers. Predefined Git options are very good.

Nachteile:

Debug feature is complicated. Identify elements for desktop applications feature is not good using UISpy.

Good product and great alternative

Kommentare: Overall the tool has many good functions and capabilities. Pros, outweigh cons in a major way.
Pricing structure and support is excellent.

Vorteile:

Somewhat easy to get started (see cons), Git integration, beginner and expert modes. Ability to export and continue with other IDEs if desired to go outside of the tool (not locked in to it forever). Plenty of information on the web to troubleshoot and ask questions (unlike our previous tool). May frequent updates and feature releases.

Nachteile:

A little cumbersome to setup all the needed plugins. Until everything is configured just right, you will run in to errors here and there that take time to troubleshoot. Test case navigation/folder structure could use a few more options and customization capabilities to be able to sort things better. Automatic centralized location for code and test case storage (similar to ALM) would be great. Having to commit and pull code each time from different stations is cumbersome. To schedule remote execution you must make sure the machine pulled latest code which is an issue if execution and development PCs are different.

plug n play automation software with many built in keywords

Kommentare: We adopted the tool after I highly spoke of it to higher management as they trust me as our main testing tool on the current project I'm working on. Had a very small learning curve and create custom keywords and scripts to be reused and acting as lego blocks in many tests. Cucumber is documenting all our scenarios.

Vorteile:

It allow to somebody with no or little coding knowledge to get started in test automation with its intuituous interface and built in keywords. Also, with all the integration with various platforms and technologies make it a very easy to integrate tool in the day to day work environment.

Nachteile:

Some glitches still exist in some fields such as soap api calls where not all endpoints are loaded correctly and some improvemetns could be done in order to completely replace soap ui usage in my case. Also the cucumber integration doesn't seem to have all the solution's benefits working correctly such as tags and others that could be added. Finally the Database that is internal could allow to clone, copy, delete or manipulate data easily even the search is not there to make a query for instance.

Didn't see a tool that provides more flexible features like Katalon

Kommentare: Well with katalon. really loved it

Vorteile:

1. Integrations with GIT, Bitbucket, Slack 2. Data binding 3. variable binding 4. Execution settings 5. Compatible with other languages even though it is running using groovy 6. Profiles 7. Data files

Nachteile:

1. Better to have options to connect multiple databases with windows auth mode 2. Execution reports in katalonanalytics seem not running properly 3. API automation report doesn't have the flexibility to trace the issues easily we need to do many clicks

My go-to app for Test automation for the web

Kommentare: being allergic to super-coding, I find Katalon studio friendly to QAs and data encoders, but can also be flexible enough to support other extensions or code snippets from other libraries.

Vorteile:

Overall, the experience with record-play-customize code-replay has is reminiscent of its more expensive counterpart/s. But overall it's better than the other automation tools i used so far. online help and resources are bountiful. Object repository, test collection, input data files are some of my favorite places to work around with. there are other features which i havent explored yet, like mobile and API automation.

Nachteile:

There are certain customizations that i need with the software which are not yet supported (like full-page web screenshot and data file output), so our team is left to the care of old-school programming gurus on the web. the features that i miss is not a deal-breaker though, work arounds are fine by me for now.

Growing Tool in Test Automation

Kommentare: Katalon Studio as a Test Automation Tool satisfies the need of the Regression testing and is continuously improving as a Tool that gives a chance to Automate everything.

Vorteile:

- Katalon Studio is easy to script - Support multiple platforms(WEB UI, Mobile, API) - Supports multiple Integrations for Reporting and Tracking

Nachteile:

- Newer versions have browser upgrade issue as each time we have to upgrade the browser for smooth execution. Most of the time it does not upgrade in one go.

Suhan - katalon Review

Kommentare: easy to handle and understand the product feature

Vorteile:

easy to handle and understand the product feature

Nachteile:

Nothing like that; looks i have all the feature looking for till date

Katalon Studio is very good for automation testers and it develops a better-inbuilt framework

Kommentare: overall katalon is good for tester who don't have much programing knowledge

Vorteile:

Katalon Studio is very good for automation testers and it develops a better-inbuilt framework easy to deploy code to git

Nachteile:

it won't handle drag and drop Functionality efficiently and upload image functionality also not good and select value from drop down also not handled properly

Bridge the gap from manual to automated testing

Vorteile:

Katalon Studio has been instrumental in lowering the barrier of entry for our people who are just learning test automation. It has enabled rapid creation of automation to implement continuous testing in our end to end functional testing efforts.

Nachteile:

We still needed to implement some standard ways of how we save, write and organize our test suites. Katalon could provide some guidelines or templates to help in this effort.

Good software to do test

Kommentare: in my opinion the software is of quality, is continuously receiving update and allows many configuration and run test firefox, chrome, edge, ie. I would like it to allow to program tests with the javascript language

Vorteile:

what I like the most is that it is free, allows you to run tests with the most famous browsers and allows you to execute different types of languages, in addition you can program without writing

Nachteile:

I would like you to be able to use languages ​​like php and javascript and integrate with api to run automated tests