TestRail Erfahrungen

Regression testing

Kommentare: TestRail was implemented to do the record taking for manual regression testing and planning.

Vorteile:

Great product allowing us to keep history of our testing and specifically regression testing of our software development team

Nachteile:

Find some reporting can be difficult, but in general it is a great tool for managing our regression testing test cases, and ensuring that they have all been run.

Testcase Management

Kommentare: We enjoy using this tool because it takes little time to train new members and easy of using. SImple and faster.

Vorteile:

Ease of use. Simple and intuitive flow for the workflows that can be customized based on your work.

Nachteile:

Traceability is based on how you configure. Little confusing if you try to explain to users not familiar with the tool.

In Betracht gezogene Alternativen: Zephyr

Warum TestRail gewählt wurde: Ease of use and less maintenance work. No need to worry about managing the infrastructure and secure.

Used to be great, now it is horrible

Kommentare: I've been told their team was decimated after it was bought out. They have only 20 people to handle 11,000 customers. A product that is supposed to be for QA, is not QA'd before releases. If you are considering this product my advice is to run in another direction. You will be disappointed if you invest in TestRail.

Vorteile:

I loved it before it was sold. It was solid, easy to use, and made our work flow simple and efficient. That is no longer the case

Nachteile:

Since it was bought out, it is now horrific. Test data disappears or is inaccessible. Test runs disappear. EVERY single release is extremely buggy. And knowing that, they still continue to push the release in waves to other customers instead of fixing high priority issues first. Tickets are opened and we get the canned "we're working on it" but rarely are bugs fixed correctly the first time (if at all). We have had months of work disappear with a single release. We've had things break where we were unable to access our tests for days or even weeks at a time. I went from convincing my entire company to join in to use this product, to now only having 3 of us left who will touch it. It's just sad how far it has fallen.

In Betracht gezogene Alternativen: PractiTest

Warum TestRail gewählt wurde: We needed something cheaper and easier to use

Gründe für den Wechsel zu TestRail: At the time it was the best fit for our needs (now it stinks). It was easy to use and we could purchase only the number of licenses that we needed.

Everything we needed at half the cost

Kommentare: We are better able to track our software testing and coverage with this tool.

Vorteile:

I love the way they setup billing, every month you it automatically detects how many active users you have and you pay for that instead of being roped into a set amount of licenses. This has been incredibly helpful as we've gone through hiring, layoffs, and bringing on offshore contracted workers. Great flexibility! Another thing I like a lot are the UI Scripts, where you can customize the instance adding in or removing features and functionality. They are very powerful and super useful for us.

Nachteile:

It bugs me that every time you close a test run the test case id numbers have a huge spike, a case we created today had the id number of over 11 million even though we have less than 50,000 cases total in our library. I also do not like the way you add and remove tests from a run. It is a bit awkward and hard to see exactly what tests you're adding and removing.

If you are executing manual test cases on a large scale then Test Rail is for you

Kommentare: Having using various test management suites TestRail does excel in that it was built to run manual test cases and display results in an easy glance for the whole team. Linking to defects is simple, generating a report when the test run is complete. I feel like reusing regression suites could be improved, it does what it is meant to however you have to repeat several steps each time you want to generate a regression suite.
Some areas for improvement would be a test case type for API tests, I am sure everyone needs this but struggles to find a way to record this data.

Vorteile:

I think report generation is the strong suit of Test rail, the percentage pie chart of passed, failed blocked cases at a glance make daily reporting for scrum stand up meetings ideal. Integration with Jira is excellent, although some room for improvement.

Nachteile:

Trying to do something simple like import test case steps from a .csv is not so easy. You can import a suite but that is not ideal. Trying to duplicate cases can be tedious, let's say you have a lot of cases, trying to copy paste them in to various projects is a lot of hassle, it is surprising they have not addressed issues like this after so many years.

Best test management tool for QA

Kommentare: It saves my time and its very useful for QA use this tool, actually you can create everything in this tool and not use other tools.

Vorteile:

I'm using this tool everyday at my work, create test cases, tracking their status, and also create different reports to see the status. This tool works fast, has good user friendly design, by tracking results you can get an email notification.

Nachteile:

Didn't find any drawbacks its really fast and convenient in using, also help to keep all info in one place.

Perfect QA platform for teams spread across the globe

Vorteile:

- Web based - doesn't require a localized server installation (unless you want to) and can be accessed by anyone with credentials, no matter where they are located without any effort - Very easy to use and gives you a very neat category division when it comes to test cases, test runs and milestones

Nachteile:

Can't search and replace words in multiple test cases at the same time which makes it harder to re-use existing test cases with only small changes

Easy to use and mantain. Very useful to do regressions.

Kommentare: I use it every day. It's very easy to define the tests and execute them manually and with automations.

Vorteile:

It's very easy to use, with different kind of configurarions and customizations.

Nachteile:

The tests scenarios are not versioned. There's not possibility to see previous changes or have different versions of them.

Inexpensive, basic test management tool you should implement from day 1

Kommentare: Saves us a ton of time/money in testing, helps our process stay consistent, and makes it faster to bring up new employees.

Vorteile:

Easy and simple way to build a QA process, plus it's web-based, easy to admin, and has a simple UX that even our QA co-ops can follow for manual test. Has scaled well with our team.

Nachteile:

Not much to not like. Works as advertised but doesn't seem to tie easily into automated testing, maybe that could be an add on in future.

Good for new eployees

Kommentare: In my company TestRail work a bit slow (because of the VPN probably), so I do not enjoy really using it, but as a tool it is simple and useful. If I had a choice, I would be still using it with no doubt.

Vorteile:

Although some functions should be clearly left for more experienced workers, new employees should have no problems with filling the test cases. They need a few minutes to get used to the UI, but in general it easy to learn.

Nachteile:

Not being able to delete some of the elements I added (admin status was needed). Blocking this for elements added by other users would be justified, but if I make a mistake, I should be able to fix it myself.

Stellar Feature Rich Platform

Vorteile:

The ease of use for maintaining, connecting and sharing test cases are unrivaled. The platform is so feature rich every time I think of a feature I want to request they already have it!

Nachteile:

Takes a good amount of time to spin up a valuable framework. I think this can be mitigated by some test case best practices or maybe a super-user demo within the platform.

In Betracht gezogene Alternativen: CucumberStudio und Zephyr Enterprise

Zuvor genutzte Software: CucumberStudio

Efficient software for Test Case management

Kommentare: Overall I'd really recommend Test rail for Test case management.

Vorteile:

1. Ability to create test plans and test case for multiple features at once. 2. Ability to configure test cases in combination for different environments and browsers, OS etc. 3. Ability to present detailed reports to stakeholder and management. 4. Integration with Jira eases the need to map to a user story. 5. The test plan hierarchy helps to create test cases easily and it helps reduce redundancy between test cases. 6. Very easy to navigate using the user interface. 6. Ability to lock a test plan where it can no further be modified. 7. Able to run test cases in multiple environment and check the run history. 8. Able to download and email reports to management.

Nachteile:

Searching for a past completed story is difficult unless to navigate from Jira. Marking a test case run as passed has too many steps involved. Id love if it has ability to record screen as well as attaching screenshot to a test step/ I'd also love if I can pass/fail each step of a test case and not the test case as a whole.

TestRail helps to keep things more organized

Kommentare: Overall my experience with TestRail is good.

Vorteile:

One thing I like the most about the software is the ability to create and share reports on test results.

Nachteile:

The thing I like least about the software is the test-case review process is not very streamlined.

In Betracht gezogene Alternativen: Zephyr und Microsoft Excel

Warum TestRail gewählt wurde: More options.

Zuvor genutzte Software: Zephyr

Gründe für den Wechsel zu TestRail: More features and ease of use.

Easy to use Test Management tool

Vorteile:

Its very easy to add the test scenarios in the existing Test Run. We can create multiple Test runs and could create a lot many reports with different filters. As an admin too its very easy for me to give specific access to different members in my team.

Nachteile:

There should be some report format where I could show the Stories, linked Test scenarios, linked defects and their status in more readable way. As of now its there but I feel their is a need of more clarity in the reports.

Good enough, but can be better

Kommentare: Test management became easier.

Vorteile:

Valuable reports (that's the main purpose of testing) Easy to onboard Supports is repsonsive and helps with your case Good API and integration with JIRA

Nachteile:

There is no integration with confluence (to get bubbles like for JIRA defects/tasks) You can't push an attachment in the jira (only can show an attachment in jira's plugin) API needs some extra methods to work with plans and runs with configuration (you allow to manipulate with it, but only in strict cases) Sometimes it takes too muck time to get a reply from staff on the forum.

Great solution to improve testing efficiency

Vorteile:

Effective test case managment:- TestRail provides a highly customizable test case management system. You can create test suites, parts, and cases to suit the unique needs of your project. Easy to use:-Test cases using TestRail are efficient and simple. The ability to add test results, comments, and attachments directly from the interface simplifies the testing process.

Nachteile:

There should be option for comments or chat to communicate within TestRail for communication amongst team.

Test Case Management tool with good customer support

Kommentare: We are able to clearly track the health of a build. With creating testplan we are able to track release readiness through milestones. Management can view report on mail or printout

Vorteile:

Appreciate easy integration with JIRA, this allows us to map test cases to JIRA task & defects. Test plan is another feature which we appreciate. It allows us to track our progress on milestones. Adding additional attributes to test cases also helped us to resolve some requirements like multi level reviews. Configuration is another option which we have used extensively.

Nachteile:

A direct integration with Confluence could be appreciated. We have always felt that tester needs to navigate to JIRA and to confluence to review any requirement change. As confluence is a widely used documentation tool and direct integration with the same would be widely appreciated.

Customization is fantastic - but there are significant bugs

Kommentare: I use TestRail to easily create reproducible and well-defined objects to drive automated tests. I also use the custom UI buttons to drive external testing software. For these purposes it works great, other than the bugs mentioned above.

Vorteile:

The customization options. It works perfectly for adding custom fields and even custom buttons with external functionality. The design and visualization aspects are also excellent. Importing test suites via CSV also works very well.

Nachteile:

The bugs. The most significant one is copying a test suite copies all attachments from any test runs that implement that suite as well. On top of this there is no option to delete all or multiple test suite attachments - you must remove each one individually. Very inconvenient and tedious.

Organization of Test and Issues Resolution

Kommentare: Excellent tool for managing the chaos! Much better than passing around emails.

Vorteile:

Ownership and organization of issues is my favorite feature. We load data into our cloud solution and issues arises. Using TestRail, we can log issues, provide all pertinent notes and files about that issue in one place. Also, we always know who "owns" the next step on the issue to resolution. The "ToDo" view is also very useful. Todo lets me know what I own across many projects.

Nachteile:

Reporting may be available but I don't see it.

Test Rail high level review

Vorteile:

It is very intuitive. If one used other such tools for test documentation and tracking, it really very use to start with Test Rail.

Nachteile:

1) Configuration of the tool is a bit too rigid. I would make it more streamlined and have some admin features for configuration made available for regular users 2) Errors. Rather errors explanations. If possible to expand on what the exact issue is when we get an error.

Great test case management tool

Kommentare: I used it in two companies already for 5 years now. In general i like the flexibility and that even non QA's can use the tool.

Vorteile:

- easy to use - you can create a lot of testcases but you still keep the overview - you can connect it with jira - after some time the UI is easy to use and you can give the test case to tester

Nachteile:

- design is outdated and could be a bit more intuitiv

Good management very robust tool that can match most sdlc

Kommentare: Long time user and adapter

Vorteile:

- clean interface - a few ways to equip/start projects - a lot of integrations - available API

Nachteile:

- so as much as it is adaptable by doing so it also makes it not the strongest tool since it needs to support many different styles - reporting engine to do customizations is a learning curve

Excelent management tool

Kommentare: We are using testrail to manage all of our core tests in the platforms and the experience is excelent.

Vorteile:

Easy to configure and use projects, testsuites and testcases. Can manage all projects independent. Integrations are easy for automatize testruns executions .

Nachteile:

I miss some integrations with others tools.

Test Rail review

Vorteile:

It is easy to use and user friendly. Also I can create the report easily

Nachteile:

When moving the test to another test suite will remove the test result history

Outdated software. Features don't work.

Vorteile:

Nothing. I do not recommend buying this software.

Nachteile:

We faced with several issues using TestRail and Testrail still doesn’t resolve them (And I’m not sure they will resolve them in future): 1. It is not possible to link test cases and other documentation to tickets in ClickUp 2. It is not possible to automatically generate reports for Autotests from Gitlab for Cypress every time the tests are run