What is a test management tool?
Four criteria decide whether a tool qualifies. We meet all four.
- 1
A real repository
Test assets organised in a tree, not a flat list.
- 2
More than one test type
Manual and automated in the same place.
- 3
Reports and metrics
Quality over time, not just last night.
- 4
Development platform integrations
Reaches into where the code lives.
Four generations of test management
Knowing which generation a tool belongs to explains most of its behaviour.
- First
Spreadsheets and wiki pages
Free and universally understood. Cannot tell you anything about last night’s run.
- Second
The manual-first standalone TMS
TestRail, PractiTest, qTest. Gave cases a real home and treated automation as an import job that arrives after the fact.
- Third
The Jira-native add-on
Xray, Zephyr. Solved traceability by moving cases inside the issue tracker, at the cost of living and dying with Jira.
- Fourth
AI-native
The repository is still the source of truth, but agents can read and write it, automated results arrive as they happen, and the model in your editor is a first-class user.
M00N Report is here
A repository for every test asset
An enforced folder and suite tree. Nothing floats loose in an untitled list.
Folders and suites
Folders group by feature or team. A case always lives in exactly one suite.
Test cases
A rich-text document, not a grid row: numbered steps, attachments, tags, custom fields, a stable TC-142 number and a field-level history.
Test Collections
Reusable named sets that cut across the folder tree. Build a smoke pack once, pull it into run after run.

Support for multiple types of testing
Manual and automated in one repository, under the same cases, with one set of results.
Manual
First-class executions with assignees, an environment and per-step results. Cases are snapshotted on creation, so editing a case next month never rewrites what a tester saw last month.
Automated
Streams in live from CI and appears while the run is still going. An automated test links to the manual case it descends from, even before it has ever run.
Releases
Sit above both, aggregating the manual executions and automated launches of a version so readiness is judged on the whole picture.

Reports and metrics on quality, not just pass rate
Things a case repository alone cannot compute.
- Live dashboard: activity, pass rates, failure hotspots
- Trend charts across launches
- Flaky detection by counting pass-fail flips
- Per-case history, manual and automated together
- Slicing by tag, feature, component or team
- Exportable reports for people who never log in
Coverage gap analysis
Runs both ways: cases with no automation behind them, and automated tests that no case owns. That second one is the shadow suite, and a classic TMS structurally cannot compute it.
Composite health score
One number from 0 to 100, weighted 50% automation stability, 30% coverage and 20% manual execution, with sub-scores and what to fix first.

Integrations with your development platform
Otherwise it becomes a second place to update things.
Jira, two-way
Cases, launches and releases link to issues, and the links come back as remote links on the issue itself.
The Jira issue panel
Test evidence inside the issue, where the developer already is.
Feature Scan
Reads an epic, story or bug and returns its cases, results, coverage gaps and a risk score. Needs a connected Jira.
CI, both directions
GitHub Actions, GitLab CI, Jenkins and TeamCity report in, and jobs on all four can be triggered from here.
Slack
Carries the alerts.
Single sign-on
OIDC and SAML with group-to-project mapping, so a new joiner lands in the right projects on first login.

Any language, any runner
Most tools publish a fixed framework list. Off it, you do not report.
- Playwrightnpm
- Jestnpm
- pytestPyPI
- NUnitNuGet
- JUnit 5Maven Central
An agent gets the same surface a person does
The agent works the repository directly, not through a chat box bolted onto a dashboard. 50+ MCP tools, 31 of them writing. Your own agent, your own key, no AI credits to buy.
How it compares to TestRail, Xray and Zephyr
We are a peer in this category, not a replacement for it. The useful question is which generation your team needs.
- All manual, formal requirements matrix, nothing in CIA second-generation TMS will serve you well, and we will say so.
- Every artifact lives in Jira and always willA third-generation add-on has an advantage we do not try to match.
- A real automation suite and a real manual process, governed togetherThis is ours: results visible during the run, and an assistant that does work rather than summarising a dashboard.
Side-by-side comparisons with TestRail, Xray, Zephyr, qTest, PractiTest, ReportPortal and Allure TestOps, each fact-checked against the vendor’s own docs, are on the compare hub.
The same entities, under different names
Almost everything here has an exact counterpart in the tool you use today. Planning vocabulary diverges most, which is the real reason people sometimes conclude it cannot plan. It can.
| M00N Report | TestRail | Xray | Zephyr Scale | qTest |
|---|---|---|---|---|
| Test Case | Test Case | Test (a Jira issue) | Test Case | Test Case |
| Suite | Section | Test Repository folder | Folder | Module |
| Test Collection | no equivalent | Test Set | no equivalent | no equivalent |
| Execution | Test Run, grouped by a Test Plan | Test Execution, grouped by a Test Plan | Test Cycle, grouped by a Test Plan | Test Suite in a Test Cycle |
| Release | Milestone | Jira fix version | Jira version | Release |
| Launch | An automated run, which in every one of these tools arrives as a file uploaded after the run. In M00N Report it is a live entity you watch stream in. | |||
A Test Plan does two jobs. Scoping, deciding which cases are in an effort, belongs to reusable Test Collections. Rollup, one readiness number across everything, belongs to a Release. Split across two nouns, both jobs are covered.
Cloud or self-hosted, with the controls procurement asks about
The same product runs in our cloud or on your infrastructure. Self-hosted deploys behind your firewall with the identical feature set, and pricing is per seat either way.
Workspace isolation
A key only ever reaches the workspace it belongs to. There is no path to another organisation’s data.
Role-based access
Four roles, including a read-only Guest that costs nothing per seat.
Single sign-on
OIDC and SAML with group-to-project JIT mapping.
MCP keys
Rate-limited per key, with every agent action written to an in-app audit log.
Questions, answered
What is a test management tool?
A test management tool is the system of record for a QA team's testing work. It stores and organizes test assets in a repository-like structure, supports more than one type of testing, produces reports and metrics on quality, and integrates with the development platforms where code and issues live. M00N Report does all four.
Is M00N Report a test management system or a test reporting dashboard?
It is a test management system. It has a folder and suite repository for test cases with steps, attachments, custom fields and tags, reusable Test Collections, first-class Manual Test Executions with assignees and per-step results, and Releases that aggregate manual and automated evidence. Real-time reporting of automated results is one pillar of the product, not its definition.
Does M00N Report support manual testing?
Yes. Manual Test Executions are a first-class entity. You build an execution from a collection, a suite or individual cases, assign testers, set an environment and a date window, and record per-step results with notes and attachments. Cases are snapshotted into the execution when it is created, so later edits to a case never change the record of what was actually run. There is no separate exploratory-session module today - manual execution is structured and case-driven - though an AI agent can run an execution for you step by step, and turn what it finds while exploring into real cases.
Can AI create and manage test cases in M00N Report?
Yes. The MCP server can read and write across the data model, so an assistant can create folders and suites, author test cases from Markdown, tag and link them to Jira, build collections, create and populate manual executions, manage releases and link automated tests to manual cases. Your own model does the writing; M00N Report supplies project-aware scaffolding and then persists the result into the repository with real IDs, history and role-based permissions.
Can an AI agent actually run my manual tests?
Yes, and this is the part most AI in test management does not reach. The AI shipped by the major test management tools generates cases for a human to run; M00N Report also exposes the manual run itself as something an agent can operate. Over MCP the agent reads each case step as structured data, exercises it against your app with its own tooling (a browser MCP such as Playwright, an HTTP client, a terminal), then writes pass or fail back per step with an issue note on the ones that failed. Case, group and execution statuses derive themselves from those step results. It works best for regression passes, where the agent follows written steps identically every release, and for exploratory sessions, where what it finds becomes real test cases instead of evaporating in a chat log. The agent acts as the account its MCP key belongs to, under that role and the MCP audit log, and a human can take over the same run mid-way. There is no built-in AI doing this - it is your own agent, and nothing is sent to a separate AI service.
Which languages and test frameworks can report results?
Five official reporters are published: Playwright and Jest on npm, pytest on PyPI, NUnit on NuGet and JUnit 5 on Maven Central. Everything else uses the documented OpenAPI 3.0.3 ingest contract at /api/ingest/v2/openapi.json, which the official reporters themselves speak, so any language and any runner can report into the same platform.
Can I migrate from TestRail, Xray or Zephyr?
Test cases can be brought in today via CSV import, which covers the export format every major tool offers. Dedicated vendor-specific importers are on our backlog rather than shipped, so for a large migration we will look at your export with you before you commit.
Can I run M00N Report on my own infrastructure?
Yes. The self-hosted edition deploys with Docker Compose or Kubernetes behind your firewall and carries the same feature set as the cloud version, including the MCP server, all five reporters and SSO. Pricing is per seat and the same either way.
Is there a free plan?
Yes. The free plan is the full product with team-size limits rather than a feature-limited trial, and the read-only Guest role is not billable, so stakeholders who only read reports never consume a paid seat.
Start with one project
Put one real feature area in. Author a dozen cases, run one manual execution, point one CI job at a reporter, then open the coverage gap report and see what your automation has been doing that nobody wrote down. An afternoon, and it costs nothing on the free plan.