At a Glance
ReportPortal
ReportPortal is the open-source heavyweight of automated test reporting. Its ML auto-analysis for failure triage has run in production since 2016, and its agent ecosystem (roughly 48 to 53 published framework agents) is one of the broadest anywhere. The Apache 2.0 core is genuinely free to self-host, it is proven at enterprise scale, and its official MCP server exposes launches, logs, defect types and analysis to AI agents.
M00N Report
M00N Report shares the real-time reporting DNA but adds WebSocket push to the browser and built-in manual test case management today - cases, suites, executions and releases in one data model, with automated results linking natively to their manual case. It runs as a compact self-hostable stack or a cloud with a free tier, and its 50+ tool MCP server lets a connected AI assistant create and manage test cases from Markdown, not just query runs.
Pick ReportPortal if you have an open-source mandate and DevOps capacity for a multi-service stack and want mature ML failure triage on huge suites; pick M00N Report if you want built-in test case management and a light footprint without operating ten containers or paying for managed hosting.
Real-Time Reporting
| Feature | ReportPortal | M00N Report |
|---|---|---|
| Results visible during the run | YesAgents push start/finish/log events as tests run; vendor documents this as real-time reporting | YesWebSocket streaming from the reporter |
| Dashboards update without manual refresh | YesDocs state widgets update in real-time as tests run; 30-second auto-refresh in full-screen mode | YesWebSocket push, no refresh interval needed |
| Screenshots, videos and traces attached | YesVia logs and attachments | YesAutomatic from Playwright, with trace files |
AI and MCP
| Feature | ReportPortal | M00N Report |
|---|---|---|
| AI agent runs a manual test execution | NoNo manual test repository, so there is no manual run for an agent to execute | YesThe run_manual_execution prompt walks the agent through it: read each case step, exercise it against the app, write pass/fail back per step with an issue note. Case and group statuses derive themselves. Included on every plan, cloud and self-hosted. |
| Automatic failure triage | YesML auto-analysis for failure triage, in production since 2016 | PartialFlaky detection built in; failure triage via MCP AI agents |
| Official MCP server for AI agents | Yes18 documented tools (launches, suites, items, logs, attachments, defect types, auto-analysis, quality gate); a v2 with test case management tools is in development | YesReads and writes across cases, executions, launches and releases, including the test case management their v2 is still developing |
| AI can create and manage test cases | NoNo built-in TCM in the shipped product (through 26.0.3); test case management tools are in active development for a future release | YesMCP creates cases from Markdown into the right suite |
Test Case Management
| Feature | ReportPortal | M00N Report |
|---|---|---|
| Built-in manual test case management | NoReporting-first today; a built-in TMS is in active development for a future release | YesCases, suites, executions, releases in one data model |
| Link automated results to manual cases | PartialVia TestCase ID references to an external TMS | YesNative linking, no external TMS needed |
Deployment and Operations
| Feature | ReportPortal | M00N Report |
|---|---|---|
| Lightweight self-hosted stack | NoAbout 10 containers incl. PostgreSQL, RabbitMQ, OpenSearch; 6 GB+ RAM minimum | YesCompact Docker Compose stack |
| Free self-hosted core | YesApache 2.0; Quality Gates and SCIM are paid premium | PartialSelf-hosted is a paid plan at $25 per user/month with trial |
| Managed cloud with a free tier | NoSaaS starts at $569 per month, shared instance | YesFree tier: 3 members, 1 project, no credit card |
Pricing
ReportPortal
Open source (Apache 2.0) and free to self-host; premium features (Quality Gates, SCIM, Test Executions view) unlock through support packages from $10,000 per year. Managed SaaS: Startup at $569 per month (shared instance), Business at $2,659 per month (dedicated). Vendor-estimated AWS infrastructure for self-hosting runs $544 to $2,497 per month.
Source: official pricing page (as of 2026-07-19)M00N Report
Free tier for small teams (no credit card); Team at $25 per user/month or $250 per user/year. Self-hosted is a plan at the same per-user price, not an enterprise upcharge.
See full pricingWhen ReportPortal is the better fit
- You have an open-source mandate and the DevOps capacity to operate a multi-service stack (PostgreSQL, RabbitMQ, OpenSearch).
- You run very large multi-framework regression suites and want its battle-tested ML failure triage.
- You need an agent for a niche framework - the ReportPortal agent ecosystem is one of the broadest anywhere.
When M00N Report is the better fit
- You want real-time reporting without operating 10 containers - or without paying $569 per month for managed hosting.
- You want manual test case management built in today, not waiting on ReportPortal's in-development TMS.
- You want a free cloud tier to start on and a self-hosted plan at the same per-user price when you need it.
- You want AI agents that can also create and manage test cases through MCP, not just query launches.
Switching from ReportPortal
No data conversion needed to start: swap your ReportPortal agents for the published M00N Report reporters (Playwright, Jest, JUnit, pytest, NUnit) and results stream from the next CI run. Keep your ReportPortal instance read-only during the transition if you need the history. And if you want the manual test case library ReportPortal never had, an AI assistant can draft it through the M00N Report MCP server from Markdown.
Bottom Line
If your priority is battle-tested ML failure triage across very large multi-framework regression suites, and you have the DevOps capacity to run and maintain a PostgreSQL plus RabbitMQ plus OpenSearch stack, ReportPortal is the stronger and more proven choice - and its core is free under Apache 2.0, which is hard to beat when an open-source mandate is non-negotiable. It also has a far broader framework-agent ecosystem than M00N Report and a longer enterprise track record. M00N Report is the better fit when you want real-time reporting and manual test case management in one product today, a compact stack you can stand up quickly, a free cloud tier to start on, and a self-hosted plan at the same flat per-user price rather than a managed-hosting bill that starts at $569 per month. Choose on operational appetite and whether you need built-in test case management now or can wait on ReportPortal's in-development TMS.
Frequently asked questions
Can an AI agent actually run my manual test cases?
In M00N Report, yes. The manual run itself is exposed over MCP: the agent reads each case step as data, exercises it against your app with its own tooling such as a browser MCP, and writes pass or fail back per step, with case, group and execution statuses deriving themselves. It fits regression passes and exploratory sessions, and a human can take over the same run mid-way. ReportPortal has no manual test repository at all, so there is no manual run for an agent to execute.
Is M00N Report a ReportPortal alternative?
Yes - both are real-time test reporting platforms. ReportPortal is open source and excels at ML failure triage at enterprise scale; M00N Report adds built-in test case management and a much lighter operational footprint.
Is ReportPortal really free?
The core is free under Apache 2.0, but Quality Gates, SCIM and the Test Executions view are paid premium features (support packages from $10,000 per year), and you carry the infrastructure cost - the vendor itself estimates $544 to $2,497 per month on AWS. The managed SaaS starts at $569 per month.
Does ReportPortal manage manual test cases?
Not in the shipped product as of mid-2026 - it links executions to cases in an external TMS, with a built-in TMS in active development for a future release. M00N Report has manual cases, suites, executions and releases built in today.
How hard is it to migrate from ReportPortal?
Easy: there is no case data to convert. Replace the ReportPortal agents in your frameworks with M00N Report reporters and results stream in from the next run.
Facts verified on 2026-07-21. Spotted something outdated? Tell us on Discord.