BotGauge
Freemium
Startups and fast-moving engineering teams
Coldtea.ai
FreemiumAgentic
Coding agents write fast and break things quietly — regressions slip through, incidents surface in user reports, and by the time you find out, the damage is done. Coldtea wraps QA and production monitoring agents around the coding agents you already run, so the breakage gets caught before your users do.
$20/mo · Free tier: 2,000 agentic credits/month (~200 test runs), 2 connected tools per project, 7-day monitoring trial
Similar tools
BotGaugeFreemiumThe core loop is: probe the agent with adversarial and real-world scenarios, trace every…
AxonQAFreemiumThe core loop: bring in a Jira ticket or let the AI explore your app, review the tests it…
Bypass LabsPaidThe workflow is boundary-in, proof-out: you approve targets, exclusions, and stop conditions…
Before Users DoPaidThe tool connects to MCP-compatible clients like Cursor or Claude Desktop, so the QA loop runs…
Screenshots 1
Summary
The core workflow is a macOS IDE that houses your terminal, agentic testing, and production monitoring in one place. QA agents take plain-English journey descriptions and turn them into self-healing tests that run against every PR preview, gating deploys on the result. Monitoring agents watch Sentry, Datadog, PostHog, and a handful of other providers, investigate anomalies, and open a PR for your review. Cloud execution lets background agents chew through tasks from Linear or Jira without tying up your laptop. The ceiling appears early: no API, no self-hosted option, and no browser-based access — this is macOS-only, which rules out Linux-first teams and any CI runner that isn't your own machine.
Bottom line: Pick this if you're a solo developer or a small team running Claude Code or Codex who wants QA and production oversight without stitching together five separate tools — but plan a different stack if your team runs Linux, needs an API to plug this into existing pipelines, or requires self-hosted deployment for compliance reasons.
Pricing Plans
Subscription- Free Tier
- 2,000 agentic credits/month (~200 test runs), 2 connected tools per project, 7-day monitoring trial
Free
Free
Unlimited tasks, 2,000 agentic credits/month, 7-day monitoring trial
- Unlimited tasks
- 2,000 credits
- Cloud runs
- 2 connected tools
Pro
$20per month
Everything in Free plus team features and higher limits
- Shared boards
- $20/user/mo after first seat
- 10,000 credits option
- Monitoring from $49/project
Enterprise
Custom
Volume pricing, annual billing, priority support
- Custom pricing
- Hands-on onboarding
- Shared Slack channel
Agentic testing Pro
$120per month
10,000 credits/month add-on
- Replaces free allowance
- Credits roll over
Production monitoring
$49per month
Essentials or Complete per project
- $49 or $99/project
- Raises key signals
- Opens PRs
View full pricing on coldtea.ai →
Pricing may have changed since last verified. Check the official site for current plans.
Find your fit
Before you choose Coldtea.ai
More options in Test Generation. Compare pricing, platforms, and features side by side.
AxonQA
Freemium
QA engineers and teams shipping software
Pros
- QA agents run self-healing tests against every PR preview URL automatically, so regressions that would otherwise reach production get caught at the merge gate instead of in a user support ticket.
- Monitoring agents investigate production anomalies across Sentry, Datadog, PostHog, and others and open a PR for your review — which means you get a proposed fix surfaced to you rather than a raw alert that still requires manual root-cause work.
- Cloud execution for background agents means parallel tasks run off your laptop, so your local machine stays free while agents work through a queue of Linear or Jira tickets.
- Works with the coding agents you already use — Claude Code, Codex, Gemini CLI, OpenCode — so you don't replace your existing agent setup, you add a testing and monitoring layer around it.
- Plain-English test authoring means you describe a user journey the way a PM would write it, and the QA agent turns that into a runnable test suite, which removes the bottleneck of translating specs into test code by hand.
Cons
- No API exists, so teams that want to trigger QA agent runs as a step inside an existing CI/CD pipeline — GitHub Actions, Jenkins, CircleCI — cannot do it. The workaround is running Coldtea in parallel outside the pipeline, which means managing two separate release gates and reconciling their results manually.
- macOS-only distribution excludes Linux-first engineering teams entirely. There is no browser-based alternative and no self-hosted option, so any team whose engineers default to Linux or whose compliance policy requires on-premises deployment has to use a competitor from day one.
- Production monitoring and agentic QA beyond the free tier are paid-only features with no self-hosted fallback, which means teams with data residency requirements — financial services, healthcare, regulated industries — cannot route production signals through Coldtea without accepting cloud data handling, and most of those teams switch to self-hostable alternatives instead.
About
- Platforms
- macOS
- API Available
- No
- Self-Hosted
- No
- Last Updated
- August 16, 2026
Best For
Who it's for
- Solo developers and side projects
- Teams shipping daily updates
- Organizations needing production oversight
- Users of CLI coding agents
What it does well
- Testing code changes with agentic QA runs
- Monitoring production signals and auto-opening PRs
- Running background agents without local resources
- Syncing tasks from Linear, Jira and similar tools
Integrations
Frequently Asked Questions
- Is Coldtea.ai free?
- Coldtea.ai offers a free option alongside paid upgrades. Check the current allowances and terms before choosing a plan.
- What platforms does Coldtea.ai support?
- Coldtea.ai is available on: macOS.
Regressions slip through before users notice
Coding agents write fast and break things quietly — regressions slip through, incidents surface in user reports, and by the time you find out, the damage is done. Coldtea wraps QA and production monitoring agents around the coding agents you already run, so the breakage gets caught before your users do.
How it works
The core workflow is a macOS IDE that houses your terminal, agentic testing, and production monitoring in one place. QA agents take plain-English journey descriptions and turn them into self-healing tests that run against every PR preview, gating deploys on the result. Monitoring agents watch Sentry, Datadog, PostHog, and a handful of other providers, investigate anomalies, and open a PR for your review. Cloud execution lets background agents chew through tasks from Linear or Jira without tying up your laptop.
Pricing and limits
It uses a subscription model. The free tier gives 2,000 agentic credits per month (about 200 test runs), 2 connected tools per project, and a 7-day monitoring trial.
Limitations
No API exists, so teams cannot trigger runs inside existing CI/CD pipelines. It is macOS-only with no browser-based access and no self-hosted option.
Who it is for / who should skip it
Best for solo developers and side projects, teams shipping daily updates, organizations needing production oversight, and users of CLI coding agents. Skip it if your team needs Linux support, API integration with pipelines, or on-premises deployment.
Contribute
- Work on Coldtea.ai? Claim this listing.
- Embed a badge for your README or site.
Sign in to rate this tool or suggest an edit.