LIVE
summarize-article · claude-sonnet-4.5
tick every 60s
−12h −8h −4h now
Your AI is silently
getting worse.
Continuous regression monitoring for production AI calls. We probe your providers every hour. We tell you when outputs drift. Free to start.
OpenAI · Anthropic · Google · Mistral · Cohere · 45+ models
§ 00 / EVERY MINUTE, WE KNOCK
§ 01 / THE PROBLEM
OpenAI deprecates gpt-4-0613. Anthropic ships latency optimizations
that drop output quality. Google tweaks safety behaviors silently.
None of it shows up on a status page. Your users feel it first.
§ 02 / THE FIX
You write a canary prompt — say, "summarize this article in 3 bullets." Pong runs it every hour against your chosen model. We embed every response and compare to baseline. When outputs drift, you get a Slack alert before your users open a ticket.
- Similarity dropped from 0.94 → 0.71 in last 3 runs
- Avg latency up +33% (1,240ms → 1,650ms)
- Refusal pattern detected in 2 of last 6 responses
§ 03 / INSTALL
Paste into Claude Code or Cursor:
MCP PROMPT
Install pong canaries on my codebase.Track my OpenAI and Anthropic calls.Alert me on Slack when outputs drift.
OAuth flows, MCP setup, codebase edits — handled. Live in 60 seconds.
§ 04 / EMBEDDABLE BANNER
One line in your app. When pong detects drift on a provider you depend on, your users see this — before they open a ticket.
Free forever. Auto-syncs with our public status pages — no config, no auth.
§ 05 / PRICING
FREE
$0
- 3 canaries
- 1-hour intervals
- Email alerts
- Drift detection
- Public status pages
- Embeddable banner
PRO
$19/mo
- 25 canaries
- 15-min intervals
- Slack + Discord
- + LLM-as-judge
- Multi-region
- Diff history
SCALE
$79/mo
- 100 canaries
- 5-min intervals
- Webhooks + API
- + per-canary judge
- Team accounts
- Audit logs
§ 06 / WHY NOW
15.5h
OpenAI outage
June 2025. $0 refunded.
5h 46m
Cloudflare cascade
took down 7 majors, Nov '25.
6 weeks
Silent Claude degradation
users felt it before Anthropic confirmed.