This is an early release preview. You may encounter bugs.
Raindrop Workshop logo
Unclaimed

Tool qa monitoring coding

Raindrop Workshop

Open-source tool that lets a coding agent write and run agent evals locally

B 72/100 GitHub score ? This grade is derived from GitHub signals, not user votes. Open for the full breakdown.
Discussion

01 / Summary

About Raindrop Workshop.

Raindrop Workshop is a local debugger for AI agents. It runs as a daemon on your machine and streams each agent run into a browser interface as it happens: tokens, tool calls and spans arrive live rather than on a refresh. Running /instrument-agent inside a coding agent adds Raindrop tracing to the repository and opens the interface.

Beyond viewing traces, Workshop is designed for a coding agent to drive. It registers an MCP server named workshop, so a coding agent reads the captured traces, writes evaluations against the code in the repository, and iterates: write an evaluation, run the agent, observe the failure, change the code, re-run until the assertions pass. A separate /setup-agent-replay command scaffolds an HTTP endpoint that replays a production trace against the real agent code.

Traces are kept in a local SQLite database, and both the database path and the interface port are configurable. The raindrop workshop subcommands start, check, reset and update the local install.

The same raindrop binary connects a project to Raindrop Cloud, the hosted production-observability product, with no local daemon involved. A cloud setup command signs in, writes an organization write key to the project's environment file, and installs a hosted MCP server plus the raindrop-setup and raindrop-investigate skills into your coding agents, and a matching uninstall command reverses that without touching the local install. Local Workshop and the cloud install use distinct MCP server names and separate registries, so both can be present at once.

  • Live streamed traces: tokens, tool calls and spans appear in the interface as the agent runs, with no polling
  • Coding-agent integration: an MCP server lets a coding agent read traces, write evaluations against your code, and apply fixes
  • Self-healing eval loop: the agent writes an evaluation, runs the agent, reads the failure, edits the code and re-runs until every assertion passes
  • Local replay: /setup-agent-replay scaffolds an HTTP endpoint that replays a production trace against your real agent code
  • Local storage: traces are held in a local SQLite file, with configurable port and database path
  • Language coverage: TypeScript, Python, Go and Rust
  • SDK coverage: Vercel AI SDK, OpenAI Agents SDK, Anthropic SDK, Claude Agent SDK, LangChain, LangGraph, CrewAI, Mastra, Pydantic AI, DSPy, Google ADK, Strands, Agno and Deep Agents
  • Provider coverage: AWS Bedrock, Azure OpenAI and Vertex AI
  • Coding agents: Claude Code, Codex, Devin, Cursor and OpenCode
  • Hosted option: the same binary connects a project to Raindrop Cloud for production observability, installing a hosted MCP server and two agent skills

02 / Discussion CREDIBILITY-GATED

Discussion

Reading is open to everyone. Posting and voting need a verified identity or a GitHub grade of B or higher.

  • No discussions yet.

04 / Build

Build with Raindrop Workshop.

Browse the catalog for frameworks, tools, and harnesses, each scored on real GitHub credibility.

Get Raindrop Workshop →

Browse the catalog