We built an AI Agent to reproduce bugs screenshot

What is We built an AI Agent to reproduce bugs?

Repro-Bot is an AI agent built by Metabase that automatically reproduces reported bugs from GitHub issues. Instead of developers manually testing each issue report, the agent reads issue descriptions, attempts to recreate the problem in a Metabase instance, and gathers reproduction steps and diagnostic information. This speeds up the bug triage process by confirming which issues are genuine problems and collecting the details needed for fixing them. The tool is particularly useful for open-source projects and teams managing large issue backlogs where manual reproduction would consume significant time. By automating initial triage work, developers can focus their efforts on actual fixes rather than verification.

Key Features

Automatic bug reproduction

reads GitHub issues and attempts to recreate reported problems without manual intervention

Issue triage

identifies which reported issues are valid bugs versus user misunderstandings or duplicates

Diagnostic collection

gathers logs, error messages, and reproduction steps automatically when issues are confirmed

GitHub integration

works directly with GitHub issue trackers to process incoming reports

Time saving

reduces manual verification work for development teams handling high issue volumes

Pros & Cons

Advantages

  • Cuts down manual reproduction work for teams with large backlogs
  • Provides consistent, documented reproduction steps for confirmed bugs
  • Available on a freemium model, making it accessible to open-source projects
  • Integrates directly with GitHub workflows without requiring additional tooling

Limitations

  • Limited to reproducing issues that can be tested in a running instance; won't catch environment-specific problems
  • Requires proper issue descriptions to work effectively; poorly written reports may not reproduce
  • Still in early stages; may not handle all types of bugs or edge cases reliably

Use Cases

Open-source projects with high issue volume needing faster triage processes

Development teams wanting to reduce time spent on manual bug verification

Confirming which GitHub issues represent actual bugs versus feature requests or user errors

Generating initial diagnostic information before assigning issues to developers