ShipSure

Development teams merge PRs daily without systematic risk assessment. Manual code review misses systemic issues across Security, Performance, and Reliability dimensions — especially under time pressure.

The SFxHH Hamburg 2025 hackathon, sponsored by Coderabbit, Daytona, and Windsurf, challenged teams to build developer tooling that automates critical workflows.

A fully automated agentic pipeline. Provide a repo and API keys: ShipSure fetches open PRs, commissions CodeRabbit to generate unit tests, executes them in clean Daytona sandboxes, and feeds everything to GPT for a structured risk report.

Key features built in 48 hours:

• Repository & PR Selection — GitHub API integration to fetch and analyze open pull requests
• Automated Test Generation — CodeRabbit API creates unit tests for the PR changes
• Isolated Test Execution — Daytona cloud sandboxes run tests in clean environments
• AI Risk Analysis — GPT evaluates 5 risk categories: Security, Performance, Maintainability, Reliability, Compatibility

The backend is built with Python and Flask, handling async job processing with status polling via jobId endpoints. The GitHub client integrates repository fetching and PR analysis.

The frontend features a modern cyber-themed UI with real-time progress tracking — showing each stage from PR analysis to test execution to risk report generation. Built with vanilla JavaScript for minimal footprint.

Deduplication logic prevents creating duplicate CodeRabbit test PRs, and the pipeline polls CodeRabbit every 60 seconds for up to 15 minutes during test generation.