Everything you need to know about GitRank. Can't find what you're looking for? Feel free to reach out.
1Getting Started
What is GitRank?
GitRank is an open-source platform that uses AI to automatically evaluate and score pull requests. It helps engineering teams run bug bounty programs, recognize top contributors, and measure developer impact objectively.
How does GitRank evaluate PRs?
When a PR is merged, GitRank fetches the diff and sends it to Claude (Anthropic's AI). The AI analyzes the changes, classifies the affected component and severity level, checks eligibility criteria (issue linked, tests, documentation), and calculates a score using your configured multipliers.
How long does it take to set up?
Most teams are up and running in under 5 minutes. You install the GitHub App, select which repositories to track, and configure your scoring rules. GitRank starts processing new PRs immediately.
Can I process historical PRs?
Yes! GitRank includes a backfill feature that lets you process PRs from before you installed the app. This is great for establishing baseline scores and historical leaderboards.
2Scoring & Configuration
How is the final score calculated?
The formula is: Final Score = Base Points (from severity) × Multiplier (from component). For example, a P1 severity fix (50 base points) in the Auth component (1.5× multiplier) would earn 75 points.
What are eligibility criteria?
GitRank checks four criteria: (1) Is this fixing an issue/bug? (2) Does the implementation actually fix what it claims? (3) Is the PR properly documented? (4) Are tests included? PRs that fail eligibility still get evaluated but score 0 points.
Can I customize the components and multipliers?
Absolutely! You define your own components (e.g., Auth, Payments, UI) and assign multipliers based on complexity or business importance. You can also set up file path rules to auto-classify PRs.
How accurate is the AI classification?
In our testing, Claude correctly classifies component and severity ~90% of the time. You can review and override any evaluation if needed. The AI provides justification for its decisions to help you understand its reasoning.
3GitHub Integration
What GitHub permissions does GitRank need?
GitRank needs read access to code and pull requests (to analyze diffs), and write access to issues (to post evaluation comments). We only access repositories you explicitly enable.
Does GitRank work with GitHub Enterprise?
Yes, GitRank supports GitHub Enterprise Server. For self-hosted installations, you'll need to configure the GitHub App with your enterprise domain.
Can I disable the PR comments?
Yes, PR comments are optional. You can disable them globally or per-repository while still collecting scores in the dashboard.
Does GitRank support GitLab or Bitbucket?
Currently, GitRank only supports GitHub. GitLab support is on our roadmap. Bitbucket support depends on community interest.
4Privacy & Security
Is my code sent to the AI?
Yes, PR diffs are sent to Claude (Anthropic) for evaluation. If this is a concern, you can self-host GitRank and use your own Anthropic API key with enterprise-grade data handling agreements.
Can I self-host GitRank?
Yes! GitRank is open source under CC BY-NC 4.0. You can deploy it on your own infrastructure for non-commercial use. For commercial use, please contact us for licensing options.
What data does GitRank store?
GitRank stores PR metadata (title, author, file list, diff snippets), evaluation results (scores, classifications), and aggregated statistics. We don't store your full codebase.
Is GitRank SOC 2 compliant?
The hosted version is SOC 2 Type II compliant. For self-hosted deployments, compliance depends on your infrastructure. We provide security best practices documentation.
5Pricing & Plans
Is GitRank free?
GitRank is free for non-commercial use under CC BY-NC 4.0. Self-host it for personal projects, education, or open source. For commercial use, contact us for licensing.
Is there a free tier for the hosted version?
We offer a 14-day free trial of Pro, and the hosted version is completely free for open source projects. Contact us to apply for the OSS program.
Do I need my own Anthropic API key?
For self-hosted installations, yes—you'll need to provide your own Anthropic API key. The hosted Pro plan includes AI credits.
Can I export my data?
Yes, you can export all your data (PRs, evaluations, leaderboards) in CSV or JSON format. You own your data.
Still have questions?
We're here to help. Reach out through GitHub or contact us directly.
