Getting Started with GitRank: AI-Powered PR Scoring in Minutes

Setting up GitRank takes less than 5 minutes. In this guide, we'll walk through connecting your GitHub repository and getting your first AI-powered PR scores.

What is GitRank?

GitRank is an open-source platform that uses Claude AI to automatically evaluate every merged pull request. Each PR gets scored based on:

• Severity: How impactful is the change? (P0-P3 scale)
• Component: What part of the codebase does it affect?
• Eligibility: Does it meet your criteria (tests, linked issues, etc.)?

The final score combines these factors, giving you objective metrics to recognize top contributors and automate bug bounty payouts.

Prerequisites

Before you begin, make sure you have:

• A GitHub account with admin access to at least one repository
• A GitRank account (free for open source projects)
• 5 minutes of your time

Step 1: Connect Your GitHub Account

After signing up at gitrank.dev, you'll be prompted to connect your GitHub account.

Click "Connect GitHub" and authorize the GitRank GitHub App. You'll be redirected back to GitRank automatically.

Step 2: Select Your Repositories

Once connected, you'll see a list of repositories you have access to. Select the ones you want GitRank to monitor.

For each repository, GitRank will:

1. Install a webhook to receive PR merge events
2. Start analyzing any new merged PRs automatically
3. Post a score comment on each evaluated PR

Step 3: Configure Your Components

Components help GitRank understand the different parts of your codebase. By default, GitRank uses AI to detect components, but you can also define custom rules.

# Example component configuration
components:
  AUTH:
    multiplier: 1.5
    paths:
      - 'src/auth/**'
      - 'lib/authentication/**'

  PAYMENTS:
    multiplier: 2.0
    paths:
      - 'src/billing/**'
      - 'src/payments/**'

Higher multipliers mean higher scores for changes in critical areas.

Step 4: Watch the Scores Roll In

Once configured, GitRank will automatically evaluate every merged PR. Within seconds of merging, you'll see a comment like this:

What's Next?

Now that you're set up, explore these features:

• Developer Leaderboard: See who's contributing the most
• Engineering Analytics: Track component health over time
• Bug Bounty Automation: Automate payouts based on scores

Common Questions

How accurate is the AI scoring?

In our testing, Claude correctly classifies component and severity about 90% of the time. You can always override any evaluation through the dashboard.

Is my code safe?

PR diffs are sent to Claude (Anthropic) for evaluation. Anthropic has enterprise-grade security and does not train on customer data. For extra security, you can self-host GitRank with your own API key.

Does it work with monorepos?

Yes! GitRank handles monorepos by analyzing the paths of changed files to determine which components are affected.

Have questions? Join our GitHub Discussions or reach out on Twitter.