Sherlock V2

The Lead Judge's Role

Lead Judge Fixed Pay

Apart from the USDC earned from the contest pool, where judges compete with each other, the Lead Judge can also receive fixed compensation according to the following breakdown:
  • 50% guaranteed payment
  • 25% based on the duration taken for completion
    • Full 25% if finished within 28 days after the audit contest's end date.
    • 18.75% if finished within 35 days after the audit contest's end date.
    • 12.5% if finished within 42 days after the audit contest's end date.
    • 0% If finished after 42 days
  • 25% based on the number of accepted escalations
    • First, calculate escalation factor: number of accepted escalations (max 1 per issue) divided by total number of issues. (2/100 = 0.02)
    • Multiply by 20 (0.02 * 20 = 0.4)
    • Subtract from maximum amount ((1-0.4) * 25% = 15%)

Lead Judge responsibilities

  • Judge issues to the best of their abilities in a fair manner.
  • Lead the judging through all the phases and achieve the two-week timeline goal to announce initial results.
  • Must communicate effectively with all parties involved
  • Must add relevant comments if required on valid/invalid issues to make the process easier for everyone involved.
Additional Note: The Lead Judge must allocate sufficient time after the contest to judge & take it through to the final state. Hence please understand the role & commitment to take up the Lead judge opportunities wisely based on your availability.

Phase 1:

Phase 2:

  • The judge receives a report, containing potential misjudged issues. This report is based on the submissions from other judging contest participants and their reputation.
  • The initial list of issues will then be shared with the protocol team to add comments and relevant labels.
  • The Lead Judge shall coordinate with the protocol team, Lead Senior Watson & Sherlock to resolve the issues based on the comments/labels. You can also add comments on the issues to help with the process.
The ideal timeline to complete the 2 phases is two weeks from the end of the contest. Initial results must be announced within this period.

Phase 3:

  • Initial results will be generated & announced based on the final issue state from Phase 2. Completion of this step opens up the Escalation period.
  • The lead judge comments on every escalation within 48 hours after the escalation period ends. The lead judge is available to answer questions at any time before the final announcement is made.
  • Sherlock resolves the escalations & Final results are announced.

Duplication Instructions:

  • The main issue is to be kept open and must have Has Duplicates label. Main issue example
  • The duplicate issues must be closed, have a Duplicate label, and should have a "Duplicate of ##" in the body of the issue at the end. Please refer image below. Duplicate issue example

The Best Lead Judge

  • Understands Sherlock's Judging guidelines
  • Understands the contest codebase well
  • Judging effectively results in ideally zero valid escalations.
  • When closing an open issue adds relevant comment for context.