Lead Judge Selection Process
Judges who outperform their peers in the Sherlock ecosystem have the ability to be a Lead Judge. Lead Judges have the opportunity to signal their interest in being selected as the Lead Judge in an upcoming audit contest in the specific judging Discord channel where new judging opportunities will be posted.
The selection window for the Lead Judge role will begin as soon as the audit contest ends and the selection of the Lead Judge will be announced 48-hours later. The Lead Judge will initially be the highest-ranked participant on the Audit Contest Leaderboard who signs up for a given judging contest. After two months, a Judging Contest Leaderboard will be revealed. Then, the highest-ranked judge on that leaderboard who signs up for a given contest will be selected as the Lead Judge.
If selected as the Lead Judge, you cannot drop out of a contest once you’ve seen the number of issues. The contest will count for your ranking either way. You will be able to see the codebase when you sign up, but you will not know how many issues will be submitted.
The Lead Judge will receive 5% of the audit contest pot as fixed pay and can also earn part of the judging contest pot that is publicly available. More specifically, the total rewards allocated to judging are 10% of the audit contest pot with 5% as fixed pay to the Lead Judge.
Everyone who signs up for a judging contest gets opted into competing for ranking on the Judging Contest Leaderboard. It is in your interest to only judge a contest if you think it will help your judging ranking.
Judging contests will now be variable in length, with one day being added per 75 issues submitted in the contest (200 issues = 3-day judging contest, 250 issues = 4-day judging contest).
Sherlock expects Lead Judges to commit to the judging contest fully. This includes working with the protocol team after the judging contest has finished and helping with escalations.
The point system for the Judging Leaderboard will be very similar to the point system implemented for the Audit Contest Leaderboard. More details to come on the point calculations.