Lead Judge
The lead judge holds the authority to make final decisions on all contest issues.
As Lead Judge, your role is to assess and make decisions on a subset of complex or controversial issues, typically between 1% and 10% of all cases. Your focus will be on issues that are challenging to judge and have been marked as controversial. You are expected to:
Evaluate Issues: Carefully analyze each controversial/escalated issue, balancing the judging guidelines and your own subjective common sense for your decisions. Use clear, reasoned explanations for why each judgment was made, especially when an issue requires subjective interpretation or a nuanced approach.
Use Judgement & Reasoning: While adhering to the guidelines is important, you can override them based on common-sense reasoning when you find it justified. Your decisions should reflect a balanced understanding of the context and potential impacts of each issue. Deviations from the guidelines should be made only in exceptional cases.
Collaborate as Needed: The Sherlock team is available to discuss decisions and provide input. You are encouraged to consult them for brainstorming or clarification, though the individual judgments remain with you.
Ensure Judgement Integrity: The Sherlock team will respect your final decisions unless a strong indication of error is identified.
Deviation Template
When deviating from the judging guidelines, document the decision as follows:
Based on the audit context, the applicable guideline is:
{guideline}
By this guideline, the issue would normally be judged as {severity}.
However, in the context of the protocol's security needs, this guideline conflicts with practical considerations due to:
Reason 1
Reason 2
...
For these reasons, the issue will be judged as {severity}.
Last updated