Sherlock V2
  • 👋Intro to Sherlock
  • 🙋FAQ
  • 📚Glossary
  • ‼️Disclaimers
  • Audits
    • 🧑‍💻Protocol Teams
      • How it Works for Protocols
      • Audit Timeline
      • Scheduling Process
      • Audit Preparation
      • Protocol Involvement During the Audit Process
      • Protocol Involvement Post-Audit
      • Rescheduling and Cancellations
      • Interim Updates and Upgrades
    • 🕵️Watsons
      • Lead Senior Watson Selection Process
      • Fix Review Process
      • Contest Points
      • How to Score Issue Points in a Contest
      • Meeting the Payout Criteria
      • First Blood Pot
      • Leaderboard Points Example
      • FAQ
    • 🧑‍⚖️Judging
      • Judging Conduct Guidelines
      • Criteria for Issue Validity
        • Criteria Changelog
      • Lead Judge
      • 🧑‍⚖️Community Judging
      • Dedicated Judge
      • Discussion
      • Sherlock's Exclusive Judging Apprentice Program
    • 🤝Referral Program
  • Bug Bounties
    • 🌱Pre-Launch Bounty
    • 🚀Post-Launch Bounty
      • 📜Platform Rules
      • ⚖️Dispute Resolution
  • Coverage
    • 🛡️Sherlock Shield
    • 💰Stakers
      • Overview
      • Lockup Period
      • Payout Flow
      • Staking APY
    • 🧑‍💻Protocol Teams
      • Getting Started
      • Coverage Premiums
      • Pricing
      • Composability and Coverage
      • Payout Flow
      • FAQ
    • 📝Claims
      • Claims Process
  • Tokens
    • SHER
    • Receipt NFTs
  • Governance
    • Roles
  • Developer
    • Overview
    • Stake Position Lifecycle
    • Claim Lifecycle
    • Protocol Lifecycle
    • SHER Distribution
    • Deployed Contracts
    • Contract Reference
    • Audits
Powered by GitBook
On this page
  • 1.11 - 06/02/2025
  • 1.10 - 12/11/2024
  • 1.9 - 12/09/2024
  • 1.8 - 08/07/2024
  • 1.7 - 10/06/2024
  • 1.6 - 17/05/2024
  • 1.5 - 29/01/2024
  • 1.4 - 10/11/2023
  • 1.3 - 12/10/2023
  • 1.2 - 12/09/2023
  • 1.1 - 01/08/2023
  1. Audits
  2. Judging
  3. Criteria for Issue Validity

Criteria Changelog

All future changes to the Issue criteria page will be logged here.

PreviousCriteria for Issue ValidityNextLead Judge

Last updated 1 month ago

1.11 - 06/02/2025


Batch 6: Links are added to each SJIP separately

  • SJIP 20:

  • SJIP 21:

  • SJIP 22:

  • SJIP 23:

  • SJIP 24:

1.10 - 12/11/2024


Batch 5:

  • SJIP 19: Update judging process

1.9 - 12/09/2024


Batch 4:

  • SJIP 14: Clarify High and Medium severities

  • SJIP 15: Off-chain mechanisms question

  • SJIP 16: Clarify future integrations and invariants in the README and Judging Rules

  • SJIP 17: Remove Legacy Report Template

  • SJIP 18: Remove the question about hardcoded values

1.8 - 08/07/2024


Batch 3: https://github.com/sherlock-protocol/sherlock-v2-docs/pull/41/

  • SJIP-11: Introduce new report template

  • SJIP-12: Clarify duplication considerations

  • SJIP-13: Fix typo

1.7 - 10/06/2024


Batch 2: https://github.com/sherlock-protocol/sherlock-v2-docs/pull/34

  • SJIP-7: Duplication

  • SJIP-8: Missing Curcuit Breaker Checks

  • SJIP-9: Change Trusted/Restricted Logic

1.6 - 17/05/2024


Batch 1: https://github.com/sherlock-protocol/sherlock-v2-docs/pull/24

  • SJIP-5: Update hierarchy of truth

  • SJIP-6: Improve known issue question in contest QA

1.5 - 29/01/2024


  • Historical decisions are no longer considered sources of truth. They may guide Watsons, but judgments should always be based on rules as they are and mistakes should not be repeated. Private messages are not sources of truth.

  • Updated the and sections to better explain what high and medium severity issues are. Repealed the description.

  • Added an exception to the hierarchy of truth for cases where blatant mistakes in a higher source of truth were made.

  • Specified opportunity loss and design choices to be out of scope.

  • Updated the section to require the PoC in more cases and ensure that Watsons need to discover the limitations and constraints of the issue being triggered.

  • Rephrased the "Future issues" rule to remove ambiguity.

  • Changed words in several places to ensure ease of understanding. Typo fixes.

1.4 - 10/11/2023


  • Made network liveness our of scope, with an exception of sequencer-like issues if they are preventable and the external admin is restricted in the section.

1.3 - 12/10/2023


  • Addition of CHANGELOG to the docs.

  • Addition of rule related to CHANGELOG in the point Hierarchy of truth in the section

1.2 - 12/09/2023


  • Some minor changes in the judging criteria documentation structure

  • Added the Contract Scope: sub-section under section in the judging criteria.

  • Added the section in the judging criteria: https://docs.sherlock.xyz/audits/judging/judging#vi.-requirements

  • Added Non-Standard tokens: point in the section

  • Extended the EIP compliance point in the

1.1 - 01/08/2023


  • Added rules for escalations:

  • Added the External Admin trust assumptions sub-section under

🧑‍⚖️
Clarify that acknowledged issues are not valid
Clarify front-running on chains with private mempool
Remove the min/maxAnser guideline
Clarify Oracle Staleness
Likelihood is not considered during judging
https://github.com/sherlock-protocol/sherlock-v2-docs/pull/46
https://github.com/sherlock-protocol/sherlock-v2-docs/pull/45