Criteria Changelog

All future changes to the Issue criteria page will be logged here.

1.5 - 29/01/2024

---

• Historical decisions are no longer considered sources of truth. They may guide Watsons, but judgments should always be based on rules as they are and mistakes should not be repeated. Private messages are not sources of truth.

• Updated the IV. How to identify a high issue: and V. How to identify a medium issue: sections to better explain what high and medium severity issues are. Repealed the II. Criteria for Issue Severity: description.
• Added an exception to the hierarchy of truth for cases where blatant mistakes in a higher source of truth were made.

• Specified opportunity loss and design choices to be out of scope.

• Updated the VI. Requirements: section to require the PoC in more cases and ensure that Watsons need to discover the limitations and constraints of the issue being triggered.
• Rephrased the "Future issues" rule to remove ambiguity.

• Changed words in several places to ensure ease of understanding. Typo fixes.

1.4 - 10/11/2023

---

• Made network liveness our of scope, with an exception of sequencer-like issues if they are preventable and the external admin is restricted in the VII. List of Issue categories that are not considered valid: section.

1.3 - 12/10/2023

---

• Addition of CHANGELOG to the docs.

• Addition of rule related to CHANGELOG in the point Hierarchy of truth in the #iii.-some-standards-observed section

1.2 - 12/09/2023

---

• Some minor changes in the judging criteria documentation structure

• Added the Contract Scope: sub-section under #iii.-some-standards-observed section in the judging criteria.
• Added the VI. Requirements: section in the judging criteria: https://docs.sherlock.xyz/audits/judging/judging#vi.-requirements
• Added Non-Standard tokens: point in the VII. List of Issue categories that are not considered valid: section
• Extended the EIP compliance point in the VIII. List of Issue categories that are considered valid:

1.1 - 01/08/2023

---

• Added rules for escalations: Rules for Escalation:
• Added the External Admin trust assumptions sub-section under #iii.-some-standards-observed