
This book explains the two components of errors in judgement, bias and noise. Bias is intuitively well understood and it is common for organizations to take steps to mitigate it. Noise is much less well understood and therefore strategies for its mitigation have been lacking. Kahneman, Sibony and Sunstein introduce their Mediating Assessments Protocol (MAP) as a general purpose strategy for noise reduction and it informs many of our design choices at C-SQD. For example, aligning with the MAP priority to avoid making decisive judgements too early, we replace the initial accept/reject dichotomy employed by the vast majority of academic journals with on-going post publication peer review. Further, our manuscript evaluation tuple avoids inappropriately aggregating categories of judgement into a single number. Additionally, in line with MAP's focus on independent assessments along different dimensions of a decision problem, we employ an algorithm that matches reviewers for a manuscript to one or more elements of a taxonomy of common research weaknesses.