Domain C · Area C-CA2 · Materiality assessment and controlled professional judgement

C.8Design and control scoring, thresholds and qualitative judgement

Working Draft version 1.1

Purpose and scope

This unit covers the capability to design, calibrate, apply and review scoring models, qualitative assessment methods, thresholds and professional-judgement controls used in materiality assessment. It includes criterion anchors, weighting, aggregation, single-score, matrix and tiered approaches, sensitivity testing, borderline cases, qualitative overrides, bias and false precision. Scoring is a decision-support mechanism and not the materiality conclusion itself.

Applied competency statement

Can design and control proportionate scoring, threshold and qualitative-judgement methods for materiality assessment, including calibration, sensitivity testing, overrides, borderline cases and governance approval.

Boundary and escalation

This unit designs decision-support methods and does not create universal materiality thresholds or replace the criteria required by the reporting basis, qualitative evidence, specialist judgement or accountable governance approval. The same scoring model must not be assumed suitable for impact and financial materiality without explicit justification.

Key quality risks

Selecting an arbitrary cut-off after seeing the results; averaging dimensions that should remain visible; using weights without rationale; false precision from numeric scores; inconsistent scoring anchors; dominant management or facilitator bias; stakeholder-response counts treated as materiality; low-likelihood severe impacts excluded mechanically; matrix positioning used as the final decision; and undocumented overrides for topics immediately above or below the threshold.

Required knowledge · 6

C.8-K01

Understands the purposes and limitations of qualitative assessment, rating scales, single-score, multi-criteria, matrix, tiered and other prioritisation approaches.

Knowledge Type: Method purposes · Normative Weight: Core

C.8-K02

Understands criterion definitions, scale anchors, evidence requirements, direction, range, ordinal versus cardinal interpretation and the need for assessor guidance.

Knowledge Type: Criteria and anchors · Normative Weight: Core

C.8-K03

Understands weights, aggregation, averaging, minimum or maximum rules, non-compensable dimensions, interaction effects and risks of concealing severe or uncertain matters.

Knowledge Type: Weighting and aggregation · Normative Weight: Core

C.8-K04

Understands cut-offs, tiers, calibration cases, benchmark topics, distribution review, sensitivity testing and the distinction between a methodological threshold and accountable judgement.

Knowledge Type: Thresholds and calibration · Normative Weight: Core

C.8-K05

Understands confirmation, anchoring, group, management, availability and facilitator bias, qualitative overrides, borderline cases, dissent and change control.

Knowledge Type: Bias and overrides · Normative Weight: Core

C.8-K06

Understands methodology approval, assessor training, evidence records, versioning, reproducibility, independent challenge and the limitations of score-based visual presentation.

Knowledge Type: Governance and traceability · Normative Weight: Core

Applied skills · 5

C.8-S01

Select and design a proportionate assessment method aligned with the reporting basis, materiality perspective, evidence quality and decision needs.

Skill Type: Core applied capability · Observable Output or Result: Materiality scoring and judgement methodology

C.8-S02

Define criteria, scales, anchors, weights, aggregation rules, non-compensable conditions, example cases and assessor instructions.

Skill Type: Anchor and calibration design · Observable Output or Result: Scoring guide and calibration cases

C.8-S03

Apply or oversee the method consistently, document evidence and rationale and identify outliers, assessor differences, bias and false precision.

Skill Type: Application and quality control · Observable Output or Result: Scoring and judgement record

C.8-S04

Test alternative weights, thresholds, assumptions and qualitative decisions and examine matters immediately above or below the cut-off and severe or high-uncertainty cases.

Skill Type: Sensitivity and borderline review · Observable Output or Result: Threshold calibration and sensitivity analysis

C.8-S05

Document overrides, dissent, unresolved cases, approval and version changes and explain why the final conclusion may differ from a mechanical score.

Skill Type: Override and governance control · Observable Output or Result: Borderline, override and professional-judgement log

Professional behaviours · 3

C.8-B01

Does not choose weights, scales or thresholds to achieve a preferred topic list or remove inconvenient matters.

Behaviour Type: Methodological neutrality · Non-compensable Requirement: No

C.8-B02

Makes qualitative judgement, overrides, dissent, uncertainty and limitations visible rather than presenting scores as objective facts.

Behaviour Type: Transparency of judgement · Non-compensable Requirement: No

C.8-B03

Does not allow averaging or cut-offs to hide severe, potentially irremediable, high-magnitude or poorly evidenced matters that require further review.

Behaviour Type: Severity and evidence discipline · Non-compensable Requirement: No

Typical tasks · 4

C.8-T01

Define the purpose, perspective, criteria, evidence needs, method type, scales, anchors, weighting and governance requirements.

Primary Output Link: C.8-O01

C.8-T02

Develop calibration examples, assessor guidance and non-compensable or qualitative review rules and pilot the method.

Primary Output Link: C.8-O01

C.8-T03

Apply or review scores and rationales, compare assessors and investigate outliers, bias, missing evidence and inconsistent interpretation.

Primary Output Link: C.8-O04

C.8-T04

Perform sensitivity and threshold analysis, review borderline and severe cases, document overrides and obtain governance approval.

Primary Output Link: C.8-O02

Expected outputs · 4

C.8-O01

Materiality scoring and judgement methodology

Output Type: Professional work product

C.8-O02

Threshold calibration and sensitivity analysis

Output Type: Professional work product

C.8-O03

Borderline, override and professional-judgement log

Output Type: Professional work product

C.8-O04

Scoring and judgement record

Output Type: Professional work product

Proficiency indicators

Level 1 · Foundation

C.8-L1-01

Can apply an established scoring or qualitative method, use defined anchors, document rationale and identify matters near the threshold or requiring override review.

Indicator Dimension: Task execution

C.8-L1-02

Can recognise obvious inconsistent scoring, missing evidence, false precision or severe cases and escalate them rather than relying on the calculated result.

Indicator Dimension: Quality, judgement and accountability

Level 2 · Practitioner

C.8-L2-01

Can independently apply and configure an established, proportionate scoring and threshold method for a moderately complex assessment, ensure consistent application of criteria and scales across assessors, and perform sensitivity and borderline review.

Indicator Dimension: Task execution

C.8-L2-02

Can resolve routine scoring differences, explain weights and thresholds and document qualitative judgement, overrides and limitations to management.

Indicator Dimension: Quality, judgement and accountability

Level 3 · Advanced Practitioner

C.8-L3-01

Can design or critically review scoring, threshold and judgement methodologies for complex impact, financial or double-materiality assessments.

Indicator Dimension: Method design and review

C.8-L3-02

Can challenge arbitrary cut-offs, hidden compensation and biased models, resolve contested borderline cases and advise governance bodies on sensitivity, residual uncertainty and the limits of scoring.

Indicator Dimension: Leadership and governance

Illustrative evidence · 6

C.8-E01

Materiality scoring and judgement methodology with criteria, anchors, weights, aggregation and governance rules.

Evidence Type: Work product

C.8-E02

Threshold calibration and sensitivity analysis using example and borderline cases.

Evidence Type: Work product

C.8-E03

Borderline, override and professional-judgement log with rationale, dissent and approval.

Evidence Type: Work product

C.8-E04

Assessor guidance, calibration results, scoring evidence, outlier review and version trail.

Evidence Type: Process evidence

C.8-E05

Documented management, specialist, quality or governance challenge and the practitioner's response.

Evidence Type: Review evidence

C.8-E06

Observed defence or critique of a scoring model and a borderline or severe case.

Evidence Type: Observed performance

Assessment · 3

C.8-A-L1

Scoring exercise, situational judgement and limited sensitivity task

Correct use of anchors; evidence linkage; recognition of false precision, severe cases and threshold limitations.

C.8-A-L2

Integrated methodology case and written memorandum

Method proportionality; calibration; weighting and aggregation rationale; sensitivity; override and borderline governance.

C.8-A-L3

Complex method-design case, portfolio and oral defence

Method design; perspective-specific criteria; non-compensable dimensions; bias and sensitivity control; governance advice and oral defence.

Relationships · 9

From	To	Type	Rationale
C.5	C.8	Method, data and analytical linkage	Scoring, thresholds and qualitative overrides support but do not replace impact-materiality judgement.
C.6	C.8	Method, data and analytical linkage	Scoring, thresholds and sensitivity support financial-materiality judgement and must control false precision.
C.7	C.8	Method, data and analytical linkage	Combined scoring and presentation must not collapse or cancel the distinct criteria of each perspective.
C.8	C.5	Method, data and analytical linkage	Impact criteria, severity and likelihood may be operationalised through controlled scoring and qualitative judgement.
C.8	C.6	Method, data and analytical linkage	Financial likelihood, magnitude, timing and uncertainty may be operationalised through controlled methods and sensitivity.
C.8	C.7	Risk and control linkage	Double-materiality methods must preserve separate perspective logic and prevent cancellation.
C.8	C.9	Evidence and traceability linkage	Scoring methodology, calibration, sensitivity, borderline cases and overrides must remain in the materiality file.
C.8	H.3	Professional conduct and collaboration linkage	Significant materiality judgements, alternatives and uncertainty require disciplined professional-judgement documentation.
H.3	C.8	Method, data and analytical linkage	Scoring, thresholds and qualitative overrides are examples of significant reporting judgements.

Role profiles for this unit

Role	Target level	Relevance	Evidence expectation
Corporate Sustainability Reporting Practitioner	Practitioner	Required?	A case or work sample demonstrating independent performance, documented judgement and a reviewable professional output.
Sustainability Reporting Manager or Lead	Advanced Practitioner	Role-defining?	A complex case or verified portfolio, supplemented by oral or observed defence, demonstrating method design, challenge and governance capability.
Sustainability Reporting Adviser or Consultant	Advanced Practitioner	Role-defining?	A complex case or verified portfolio, supplemented by oral or observed defence, demonstrating method design, challenge and governance capability.
Sustainability Data, Systems and Controls Specialist	Practitioner	Required?	A case or work sample demonstrating independent performance, documented judgement and a reviewable professional output.
Assurance Readiness and Reporting Quality Specialist	Advanced Practitioner	Role-defining?	A complex case or verified portfolio, supplemented by oral or observed defence, demonstrating method design, challenge and governance capability.
Investor, Capital Markets and Ratings Disclosure Specialist	Practitioner	Required?	A case or work sample demonstrating independent performance, documented judgement and a reviewable professional output.