Foundations of Rules Integrity · Chapter 8
Rule Quality
A rule is not high quality merely because it is clear, enforceable, or legally valid. It must be fit for purpose across authority, meaning, operation, evidence, maintenance, and the wider rule system in which it governs.
Chapter summary
Rule quality is fitness for legitimate, reliable, and sustainable governance
Organizations often judge rules by a single visible property. Legal teams may ask whether a rule is authorized. Editors may ask whether it is clear. Operations teams may ask whether it can be implemented. Auditors may ask whether compliance can be demonstrated. Each question is necessary, but none is sufficient by itself.
Rule quality is multidimensional. A rule may be precise but unjustified, valid but impracticable, enforceable but disproportionate, measurable but easy to manipulate, or locally effective while damaging the coherence of the broader rule system. High-quality rulemaking therefore requires structured evaluation across the full set of properties that determine whether a rule can govern well.
This chapter defines rule quality, distinguishes it from compliance and effectiveness, presents a practical quality model, explains common tradeoffs, and establishes an assurance process for evaluating rules before adoption and throughout their useful life.
1. Defining rule quality
Quality is not elegance; it is demonstrated fitness
Working definition: Rule quality is the degree to which a rule is authorized, necessary, intelligible, complete, coherent, feasible, proportionate, testable, maintainable, and fit to achieve its legitimate purpose within the rule system and context in which it operates.
This definition follows the general quality-management idea that quality concerns the fulfillment of relevant requirements, but it adapts that idea to rule systems, where the requirements are legal, ethical, semantic, operational, evidentiary, and systemic rather than merely technical.1
A rule is a governing instrument. Its quality must therefore be judged against the work it is expected to perform. That work may include protecting rights, coordinating conduct, controlling risk, allocating authority, standardizing decisions, preserving institutional commitments, or translating external obligations into operating practice.
Quality cannot be inferred from formality. A carefully formatted policy may contain an invalid delegation. A short instruction may govern well because its context is stable and shared. A mathematically precise threshold may be inferior to a structured judgment standard when the subject matter resists fixed boundaries. The relevant question is not whether the rule appears polished, but whether it performs its legitimate function reliably and without unacceptable harm.
2. Important distinctions
Rule quality is related to, but different from, effectiveness and compliance
Is the rule fit to govern?
Examines the properties of the rule and its relationship to purpose, context, and the wider system.
Does the rule produce the intended result?
Concerns outcomes, including intended benefits, unintended effects, and actual behavior.
Are governed actors following the rule?
Measures conformity, not whether the rule itself is legitimate, sensible, or well designed.
Can the rule system be trusted as a whole?
Examines consistency, traceability, alignment, lifecycle control, and system-wide reliability.
A low-quality rule can achieve high compliance if enforcement is strong. A high-quality rule can initially produce low compliance if training or implementation is poor. An effective rule can still be illegitimate if it exceeds authority. A locally sound rule can damage system integrity if it conflicts with superior rules or duplicates existing controls in inconsistent language.
These distinctions prevent a common governance error: treating observed obedience as proof that the rule is good. Compliance data describe behavior under a rule. They do not establish that the rule should exist, that its burdens are justified, or that its consequences are acceptable.
3. A multidimensional quality model
No single score can substitute for examining the dimensions
Mature quality disciplines use structured models because complex artifacts cannot be assessed through one characteristic alone. ISO quality-model standards, for example, organize quality into multiple characteristics and subcharacteristics for specification, measurement, and evaluation.23 Rules require the same discipline.
Validity
Authorized by a legitimate source acting within its power.
Purpose fitness
Directed toward a legitimate, defined, and necessary objective.
Clarity
Meaning can be understood with acceptable interpretive variation.
Completeness
Contains or connects to the information needed for application.
Consistency
Does not create ungoverned contradiction, duplication, or incoherence.
Feasibility
Can be performed using available authority, time, people, and systems.
Testability
Conformance and performance can be evaluated with credible evidence.
Proportionality
Burdens and consequences are justified by purpose and risk.
Exception integrity
Departures are controlled without destroying the rule's purpose.
Maintainability
Can be changed, versioned, explained, and retired without disorder.
Accessibility
Available and usable by the people and systems expected to apply it.
System alignment
Fits the surrounding hierarchy, dependencies, processes, and future state.
The dimensions are interdependent. Improved precision may reduce adaptability. Additional exceptions may improve fairness while increasing complexity. Stronger controls may improve risk reduction while making the rule infeasible. Quality review must therefore examine both individual properties and the balance among them.
4. Validity and authority
An unauthorized rule cannot become high quality through better drafting
Validity is foundational. The issuer must possess authority over the subject, affected population, territory, process, and consequence. Required approval procedures must be followed. Delegation must be genuine, current, and within any limits imposed by the superior source.
Quality review should ask whether the rule is mandatory, contractual, organizational, professional, technical, or advisory and whether its presentation accurately reflects that status. A recommendation presented as a binding requirement is defective even if its substance is sensible. A software restriction that silently exceeds approved policy is not cured by technical reliability.
Validity also includes continuing authority. A rule may become invalid when legislation changes, a contract expires, a delegated office is dissolved, or an emergency power ends. High-quality governance records not only the original source but the conditions under which that source remains effective.
5. Purpose fitness and necessity
A rule should solve a defined problem that warrants a rule
The first quality question is often not how to improve the wording but whether the institution needs the rule at all. Rules impose cognitive, administrative, technical, and enforcement costs. They can reduce discretion, create delay, shift risk, and produce behavior aimed at formal compliance rather than substantive outcomes.
A high-quality rule has a defined problem statement, intended outcome, affected group, risk rationale, and theory of operation. The institution should be able to explain why information, training, guidance, process redesign, supervision, incentives, or a technical safeguard would not address the problem more appropriately.
Purpose fitness requires more than naming a broad aspiration such as safety, fairness, or efficiency. The link between the rule and the objective must be plausible and capable of later evaluation. Better-regulation frameworks similarly emphasize effectiveness, relevance, coherence, proportionality, and evaluation across the policy lifecycle. 45
6. Semantic clarity and precision
The governed actor must be able to determine what the rule requires
Semantic quality concerns actors, actions, objects, modality, conditions, thresholds, time, scope, exceptions, and consequences. The rule should use controlled terms where precision matters, preserve ordinary language where technical terminology would create unnecessary distance, and avoid unstable synonyms for the same concept.
Clarity does not require eliminating all judgment. Terms such as reasonable, material, prompt, substantial, or appropriate may be necessary when fixed thresholds would create arbitrary results. The quality requirement is that the rule governs the judgment: relevant factors, authorized decision-maker, evidence, documentation, review, and the range of acceptable outcomes should be sufficiently defined.
Drafting guidance from legislative institutions consistently treats organization, wording, structure, and enforceability as practical quality concerns rather than matters of style alone.67 A rule that cannot be interpreted consistently by its intended users is operationally unstable even if every sentence is grammatically correct.
7. Contextual completeness
A rule must contain, or reliably connect to, what application requires
Completeness does not mean placing every detail in one sentence or document. It means that the governing system provides the information necessary to decide whether the rule applies and what must happen next.
A complete rule record should identify the relevant population, subject matter, triggering conditions, exclusions, timing, responsible actor, required action, evidence, exception path, and relationship to superior or incorporated sources. Information may be distributed across definitions, schedules, procedures, technical specifications, and referenced standards, but those connections must be controlled.
Hidden dependencies are a frequent source of low quality. A policy may require approval without naming the approving role. A contract may impose a deadline calculated from an event defined elsewhere. A system rule may depend on data whose source and refresh cycle are undocumented. The words appear complete, but application depends on knowledge that is unavailable or unreliable.
8. Consistency and coherence
A good rule must fit the rule system, not merely read well in isolation
Internal consistency requires the rule's provisions, definitions, examples, tables, and exceptions to agree with one another. External consistency requires alignment with superior authority, peer rules, contracts, procedures, controls, and technical implementation.
Coherence is broader than absence of direct contradiction. Two rules may be logically compatible yet create an incoherent operating model. One may require rapid customer response while another introduces an approval chain that makes the deadline routinely impossible. Separate policies may use different risk classifications, producing incompatible escalation paths without ever stating opposite commands.
Quality review should therefore examine shared concepts, thresholds, timing, ownership, dependencies, and outcomes. Duplicate rules should be compared for semantic equivalence rather than assumed consistent because their language looks similar.
9. Feasibility and operability
An impossible rule transfers failure to the governed actor
Feasibility concerns whether the required action can be performed under realistic conditions. The institution must consider time, staffing, skill, information, technology, budget, physical constraints, competing obligations, and the availability of authorized decision-makers.
A rule requiring immediate action may be impossible outside business hours. A control may depend on data not collected until after the decision. A separation-of-duties rule may be appropriate for a large enterprise but impossible for a three-person office. An approval requirement may fail during absence because no delegation mechanism exists.
Feasibility testing should use representative scenarios, including peak demand, emergencies, system outages, remote operations, atypical cases, and resource scarcity. A rule that works only under ideal conditions is not operationally mature.
10. Testability and evidence
The institution must be able to determine whether the rule was followed and whether it worked
Testability requires observable conditions, identifiable evidence, and a repeatable assessment method. For each obligation, the institution should know what fact would demonstrate conformance, where that fact is recorded, who may evaluate it, and how uncertainty is resolved.
Not every rule should be reduced to a binary metric. Some require professional judgment. But even judgment-based rules can define evidence sources, required considerations, documentation standards, review authority, and unacceptable omissions.
Assessment frameworks such as NIST SP 800-53A illustrate the value of explicit, repeatable procedures for examining whether controls are implemented correctly, operating as intended, and producing the desired outcome.8 Rules Integrity applies the same principle more broadly: quality improves when the rule includes a credible path from requirement to evidence to evaluation.
11. Proportionality and fairness
The burden of a rule should be justified by the risk and objective
Proportionality examines whether the rule goes further than necessary. It considers the seriousness and likelihood of harm, the effectiveness of the intervention, the burden imposed, the availability of less restrictive alternatives, and the distribution of costs and benefits.
Fairness concerns both substance and administration. Similar cases should be treated consistently unless relevant differences justify variation. People affected by adverse decisions should know the basis, have access to the governing rule, and receive a meaningful route for correction or review where appropriate.
A rule can be clear, feasible, and measurable while remaining low quality because it imposes excessive cost, creates arbitrary classifications, or concentrates burdens on people least able to comply. Rule quality therefore includes ethical and institutional legitimacy, not only technical performance.
12. Exception quality
Exceptions should preserve judgment without dissolving the rule
Exceptions are often necessary because general rules cannot anticipate every relevant condition. Poorly designed exceptions, however, create hidden discretion, unequal treatment, contradiction, and an alternative path around the rule.
A high-quality exception identifies the circumstances that justify departure, the authorized decision-maker, required evidence, duration, conditions, documentation, monitoring, and whether repeated use triggers review of the underlying rule. Emergency exceptions should include expiration and retrospective examination.
The exception must also remain subordinate to non-waivable superior obligations. An internal approval cannot authorize what law or contract prohibits. Quality assurance should test not only the main rule but every exception path, including combinations of exceptions that may produce unintended results.
13. Maintainability and change resilience
A rule should be designed for a future in which its context changes
Maintainability is the capacity to identify, interpret, amend, test, communicate, and retire a rule without losing control of its meaning or effects. It depends on ownership, version history, source links, dependencies, review dates, amendment procedures, and a clear distinction between current and superseded text.
Rules become fragile when they contain copied definitions, embedded thresholds that change elsewhere, named technologies likely to be replaced, or references to roles that no longer exist. Excessive cross-reference can also reduce maintainability by making a small change propagate unpredictably through many documents.
Change resilience does not mean making rules abstract. It means selecting the right level of stability. Enduring principles, controlled definitions, operational procedures, and technical parameters may belong in different layers so that each can change through an appropriate process.
14. Accessibility and human use
A rule unavailable at the decision point is functionally defective
Accessibility includes discoverability, readability, language, format, disability access, role relevance, and availability within the workflow where the decision occurs. Publishing a rule in a repository does not guarantee that governed actors can find or use it.
Different audiences may need different representations: authoritative text, operational procedure, training explanation, decision table, system logic, or public notice. Those representations must remain controlled and traceable to the same governing meaning. Summaries should not silently narrow obligations or create new ones.
Human factors matter. Dense cross-references, inconsistent labels, overloaded forms, and rules that require excessive memory increase error even when the formal language is accurate. High-quality rules reduce avoidable cognitive burden while preserving the distinctions necessary for correct decisions.
15. Quality tradeoffs
Improving one property can weaken another
Rule quality is not a process of maximizing every dimension independently. Precision can reduce adaptability. Simplicity can omit necessary distinctions. Strong enforcement can discourage reporting. Broad discretion can improve contextual judgment while reducing consistency. Extensive documentation can strengthen evidence while imposing disproportionate cost.
Use thresholds where boundaries are defensible; use structured judgment where relevant facts vary.
Keep the governing proposition intelligible while moving controlled detail to supporting layers.
Treat like cases alike while recognizing differences that are materially relevant.
Increase assurance only to the level justified by risk, consequence, and available alternatives.
Protect core intent while allowing timely change to operational parameters.
Expose the basis of governance without disclosing protected information unnecessarily.
Good design makes tradeoffs explicit. The record should identify which properties were prioritized, what risk was accepted, and what evidence would justify revisiting the balance. Hidden tradeoffs become future disputes; documented tradeoffs become governed decisions.
16. Rule quality assurance
Quality must be engineered, reviewed, tested, and monitored
Quality assurance should begin before drafting and continue after implementation. A rule should not be considered complete merely because an authorized body approved the text. Approval is one control in a larger assurance process.
State the problem, authority, outcome, population, and constraints.
Select the rule mechanism, scope, modality, exceptions, and evidence model.
Conduct legal, semantic, operational, technical, and equity examination.
Apply normal, boundary, conflict, exception, failure, and abuse scenarios.
Record authority, rationale, accepted tradeoffs, and implementation obligations.
Measure conformance, outcomes, burden, disputes, overrides, and unintended effects.
Correct defects, update dependencies, revise assumptions, or retire the rule.
Cross-functional review is essential because no single profession sees every defect. Legal reviewers may identify authority problems. Operators may expose infeasible timing. Data specialists may find unobservable evidence requirements. Accessibility experts may identify unusable presentation. Frontline users may reveal that the rule conflicts with the actual sequence of work.
Management-system standards similarly treat effective compliance as something to be established, implemented, evaluated, maintained, and improved rather than declared once. 9
17. Measurement and scoring
Scores can support judgment, but they should not conceal critical defects
A quality score can help compare drafts, prioritize review, and reveal recurring weaknesses. Each dimension may be rated using defined criteria and supporting evidence. Weighting may vary by domain: authority and safety may be critical in one system, while accessibility and response time dominate another.
Aggregation must be handled carefully. A high average should not compensate for a fatal defect. An unauthorized rule, an impossible obligation, or an uncontrolled conflict may require rejection regardless of strengths elsewhere. Quality models should therefore combine dimensional ratings with mandatory gates.
Authority, legality, rights, and non-waivable constraints.
Feasibility, intelligibility, evidence, and implementation readiness.
Strengths and weaknesses across the full quality model.
Disposition based on evidence, risk, and unresolved defects.
The value of measurement lies in disciplined reasoning, not the appearance of numerical certainty. Ratings should be reviewable, evidence-based, and accompanied by the issues that numbers cannot adequately express.
18. Failure cases
Rules can fail while appearing professionally complete
01
The clear but unauthorized rule
A department issues a precise restriction outside its delegated authority. Enforcement is consistent, but legitimacy is absent.
02
The measurable but distorted rule
A performance threshold is easy to audit but causes staff to avoid difficult cases, undermining the intended service objective.
03
The complete but unusable rule
Every condition appears in one document, yet the density and cross-references make correct application unrealistic at the decision point.
04
The fair exception without control
An exception protects unusual cases but lacks evidence, duration, and review, becoming the routine path around the rule.
05
The locally efficient contradiction
A unit improves its own workflow through a new rule that conflicts with enterprise retention, security, or contractual obligations.
06
The durable rule that outlives its assumptions
The text remains unchanged while technology, roles, risk, and law evolve, leaving a formally current but substantively obsolete rule.
19. Practical rule quality review
Twenty-four questions for evaluating a rule
- 01
Authority
What legitimate source authorizes this rule, and is the issuer acting within scope?
- 02
Problem
What specific condition or risk is the rule intended to address?
- 03
Necessity
Why is a rule preferable to guidance, training, process redesign, or another intervention?
- 04
Outcome
What result should the rule produce, and how will that result be recognized?
- 05
Actor
Is every responsible, affected, approving, and reviewing role identifiable?
- 06
Action
Is the required, permitted, or prohibited conduct sufficiently clear?
- 07
Scope
Are population, subject matter, geography, systems, and organizational boundaries defined?
- 08
Conditions
Can users determine when the rule starts, stops, and does not apply?
- 09
Time
Are deadlines, durations, recurrence, and effective periods unambiguous and feasible?
- 10
Definitions
Are critical terms controlled, current, and used consistently?
- 11
Completeness
Can application occur without unavailable assumptions or hidden dependencies?
- 12
Consistency
Does the rule align with superior, peer, contractual, procedural, and technical rules?
- 13
Feasibility
Can the rule be performed under normal, peak, degraded, and emergency conditions?
- 14
Resources
Are required people, skills, information, authority, systems, and budget available?
- 15
Evidence
What facts demonstrate conformance, and where will they be preserved?
- 16
Assessment
Who evaluates compliance and effectiveness, using what repeatable method?
- 17
Proportionality
Are burden, restriction, and consequence justified by the purpose and risk?
- 18
Fairness
Are materially similar cases treated alike, and are relevant differences recognized?
- 19
Exceptions
Are departures authorized, evidenced, limited, monitored, and subordinate to superior rules?
- 20
Accessibility
Can every intended user locate, understand, and apply the rule at the decision point?
- 21
Implementation
Do procedures, training, forms, data, and software preserve the approved meaning?
- 22
Maintenance
Are ownership, versioning, review, amendment, and retirement responsibilities defined?
- 23
Monitoring
Will the institution detect burden, disputes, overrides, drift, and unintended effects?
- 24
Decision
What defects remain, who accepted them, and what condition will trigger reconsideration?
20. Worked examples
Improving quality requires more than rewriting the sentence
Initial rule
“Managers must promptly review all significant incidents.”
Quality defects
- Manager population is undefined.
- Significant incident has no governed meaning.
- Promptly provides no factors or outer limit.
- Review content and evidence are unspecified.
- Escalation and exceptions are absent.
Controlled rule model
Incident severity, responsible reviewing role, review deadline, required evidence, escalation path, outage procedure, and exception authority are defined through a controlled incident-governance record.
Over-precise rule
“Every customer complaint must be resolved within exactly 48 hours.”
Quality analysis
The fixed limit is measurable but may encourage premature closure or be impossible for complex matters. A better design may separate acknowledgement, risk triage, routine resolution targets, complex-case extensions, and documented oversight.
Technically reliable implementation
A system automatically rejects transactions missing a field that policy treats as optional.
Quality analysis
The software is functioning consistently, but the implemented rule is not aligned with approved policy. Technical reliability cannot compensate for semantic and authority defects.
Conclusion
High-quality rules earn trust through evidence across the full system
Rule quality is not a literary judgment and not a compliance statistic. It is a disciplined evaluation of whether a governing instrument is legitimate, necessary, understandable, complete, coherent, feasible, proportionate, testable, maintainable, and usable in the context for which it was created.
No dimension stands alone. Clear language cannot cure invalid authority. Precise metrics cannot justify a harmful objective. Strong enforcement cannot make an impossible rule fair. A well-designed sentence cannot remain trustworthy when its dependencies, systems, or institutional assumptions change without review.
Rules Integrity therefore treats quality as an engineered and continuously examined property. Institutions should define quality criteria before drafting, test the rule against realistic cases, record accepted tradeoffs, monitor actual effects, and revise or retire the rule when evidence shows that its fitness has degraded.
Foundational principle: A rule should be considered high quality only when its legitimacy, meaning, operation, evidence, proportionality, and continued fitness can be demonstrated—not merely asserted.
Selected references
Sources informing this chapter
- International Organization for Standardization. ISO 9000:2015 — Quality management systems: Fundamentals and vocabulary. Foundational quality-management vocabulary and principles.
- International Organization for Standardization. ISO/IEC 25010:2023 — Systems and software engineering: Product quality model. A multidimensional model for specifying, measuring, and evaluating quality characteristics.
- International Organization for Standardization. ISO/IEC 25002:2024 — Quality model overview and usage. Framework for defining quality characteristics, measurement, requirements, and evaluation.
- Organisation for Economic Co-operation and Development. Recommendation of the Council on Regulatory Policy and Governance.
- European Commission. Better Regulation Guidelines and Toolbox. Guidance covering preparation, implementation, evaluation, coherence, effectiveness, and proportionality.
- UK Office of the Parliamentary Counsel. Drafting Guidance. Guidance on clear writing, legislative structure, amendments, and drafting technique.
- U.S. Office of the Federal Register. Regulatory Drafting Guide. Guidance intended to improve the clarity and enforceability of regulatory documents.
- National Institute of Standards and Technology. NIST SP 800-53A Revision 5 — Assessing Security and Privacy Controls in Information Systems and Organizations. A structured, repeatable approach to control assessment.
- International Organization for Standardization. ISO 37301:2021 — Compliance management systems: Requirements with guidance for use.
These sources provide established perspectives on quality models, regulatory design, drafting, assessment, proportionality, evaluation, and compliance management. This chapter adapts those perspectives to the broader discipline of Rules Integrity and to rule systems across legal, contractual, organizational, professional, and technical domains.