Task Decomposition

Task decomposition is the scalable-oversight technique of breaking complex problems into smaller, independently solvable subtasks — making evaluation and verification tractable at each level. Foundation for iterative-amplification and many debate-based approaches.

Core Concept

Mirrors how humans handle complexity through layers of abstraction.

Practical example: summarize a book by first summarizing each chapter, then pages, then paragraphs — until reaching simple-enough levels for direct human evaluation.

Three Properties of Good Decomposition

Recursive Decomposability

Problems can be continuously broken into simpler sub-tasks until reaching components solvable directly.

Independence / Modularity

Sub-tasks can be completed separately without depending on other components. Cross-dependencies break this.

Composability

Individual solutions combine into a coherent answer to the original problem. Without this, local solutions don’t yield global solution.

Not all tasks satisfy all three. Failure modes:

  • Cross-dependencies → independence violated
  • Holistic-judgment tasks → don’t decompose
  • Composability gaps → local correct, global wrong

Why It Matters for Oversight

Task decomposition operationalizes verification-vs-generation hierarchically:

  • Each subtask is verified at its own complexity level
  • Humans can check each piece even when they couldn’t generate it
  • The combined verification provides confidence in the whole

This is necessary because as systems become more capable, providing accurate training signals for subjective tasks becomes difficult. By reducing task complexity through decomposition, humans can more easily evaluate outputs and provide clearer feedback signals.

Factored Cognition

Apply decomposition principles to machine learning itself. Break sophisticated reasoning into “many small and mostly independent tasks” learnable through human demonstrations and feedback.

Key advantages:

  • Delegation — multiple agents work independently on assigned subtasks
  • Meta-reasoning — the decomposition process itself can be optimized iteratively

Role in Other Scalable Oversight Techniques

Task decomposition is a building block:

Limitations

The Atlas notes important caveats:

  • Some tasks don’t decompose — holistic judgment, gestalt perception
  • Decomposition itself can be wrong — bad decomposition hides errors at boundaries
  • Information loss at boundaries — context that matters across subtasks may be lost
  • Aggregation may add errors — small subtask errors compound when combined

These mean task decomposition isn’t universal — it’s a powerful tool when conditions are favorable, but has structural limits.

Connection to Wiki

Sources cited

Primary URLs harvested from this page’s summary references. Auto-generated by scripts/backfill_citations.py; edit by re-running, not by hand.