SYNTHESIS NOTE
Topics›Agent Harness›this note

How should agents route across thousands of skills?

As skill libraries grow, should routing focus on selecting one skill or composing many? This explores whether decomposition and chaining creates better task execution than single-skill selection.

Synthesis note · 2026-07-17 · sourced from Agent Harness

Modern agents lean on skills — modular, reusable tool specifications (e.g. Anthropic's SKILL.md format) that bundle a capability with documentation for when and how to invoke it. As community skill libraries swell to thousands of entries, the obvious framing is a selection problem: given a query, which skill do I call? But real tasks rarely map to a single skill; they require composing several. That reframes routing as Compositional Skill Routing: decompose a complex query into atomic sub-tasks, retrieve the appropriate skill for each, and compose them into a dependency-aware executable plan (a DAG), rather than picking one tool off the shelf.

The reframing matters because it moves the hard part upstream. Selection accuracy is bounded by how well the query was carved into sub-tasks in the first place — a bad decomposition asks retrieval to find skills for the wrong steps. This is the skill-library instantiation of a principle the vault already holds: since Does separating planning from execution improve reasoning accuracy?, treating decomposition as its own stage (with its own failure mode and its own fixes) beats folding it into selection.

It also connects to how skill repositories should be built and maintained — Can a separate trained curator improve skill libraries better than frozen agents? — because composition quality depends on skills being scoped and documented well enough to be retrieved and chained. Compose-not-select is the demand side of the same skill-as-first-class-artifact shift.

Inquiring lines that read this note 12

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What should agent evaluation prioritize to reveal reliable behavior? How does decomposing tasks improve reasoning and prevent failure propagation? How do agent-learned skills transfer and improve across different tasks? How much do training data properties shape model reasoning? When do multi-agent systems outperform single frontier models? Can intelligent routing over smaller models outperform scaling a single large model? How should agent systems validate and persist generated code artifacts? What execution architectures enable agents to most effectively use tools?

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
13 direct connections · 97 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

real agent tasks require composing multiple skills not selecting one so skill routing becomes decompose-retrieve-compose