Agentic Search

Agentic Search

A retrieval paradigm where the language model has agency over the retrieval process, deciding when to search, what queries to issue, and how to incorporate results—in contrast to static RAG pipelines with fixed retrieve-then-read structure.

Comparison with Static RAG

AspectStatic RAGAgentic Search
Control flowFixed pipelineModel-determined
Retrieval timingBefore generationDuring reasoning
Query sourceUser query onlyModel-generated subqueries
Number of retrievalsFixed Adaptive (0 to many)
Multi-hop reasoningLimitedNatural
TrainingSFT on QA pairsOften RL with outcome reward

Key Capabilities

  1. Adaptive retrieval: Search only when needed
  2. Query reformulation: Generate targeted subqueries
  3. Iterative refinement: Multiple search rounds
  4. Result synthesis: Combine information across retrievals
  5. Self-evaluation: Assess if more search is needed

System 2 Analogy

Agentic search corresponds to System 2 thinking in cognitive science:

  • Deliberate, slow processing
  • Explicit reasoning about information needs
  • Iterative refinement

Static RAG is more like System 1:

  • Fast, automatic
  • Fixed pattern execution
  • No adaptation

Example Systems

SystemApproach
SEARCH-R1RL-trained interleaved reasoning + search
Self-RAGLearned retrieval decisions via special tokens
ReActReasoning-action interleaving
Adaptive-RAGQuery routing by complexity

When to Use

ScenarioRecommendation
Simple factual QAStatic RAG
Multi-hop reasoningAgentic Search
Latency-criticalStatic RAG
Research queriesAgentic Search

Connections

Appears In