Tool-Adaptive LLM Reranker

2026-07-12Information Retrieval

Information RetrievalArtificial IntelligenceComputation and Language
AI summary

The authors present TALRanker, a new system that improves how language models find the best information by deciding when to use external search tools. Instead of calling search tools all the time, which slows things down, TALRanker learns to only use them when really needed to avoid mistakes. They train it in two steps to keep the model's original abilities and make it smart about balancing accuracy and speed. Tests show TALRanker works very well and fast, especially on difficult questions requiring reasoning.

Large Language ModelsFactual HallucinationInformation RetrievalRerankingMarkov Decision ProcessReinforcement LearningHybrid LossExternal Tool CallingAccuracy-Efficiency Tradeoff
Authors
Zichuan Liu, Ruijin Hua
Abstract
Generative Large Language Models (LLMs) have revolutionized information retrieval, yet their strictly parametric nature frequently leads to severe factual hallucinations when confronted with complex queries beyond their epistemic boundaries. While external tool-calling can mitigate this, indiscriminately invoking search tools for every document during reranking incurs prohibitive latency overheads, creating an intractable accuracy-efficiency dilemma. To address this challenge, we propose TALRanker, a novel framework that formalizes pointwise relevance scoring as an agentic Markov decision process. We optimize it via a two-stage training paradigm. An initial warm-up utilizes a language-preserving hybrid loss to prevent the catastrophic forgetting of native generative capacities. Subsequently, an asymmetric cost-aware reward equipped in reinforcement learning forces the policy to autonomously bypass tools for maximum efficiency when confident, while selectively retrieving external evidence to avert severe hallucination penalties when uncertain. Extensive evaluations demonstrate that TALRanker achieves state-of-the-art performance across standard and reasoning-intensive retrieval benchmarks, matching throughput with pointwise rerankers while outperforming parameter-heavy reasoning models.