RAG guide

Best AI models for RAG

This page ranks models that fit document-backed assistants and retrieval pipelines, with extra weight on tool support, structured output, and enough context to hold retrieved evidence.

Live signalTool support for retrieval and workflow integration

Live signalStructured output support for controlled downstream handling

Live signalEnough context to hold retrieved chunks and instructions

Live signalLive pricing for document-backed production traffic

Fast answer

Start with the live shortlist, then validate the route

Most RAG teams should compare tool support, context room, and structured output before raw benchmark scores, because those factors determine whether the model fits the actual retrieval stack.

Data source and freshness

Catalog-backed, not a static price sheet

TVP refreshes this page from the live OpenRouter model catalog. This render used 685 public model records and was synchronized Oct 26, 2026, 7:33 AM UTC. Pricing, availability, and context values can change.

Verify the exact route before sending production traffic, then use the linked model and provider pages as the source for current values. Read the TVP data methodology.

Shortlist

Top live candidates right now

x-ai

SpaceXAI: Grok 4.20

Grok 4.20 is a reasoning model from SpaceXAI with industry-leading speed and agentic tool calling capabilities. It combines the lowest hallucination rate on the market with strict prompt adherance, delivering...

Context2,000,000

Input$1.25

Output$2.50

2,000,000 token context, tool support, and structured output make it a better RAG candidate.

text
image
file
tools
structured

Model details Provider page

meta-llama

Meta: Llama 4 Scout

Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input...

Context1,310,720

Input$0.1

Output$0.3

1,310,720 token context, tool support, and structured output make it a better RAG candidate.

text
image
tools
structured

Model details Provider page

openai

OpenAI: GPT-6 Luna (batch)

GPT-6 Luna is the fast, cost-efficient model in OpenAI's GPT-6 series, positioned below GPT-6 Sol. It is suited for high-volume and latency-sensitive workloads such as chat, classification, and lightweight agentic...

Context1,050,000

Input$0.05

Output$0.25

1,050,000 token context, tool support, and structured output make it a better RAG candidate.

file
image
text
tools
structured

Model details Provider page

openai

OpenAI: GPT-6 Luna Pro (batch)

GPT-6 Luna Pro is the same underlying model as [GPT-6 Luna](TVP catalog), served with `reasoning.mode` set to `pro` for higher-quality responses on complex tasks. **Cost note:** pro mode spends far more...

Context1,050,000

Input$0.05

Output$0.25

1,050,000 token context, tool support, and structured output make it a better RAG candidate.

file
image
text
tools
structured

Model details Provider page

xiaomi

Xiaomi: MiMo-V2.5

MiMo-V2.5 is a native omnimodal model by Xiaomi. It delivers Pro-level agentic performance at roughly half the inference cost, while surpassing MiMo-V2-Omni in multimodal perception across image and video understanding...

Context1,050,000

Input$0.119

Output$0.238

1,050,000 token context, tool support, and structured output make it a better RAG candidate.

text
audio
image
video
tools
structured

Model details Provider page

FAQ

What buyers usually ask

What should RAG teams compare first?

Most RAG teams should compare tool support, context room, and structured output before raw benchmark scores, because those factors determine whether the model fits the actual retrieval stack.

Why does pricing matter in RAG?

RAG prompts are often large because they include retrieved context. That makes per-token cost a bigger operational factor than in short chat routes.

Next step

Use the guide, then validate the route in live TVP data.

TVP keeps the shortlist connected to the current catalog, provider coverage, and token pricing so buyers can move from research to routing without starting over.

Open marketplace View rankings