If you are building an AI agent in late 2026, the question is no longer whether it needs live web search. It is which search layer to rent, and how much of the answer pipeline that layer should own. Our short answer: start with Tavily if you want one call that returns model-ready results, add Exa when queries are fuzzy or research-heavy, use Serper when you only need cheap Google results, and bolt on Firecrawl when the agent has to read full pages. The more interesting story is why that menu looks the way it does, and three things changed this year that should shape your choice.
This is a trend piece, not a ranking. We read the vendors' own pricing pages, a LangChain integration page, a press release and two competitor comparisons published by vendors in this very market, then added our own analysis. Vendor-published benchmarks are flagged as such throughout, because every one of them favours its author. For the wider category map, see our AI & ML guide and AI & ML topic page.
The quick comparison
| Tool | What it returns | Free tier | Headline price | Best for |
|---|---|---|---|---|
| Tavily | Search, extract, crawl, research in one API | 1,000 credits/mo | $0.008 per credit (about $8 per 1,000 basic searches); plans from $30/mo | Default RAG and agent grounding |
| Exa | Semantic search plus page contents and deep research | $10 monthly credits | $4 per 1,000 Instant searches; $7 Fast/Auto; $12-$15 Deep | Fuzzy, research-style queries |
| Firecrawl | Search plus clean markdown from full pages; crawl; interact | 1,000 credits/mo | Search costs 2 credits per 10 results; plans from $16/mo billed yearly | Agents that must read whole pages |
| Serper | Raw Google SERP data in JSON | 2,500 free queries | From $0.30 per 1,000 queries; packs from $50 | Cheap, fast Google results |
| Perplexity | Cited, synthesised answers | See profile | See profile | Answer-first products |
Prices are list prices from the vendors and our profiles as of October 2026, and they change often. Check the vendor before you budget.
What changed in 2026?
1. The market is consolidating
On February 10, 2026, Nebius announced an agreement to acquire Tavily to add agentic search to its AI cloud, according to Nebius's own press release. The terms were not disclosed in that release. Tavily's founder and CEO Rotem Weiss and the team were to join Nebius, and Tavily was to keep its brand. The release also cites more than 3 million monthly SDK downloads and customers including IBM, Cohere and Groq. Those are company-stated figures that we have not independently verified.
Our read: a GPU cloud buying a search API tells you where the money thinks the value is. Inference is becoming a commodity, and the sticky part of an agent is the toolbelt around the model. If you build on Tavily today, nothing breaks, but we would not hard-wire it so deeply that swapping providers takes a sprint. Our Tavily profile already lists "becoming part of Nebius may change roadmap or pricing" as a con, and that remains the sensible way to hold it.
2. Free tiers are shrinking and prices are drifting up
Firecrawl's comparison, itself a vendor blog, argues that pricing is moving toward metered usage with fewer free tiers. It points to Brave removing its standalone free plan in February 2026 and Exa lifting standard search from $5 to $7 per 1,000 in March 2026. We could not verify those dates on the vendors' own pages, so treat them as one competitor's account. What we can see directly: Brave's API page lists $5 per 1,000 requests with a $5 monthly credit, while a banner on the same page promises up to $20 in free calls each month. The two figures do not match, which is a good reason to read the billing page rather than the marketing line.
For you, the lesson is practical. Free tiers are for prototyping. Budget on the paid rate from day one.
3. The consumer is now a model, not a person
The same Firecrawl piece splits the market into five jobs: raw SERP APIs, ranked web search, semantic search, synthesis APIs that return a written answer, and content extraction. That taxonomy is useful because it explains why products with the same label cost wildly different amounts. A SERP API hands you ten links and snippets. An extraction API hands you the page as clean markdown. A synthesis API hands you an answer. The further right you go, the more tokens and compute the vendor spends on your behalf, and the more you pay.
What does it actually cost? A back-of-envelope model
Per-query list prices hide the real picture, so here is a simple calculation using only the published rates above. Assume an agent that makes 100,000 basic searches a month.
- Serper at an entry rate of about $1 per 1,000 (third-party comparisons put it there; the site advertises as low as $0.30 per 1,000 at volume): roughly $100.
- Brave at $5 per 1,000: roughly $500.
- Exa at $7 per 1,000 for Fast or Auto: roughly $700. Instant at $4 per 1,000 would be about $400.
- Tavily at $0.008 per credit with one credit per basic search: roughly $800.
That is a 4-8x spread for what looks like the same job. Two caveats keep us honest. First, the cheap end returns less. Serper gives you links and snippets, and if your agent then has to fetch and clean ten pages, you are paying for scraping and for the model tokens that read the pages. A comparison published by one of the vendors in this market makes the same point: search pricing "does not represent the complete cost of producing a grounded answer." Second, none of these numbers include the cost of a wrong answer, which is the one that actually hurts.
Our rule of thumb: compare cost per correct, grounded answer, not cost per query. Run 50 of your own real queries through two or three providers, score the answers, and then divide.
Which one for which job?
Tavily: the sensible default
Tavily wins on integration effort. One API covers search, extract, crawl, map and a research endpoint, and results come back chunked for language models. It also claims guardrails against PII leakage and prompt injection, which matters more than people think once an agent browses unattended. The trade-offs are credit-based billing that varies by endpoint and the fact that its benchmarks are vendor-published. Pick it when you want to ship this week. Compare it with its closest rivals in Exa vs Tavily and Firecrawl vs Tavily.
Exa: the one for questions that do not fit keywords
Exa is built on semantic search, with configurable latency from an Instant mode to multi-step Deep search, plus vertical indexes for companies, people, news, papers and code. It ships an MCP server and Claude connector. If your agent does enrichment ("find companies like this one") or research ("papers that make this argument"), Exa's approach tends to beat keyword matching. The cost is real: Deep search and Agent runs are far pricier than Instant. See Exa vs Firecrawl if you are also weighing a crawler.
Firecrawl: when reading matters more than finding
Firecrawl is the odd one out in the best way. It is open source and strongest at turning pages into LLM-ready markdown or JSON, including JavaScript-rendered sites, with search layered on top. Its self-reported benchmarks should be read as marketing, but the underlying logic is sound: raw HTML wastes context window. If your agent keeps failing because it cannot read the page it found, fix that before you pay for fancier search.
Serper: the budget workhorse
Serper is the least glamorous and often the most cost-effective. It is a thin, fast layer over Google results with ten search types, 2,500 free queries and a ready-made tool in the LangChain Serper integration. It does not do extraction or semantic ranking, so pair it with a reader. Head-to-heads: Serper vs Tavily and Exa vs Serper.
How good are they really? Read the benchmarks sceptically
The most cited neutral-looking number is an AIMultiple agent-search test, as repeated by vendors. In the version quoted, Brave scored 14.89, Firecrawl 14.58, Exa 14.39 and Tavily 13.67. Brave's own page, unsurprisingly, leads with "ranked 1st in independent testing." We would not pick a provider on a spread of about one point on a single test. Another vendor comparison, which ranks its own product well, concedes that "no provider leads every category." That sentence is the most reliable finding in this entire market.
What to do instead:
- Build a 50-query test set from your real traffic, including the awkward long-tail questions.
- Score for answer correctness and citation quality, not just relevance.
- Track tokens consumed per task, since a verbose result costs you model spend.
- Re-run it quarterly, because every vendor on this list ships changes monthly.
Our recommended stack
For most teams building a RAG product or research agent, we would run a two-provider setup. Use a cheap discovery layer (Serper, or Tavily if you want a single vendor) for the bulk of queries, and escalate to a semantic or deep layer (Exa) only when a query is ambiguous. Add Firecrawl for pages that need to be read in full. Keep a thin abstraction over all of them so you can swap vendors, given the consolidation above.
If you are still designing the retrieval half, read Retrieval-Augmented Generation, Explained and What Are Embeddings?. Web search and a vector store solve different problems: Pinecone-style stores hold your private data while these APIs fetch public data. Our top vector databases guide covers the other side, and LangChain is the orchestration layer most teams wire both into. For the broader landscape, see The Best AI Tools for 2026.
What is missing from this list
Several well-known players in agent search are not yet listed on ProductListo, so we have not reviewed them: Brave Search API, Parallel, Bright Data's SERP API, SerpAPI and TinyFish. They are real contenders, and their absence says more about how much of this fast-moving market we still have to map than about their quality.
Build search for agents? Get listed
If you make a search, scraping or retrieval tool for agents, submit your tool for review, or ask about guest posts and sponsored placements on our write for us page. We label sponsored content clearly and never sell reviews.