Documentation Index

Fetch the complete documentation index at: https://azure-cost-management-playbook.turbo360.com/llms.txt

Use this file to discover all available pages before exploring further.

Foundry IQ / AI Search

Prev Next

Naming note: Azure AI Search has been rebranded as Foundry IQ on the Azure pricing page as of mid-2026. The underlying resource type (Microsoft.Search/searchServices) and billing service family (Search) remain unchanged. Both names refer to the same service.

Azure AI Search / Foundry IQ is significant enough to warrant its own top-level resource in Azure, but it is closely integrated with the Azure AI Services family through AI enrichment pipelines.

What it does (in the AI Services context)


When combined with Azure AI Services, Azure AI Search / Foundry IQ gains AI enrichment — a pipeline that runs Cognitive Skills (Vision, Language, Document Intelligence) over raw content during indexing to extract and store enriched metadata alongside the original content.

When you'd use it


  • You have a corpus of unstructured documents (PDFs, images, emails) and want to make their content searchable, not just their filenames.

  • You are building a RAG (Retrieval-Augmented Generation) solution where a chatbot needs to retrieve relevant chunks of private documents before passing them to an LLM.

Sample use case


A law firm has 10 years of case files in SharePoint — PDFs, scanned documents, and emails. Azure AI Search with AI enrichment indexes the entire corpus: OCR extracts text from scans, NER tags legal entities (parties, courts, dates), and embeddings from Azure OpenAI enable semantic search. Lawyers search in natural language and retrieve the most relevant precedents in seconds.

Example reference architecture

Pricing & How Costs Work

Foundry IQ (Azure AI Search) offers two billing models: Dedicated (traditional always-on, tier-based) and Serverless (preview, scale-to-zero). Costs also come from separately billed add-on features.

1. Dedicated tiers — Search Units (SUs)

A Search Unit (SU) is the fundamental billing unit for dedicated tiers:

Azure AI Search uses a tier-based, always-on pricing model. Unlike consumption-based services, you pay for provisioned capacity per hour regardless of query traffic. Costs come from three independent sources:

Search Units (SU) = Replicas * Partitions

You pay a fixed monthly rate per SU, with the rate determined by the tier:

Tier

Storage per partition

Max SUs

Price per SU/month

Use case

Free (F)

50 MB

N/A

$0

Dev/test; 3 indexes max

Basic

15 GB (max 45 GB/service)

9 (3 replicas × 3 partitions)

$73.73

Small workloads, 1 partition max scale

Standard S1

160 GB (max 1.9 TB)

36 (12 × 12)

$245.28

General purpose

Standard S2

512 GB (max 6 TB)

36

$981.12

Higher storage/throughput

Standard S3

1 TB (max 12 TB)

36

$1,962.24

Large-scale; S3 HD mode available

Storage Optimised L1

2 TB (max 24 TB)

36

$2,802.47

Vector-heavy / large indexes

Storage Optimised L2

4 TB (max 48 TB)

36

$5,604.21

Maximum storage per SU

  • Replicas add query throughput and availability.

  • Partitions add storage capacity and indexing throughput.

  • The service runs 24×7 on dedicated tiers; there is no pause or stop capability — the service bills continuously once provisioned.

  • Prices above are per SU per month (billed hourly). A Basic service with 1 replica and 1 partition = 1 SU = ~$73.73/month.

2. Serverless tier (preview)

A new billing model that scales to zero when idle — no always-on compute cost:

Component

Unit

Notes

Compute

Per Compute Unit (CU) per hour

1 CU ≈ 1 vCPU + 8 GB RAM; usage billed per minute in 0.25 CU increments

Indexed storage

Per GB per month

Billed hourly based on data stored across all indexes

Included storage

1 GB per index

Each index gets 1 GB included

Max indexes

30 per service

Max services

5 per subscription per region

Note: Billing for Serverless is expected to begin in late 2026. Customers using Serverless are not charged before billing is enabled.

Serverless is suited to infrequent or variable traffic workloads where dedicated always-on capacity would be significantly underutilised.

3. Add-on features — billed per use

These are charged on top of the base tier cost:

Feature

Billing unit

Pricing

Semantic Ranker

Per 1,000 requests

First 1,000 requests/month free; then $1.00 per 1,000 requests

Agentic Retrieval

Per 1M tokens

First 50M tokens/month free; then $0.022 (min) / $0.10 (medium) per 1M tokens depending on complexity

Custom Entity Lookup skill

Per 1,000 text records

$1.00 (0–1M), $0.75 (1M–3M), $0.30 (3M–10M), $0.25 (10M+) per 1K records

Image Extraction (document cracking)

Per 1,000 images

$1.00 (0–1M), $0.80 (1M–5M), $0.65 (5M+) per 1K images

4. AI Enrichment — billed via linked AI Services resource

When you attach an Azure AI Services multi-service resource to the search indexer enrichment pipeline, skills (OCR, NER, key phrases, embeddings) are billed through that AI Services resource at the respective service rates. The search service itself does not charge for enrichment calls.

What Drives Costs


Cost driver

Why it matters

Tier selection

The biggest determinant of monthly cost on dedicated tiers. S2 ($981/SU) is 4× the cost of S1 ($245/SU) per unit. Over-provisioning the tier is the most common cause of unnecessary spend.

Replica count

Each replica multiplies the SU count linearly. 3 replicas at S1 = $736/month baseline vs $245/month for 1 replica.

Partition count

Each partition also multiplies SU count. Driven by index storage size; adding a partition to accommodate vector embeddings is a common growth trigger.

Continuous provisioning (dedicated)

No stop/pause capability on dedicated tiers — a dev/test service left running at S1 with 2 replicas costs ~$490/month whether used or not.

Semantic ranker query volume

At $1/1,000 requests, high-volume deployments with semantic ranker enabled on all queries accumulate costs quickly beyond the 1,000 free/month.

Agentic retrieval token volume

New in Foundry IQ — medium-complexity agentic retrieval at $0.10/1M tokens adds up at scale in multi-turn agent query pipelines.

Vector index size

Large embedding corpora require more partitions, driving up SU count and therefore cost. Quantisation and dimension reduction are key controls.

AI enrichment volume

The number of documents indexed with AI skills drives cost in the linked AI Services resource — not in the Search resource itself.

Azure Cost Data — Meters & Meter Subcategories


Azure AI Search / Foundry IQ appears under the Search service family (not Cognitive Services) in Cost Management. Resource type: Microsoft.Search/searchServices.

Meter name

Meter subcategory

What it counts

Search Units

Basic / Standard S1 / S2 / S3 / Storage Optimized L1 / L2

Hourly SU consumption (replicas × partitions × hours)

Semantic Queries

Standard S1 (or tier name)

Semantic ranker requests above the 1,000/month free allocation

Agentic Retrieval Tokens

Standard (Min / Low / Medium)

Tokens processed by agentic retrieval above the 50M/month free allocation

Compute Units

Serverless

CU-hours consumed by serverless tier operations

Indexed Storage

Serverless

GB-months of data stored in serverless indexes

Image Extraction Transactions

Standard S1 (or tier)

Images extracted during indexer document cracking

Custom Entity Lookup Text Records

Standard S1 (or tier)

Text records processed by the Custom Entity Lookup skill

Meter subcategory notes:

  • The meter subcategory for Search Units reflects the tier (e.g. Standard S1). If you change tier mid-month, two separate SU meter rows appear in that billing period.

  • Quantity for Search Unit meters = cumulative SU-hours. Divide by 720 (hours/month) to get the average SU count provisioned; divide by 24 to get daily SU-hours.

  • Agentic Retrieval meters are new with the Foundry IQ positioning. These appear as consumption-based rows and will grow as agentic RAG pipelines scale, independently of the SU tier cost.

  • AI enrichment costs (OCR, NER, embeddings run via the skillset) appear under Cognitive Services meters against the linked AI Services resource — not under the Search service family. This split is the most common source of incomplete cost attribution for search-based RAG architectures.

  • There is no separate storage meter for dedicated tiers — storage capacity is bundled into the SU price. Only the Serverless tier has an explicit storage meter.

  • Semantic ranker overages appear as a distinct row, making it straightforward to isolate that cost in exports.


Common Developer Mistakes That Drive Up Costs


  • Choosing too high a tier at the start and never reviewing it. Teams provision Standard S2 ($981/SU/month) or S3 ($1,962/SU/month) "for production readiness" before knowing actual index size or query volume. Because Foundry IQ / Azure AI Search bills per SU-hour continuously, an over-tiered service running for months before a review costs significantly more than a right-sized one.

  • Leaving development and staging search services running 24×7. Unlike consumption-based services, a dedicated dev search service on S1 with 2 replicas bills ~$490/month whether it receives a single query or thousands. There is no pause capability on dedicated tiers — deleting and recreating the service is the only way to stop billing.

  • Not considering Serverless for dev/test workloads. The new Serverless tier scales to zero when idle, making it significantly cheaper than a dedicated S1 service for development or infrequent-use scenarios. Teams that provision dedicated tiers for dev by default are paying for always-on capacity that is idle most of the time.

  • Adding replicas "for availability" without measuring actual query throughput. Each replica at S1 adds $245/month. A dev or internal-facing service receiving tens of queries per day does not need 3 replicas. Replicas improve throughput and SLA, not data durability.

  • Enabling semantic ranker on every query. At $1/1,000 requests (after the first 1,000/month free), a service handling 1 million queries/month with semantic ranker enabled on all of them adds $1,000/month in ranker charges on top of the SU cost. Semantic ranker should be scoped to queries where ranking quality materially affects user experience.

  • Not accounting for Agentic Retrieval token costs in multi-agent architectures. Agentic retrieval uses a multi-turn self-reflective framework and is billed per million tokens. Medium-complexity retrieval at $0.10/1M tokens in a high-volume agent pipeline adds up quickly — and the first 50M free tokens per month can be exhausted faster than expected at scale.

  • Not using AI enrichment selectively. Running every document through a full AI enrichment skill pipeline (OCR, NER, embeddings) regardless of document type inflates the cost of the attached AI Services resource. Documents already in clean text format that don't need OCR or entity extraction still consume AI Services calls if the skill pipeline is applied uniformly.

  • Adding too many partitions without checking actual index size. Each partition doubles storage capacity and the SU count. Teams sometimes add a partition when approaching a perceived storage limit rather than profiling actual index size or applying vector quantisation to reduce storage footprint.

What Could Make Your Bill Go Up or Down Next Month

Could go UP:

  • A replica is added to improve query throughput for a production workload — at S1 this adds $245/month per replica.

  • The document corpus grows significantly, requiring an additional partition to accommodate index storage — doubles the SU count at the current tier.

  • Semantic ranker is enabled for all queries rather than selectively, generating $1/1,000 charges on high-volume traffic beyond the 1,000/month free allocation.

  • Agentic retrieval is adopted in a new multi-turn agent pipeline and token consumption scales beyond the 50M/month free tier.

  • The tier is upgraded from S1 ($245/SU) to S2 ($981/SU) to accommodate a growing vector index — a 4× increase in the per-SU rate.

  • A development or staging search service that was supposed to be temporary is left running through an entire sprint or quarter.

  • Image extraction is enabled in the indexer for a new document type, adding image extraction charges on top of the base SU cost.

Could go DOWN:

  • A development or staging search service is deleted and replaced with a Serverless tier service, eliminating always-on compute cost.

  • Replica count is reduced from 3 to 2 (or 2 to 1) after profiling shows actual query throughput requirements are lower than provisioned.

  • Semantic ranker is scoped to only user-facing search endpoints, removing it from internal tooling queries.

  • Vector index storage is optimised (scalar quantisation, dimension reduction) to defer the need for an additional partition.

  • Agentic retrieval complexity tier is reduced (medium → min/low) for query patterns that don't require deep multi-turn reasoning.

  • The service tier is re-evaluated and downgraded after a workload is cancelled or moved.


Most Common Optimisation Techniques

Technique

Mechanism

Typical saving

Use Serverless tier for dev/test workloads

Scales to zero when idle; no always-on compute cost; suited to infrequent or variable traffic

Eliminates the fixed ~$245–$981+/month dedicated tier cost for non-production workloads

Delete dedicated dev/test services when not in active use

No pause capability on dedicated tiers; delete and recreate; export index schema for quick recreation

Eliminates 100% of dev service cost outside active development windows

Right-size tier to actual index and throughput requirements

Profile index size in GB and peak queries/second; start at Basic or S1 and scale up only when needed

Avoids 4× cost difference between S1 ($245) and S2 ($981) per SU

Reduce replica count to match throughput needs

Each replica removed cuts SU count proportionally; 1 replica sufficient for internal/low-volume workloads

$245–$1,962/month per replica removed depending on tier

Scope semantic ranker to user-facing queries only

Apply semantic ranker conditionally in the client SDK; skip for internal tooling or batch queries

At high volume: $1/1,000 requests adds up; 1M queries/month = $1,000 in ranker charges

Monitor Agentic Retrieval token consumption

Track token usage against the 50M/month free allocation; review complexity tier selection

Prevents unexpected token overage charges as agentic pipelines scale

Optimise vector index storage

Apply scalar or binary quantisation; reduce embedding dimensions where quality permits

Delays or avoids the need for additional partitions, saving the full SU cost of each avoided partition

Use AI enrichment selectively in the skill pipeline

Apply OCR only to image/PDF documents; apply NER only where entity extraction is used downstream

Reduces AI Services calls billed against the linked Cognitive Services resource