Azure Analytics and AI Services for Architects: Synapse, Fabric, Databricks, Azure AI Foundry, OpenAI and Cognitive Services

Microsoft Azure Architect Technologies AZ 300 55 min min read Updated: Nov 17, 2026 Intermediate
Azure Analytics and AI Services for Architects: Synapse, Fabric, Databricks, Azure AI Foundry, OpenAI and Cognitive Services
Intermediate Topic 3 of 3

Analytics Choices Recap

NeedService
SQL warehouse and BISynapse dedicated SQL or Fabric Warehouse
All-in-one SaaS analyticsMicrosoft Fabric (OneLake, lakehouse, pipelines, Power BI)
Spark data engineering and MLAzure Databricks or Fabric/Synapse Spark
Real-time analyticsEvent Hubs + Stream Analytics or Fabric Real-Time Intelligence / Data Explorer
Ad-hoc SQL on lake filesSynapse serverless SQL or Fabric SQL endpoint

AI Services Map

ServiceWhat it does
Azure AI FoundryPlatform to build, evaluate and deploy AI apps and agents with models
Azure OpenAIOpenAI models (GPT family, embeddings, image models) with Azure security, regional deployment and content filters
Azure AI SearchSearch service with keyword, vector and hybrid search. Core of RAG
Azure AI servicesPrebuilt APIs: Vision, Speech, Language, Translator, Document Intelligence
Azure Machine LearningTrain, track, deploy and monitor custom ML models with MLOps
Azure AI Content SafetyDetect harmful content
Names change Azure AI branding changes often (for example Cognitive Services became Azure AI services). Check current names when you read exam objectives.

RAG Architecture

Retrieval-augmented generation (RAG) lets a model answer using your own data instead of guessing.

  1. Ingest: documents in Blob Storage are split into chunks
  2. Embed: an embedding model turns chunks into vectors
  3. Index: store text and vectors in Azure AI Search
  4. Retrieve: for a user question, search for the best chunks (hybrid search)
  5. Generate: send question and chunks to the Azure OpenAI chat model to write the answer with citations
  6. Secure: Entra ID auth, managed identity between services, private endpoints, per-user document filters
python from openai import AzureOpenAI from azure.identity import DefaultAzureCredential, get_bearer_token_provider token = get_bearer_token_provider(DefaultAzureCredential(), "https://cognitiveservices.azure.com/.default") client = AzureOpenAI(azure_endpoint="https://oai-shop-482.openai.azure.com", azure_ad_token_provider=token, api_version="2024-10-21") reply = client.chat.completions.create(model="gpt-4o-mini", # your deployment name messages=[{"role": "system", "content": "Answer only from the context."}, {"role": "user", "content": "Context: Returns accepted within 30 days.\nQuestion: What is the return window?"}]) print(reply.choices[0].message.content)

API versions and model names change. Check the current Azure OpenAI documentation before using this sample.

Architect's Checklist for AI Workloads

  • Data privacy: your prompts and data are not used to train the base models in Azure OpenAI (confirm in current terms)
  • Networking: private endpoints and disabled public access
  • Capacity: token-based quotas and provisioned throughput for steady loads. Plan for 429 retries
  • Cost: model choice, caching and token limits
  • Safety: content filters, grounding and human review for risky actions
  • Governance: monitor with Azure Monitor and keep evaluation datasets

Choosing Quickly

ScenarioChoice
Read invoices and extract fieldsDocument Intelligence
Transcribe callsSpeech service
Chatbot over company documentsAzure OpenAI + AI Search (RAG)
Custom forecasting model with MLOpsAzure Machine Learning
Company-wide lakehouse and dashboardsFabric
Large Spark ETL with notebooksDatabricks

Practice

  1. Sketch a RAG flow for HR policy documents
  2. List three security controls for an Azure OpenAI deployment
  3. Pick a service for five AI scenarios from the table

Conclusion

Use Fabric, Synapse or Databricks for analytics, Azure Machine Learning for custom models and AI Foundry, Azure OpenAI and AI Search for generative AI with RAG. Secure them with private networking, managed identities and content safety.

Quick Summary: analytics recap; AI map; RAG; checklist; choosing.

Get Newsletter

Subscibe to our newsletter and we will notify you about the newest updates on Edugators