A step-by-step guide to understanding, selecting, and deploying Azure AI patterns. From prerequisites to production - everything you need to get started.
This portal provides seven enterprise-grade architectural blueprints for deploying AI workloads on Microsoft Azure. Each pattern includes:
7 architectural blueprints with full BOM, costs, SLA, comparison tables, and one-click deployment spec generation.
View PatternsCAF-aligned landing zone design with hub-spoke networking, subnet planning, governance, and a decision tree.
View Landing ZoneEducation vertical with 3 IQ engines, AI Academic Advisor, Dropout Predictor, and Learning Planner.
View EducationBefore deploying any pattern, ensure you have the following set up:
Owner or Contributor + User Access Administrator on the subscriptionMicrosoft.CognitiveServices, Microsoft.Search, Microsoft.KeyVaultAZURE_CREDENTIALS - Service Principal JSON
{
"clientId": "<sp-app-id>",
"clientSecret": "<sp-secret>",
"subscriptionId": "<sub-id>",
"tenantId": "<tenant-id>"
}
az ad sp create-for-rbac --name "sp-ai-deploy" --role Contributor --scopes /subscriptions/<sub-id>
az --version to check, then az loginaz bicep install (or via VS Code extension)| Required | ms-azuretools.vscode-bicep | Bicep language |
| Required | ms-vscode.azure-account | Azure sign-in |
| Recommended | ms-azuretools.vscode-azureresourcegroups | Resource explorer |
| Recommended | GitHub.copilot | AI-assisted coding |
| Optional | hashicorp.terraform | Terraform support |
| Optional | ms-python.python | Python for ML patterns |
Use this decision guide to pick the right architectural pattern for your scenario:
| If You Need... | Choose | Why | Est. Cost |
|---|---|---|---|
| Shared AI for the whole org, lowest cost | Pattern 1 - Centralized Hub | Single OpenAI behind APIM; central governance | ~$3,723/mo |
| Team-level data isolation, autonomy | Pattern 2 - Decentralized Spoke | Separate subscriptions & VNets per team | ~$7,360/mo |
| Shared models + team-specific RAG | Pattern 3 - Hybrid Central-Spoke | Central AOAI via APIM + spoke ML endpoints | ~$5,685/mo |
| Full ML lifecycle: train → deploy → monitor | Pattern 4 - AI Factory / MLOps | Azure ML workspace with CI/CD pipelines | ~$6,120/mo |
| Fast PoC, hackathon, minimal infra | Pattern 5 - Serverless AI | Functions + Logic Apps; no VNet, pay-per-use | ~$890/mo |
| Regulated data (HIPAA, PCI), zero trust | Pattern 6 - Secure Private AI | Fully private VNet, Firewall Premium, HSM | ~$10,240/mo |
| Data-heavy: Databricks, Synapse, Fabric | Pattern 7 - Data-Centric Lakehouse | Medallion architecture + vector search | ~$8,350/mo |
Browse the 7 Patterns on the home page. Click any pattern card to see its overview, or click "View Full Details" to see the complete architecture diagram, BOM table, and service breakdown.
Each pattern detail page includes:
Click the Generate Deployment Spec button inside any pattern modal or detail page. This opens a form where you provide:
main)infra/patternN)The spec auto-fills pattern-specific defaults for folder path and resource group name.
The generator produces three downloadable artifacts:
Full deployment spec with BOM, RBAC, checklist, and file structure
GitHub Actions CI/CD pipeline with validate → deploy stages
One-click copy to paste the spec into a GitHub issue or PR
Using the generated file structure as a guide, create your Bicep modules:
infra/pattern1/
â"œâ"€â"€ main.bicep # Main orchestrator
â"œâ"€â"€ parameters.dev.bicepparam # Dev parameters
â"œâ"€â"€ parameters.prod.bicepparam # Prod parameters
â"œâ"€â"€ modules/
â", â"œâ"€â"€ openai.bicep # Azure OpenAI + model deployments
â", â"œâ"€â"€ search.bicep # Azure AI Search
â", â"œâ"€â"€ keyvault.bicep # Key Vault with RBAC
â", â"œâ"€â"€ monitoring.bicep # Log Analytics + App Insights
â", â"œâ"€â"€ storage.bicep # Storage Account(s)
â", â"œâ"€â"€ networking.bicep # VNet, subnets, NSGs, PEs
â", â""â"€â"€ rbac.bicep # Role assignments
â""â"€â"€ .github/workflows/
â""â"€â"€ deploy-pattern1.yml # CI/CD workflow
// Azure OpenAI with S0 SKU and private endpoint and Copilot will generate the resource definition.
Commit your Bicep files and the GitHub Actions workflow, then push to trigger the pipeline:
git add infra/ .github/
git commit -m "Add Pattern 1 infrastructure"
git push origin main
The workflow will: validate Bicep → run what-if → create resource group → deploy resources → verify deployment.
The Landing Zone Architecture page provides an enterprise foundation before deploying any AI pattern. Here's how to use it:
Review the Management Group structure - Root → Platform / Landing Zones / Sandbox. The AI & ML management group sits under Landing Zones with Prod and NonProd subscriptions. This enables AI-specific Azure Policies, quota isolation, and cost tracking.
Use the Hub-Spoke topology diagram and Subnet Design table to plan your VNet layout. The AI spoke VNet (10.10.0.0/16) needs subnets for: AI services, private endpoints, compute (AKS/Databricks), data, and management.
The interactive Decision Tree asks questions about security, team structure, and data needs to recommend the right pattern + landing zone type. Follow the flowchart to find your best match.
The 24-item deployment checklist covers Foundation, Networking, Security & Identity, and AI-specific readiness. Check off each item as you set up your landing zone - it's divided into 4 categories for easy tracking.
The Education Platform is a specialized AI vertical for higher education institutions. Here's how to navigate it:
Crawls LMS data (Canvas, Moodle, Blackboard), student interactions, assignment submissions, and engagement signals to build a behavioral profile per student.
Indexes institutional knowledge: course catalogs, policies, research publications, faculty expertise, and accreditation documents for RAG retrieval.
Aggregates analytics: GPA trends, course outcomes, graduation rates, retention metrics, and institutional benchmarks for data-driven decisions.
The deployment spec generator creates a complete infrastructure-as-code plan tailored to your chosen pattern. Here's a detailed walkthrough:
There are two ways to open it:
The generator will auto-detect which pattern you're viewing and pre-fill the pattern-specific defaults.
The form has two sections:
All fields have sensible defaults - you can generate a spec without filling in anything. Override only what you need:
| Field | Default | Description |
|---|---|---|
| GitHub Org / Username | my-org | Your GitHub organization or personal username |
| Repository Name | azure-ai-patternN | Just the repo name (not the full URL) |
| Branch | main | Target branch for the workflow trigger |
| Target Folder Path | infra/patternN | Where the Bicep files will live |
| Subscription ID | 00000000-... | Azure subscription GUID - replace with yours |
| Region | Canada Central | Azure region for deployment |
| Resource Group | rg-ai-<env>-<region>-001 | CAF-compliant name auto-generated |
| Environment | Production | Affects naming and parameter files |
The right side of the generator form shows exactly what you need before deploying:
AZURE_CREDENTIALS secretThese are specific to each pattern - Pattern 6 (Secure) will show HSM roles; Pattern 4 (MLOps) will show ML-specific roles.
Click "Generate Deployment Spec Sheet". The output follows a logical Microsoft CAF lifecycle across 6 phases and 15 sections:
<abbreviation>-<workload>-<env>-<region>-<instance> (CAF reference)tags.bicep module, and Azure Policy JSON (CAF reference)The spec ends with a CAF Alignment Summary table mapping each CAF pillar (Strategy, Plan, Ready, Adopt, Govern, Manage, Secure) to its corresponding sections.
The core of every pattern - provides GPT-4o, text-embedding-3-large, and other models.
Documentation →Vector + keyword hybrid search for RAG patterns. Indexes documents for retrieval.
Documentation →Gateway for centralized patterns (1, 3). Rate limiting, auth, caching, load balancing.
Documentation →Secure key, secret, and certificate storage. HSM for regulated patterns (6).
Documentation →End-to-end ML platform for training, deployment, MLOps. Pattern 3, 4, 7.
Documentation →TLS inspection, threat intel, application rules. Patterns 2, 3, 6.
Documentation →| Problem | Solution |
|---|---|
Azure OpenAI quota exceeded429 Too Many Requests |
|
| Private Endpoint DNS not resolving |
|
Bicep deployment failsDeploymentFailed |
|
| GitHub Actions workflow fails |
|
| GPU quota not available (Patterns 4, 6) |
|
| Mermaid diagrams not rendering |
|
tokens Ã- price_per_1k_tokens / 1000Run these commands in Azure CLI:
# Create Service Principal with Contributor role
az ad sp create-for-rbac \
--name "sp-ai-deploy" \
--role Contributor \
--scopes /subscriptions/<subscription-id> \
--json-auth
# Copy the JSON output and add it as a GitHub secret:
# Repo → Settings → Secrets → Actions → New: AZURE_CREDENTIALS
For additional RBAC roles (Cognitive Services Contributor, etc.), assign them separately: az role assignment create --assignee <sp-app-id> --role "Cognitive Services Contributor" --scope /subscriptions/<sub-id>