Cloud AI Architect Jobs in New Jersey
Cloud AI Architect jobs in New Jersey are open across Princeton, Berkeley Heights, and Edison and other New Jersey metros, with employers like Boston Consulting, Coaction Specialty Insurance, and Delviom hiring at every experience level. Find a role that fits below and apply directly.
Find Cloud AI Architect JobsOverview
Showing 5 of 10+ Cloud AI Architect jobs
Job Description:
Technical skills:
- GenAI & Agentic Frameworks - Semantic Kernel/ LangGraph (or similar orchestration frameworks); LLM integration (Azure OpenAI, OpenAI APIs, etc.); Prompt engineering, prompt lifecycle design
- Retrieval & RAG - Azure AI Search (indexing, vector search, hybrid search); Embedding pipelines and retrieval optimization; RAG design, grounding strategies, context management
- Tool Access & Integration - MCP (Model Context Protocol) architecture and tool design; API design (FastAPI / REST / microservices); Integration with enterprise systems and third-party APIs
- AI Safety & Governance - NVIDIA NeMo Guardrails; Microsoft Presidio (PII detection/masking); Guardrails for prompt injection, hallucination control
- Evaluation & ModelOps - Azure AI Foundry (model hosting, versioning, monitoring); Evaluation frameworks (LLM-as-judge, test datasets); Prompt/version control, cost/latency monitoring
- DevOps & Observability - CI/CD pipelines (Azure DevOps / GitHub Actions); Logging, monitoring, observability (App Insights, etc.); Performance tuning and scalability
Responsibilities: Role & Responsibilities Overview:
-
Architecture & Technical Leadership
-
Define end-to-end architecture for agentic AI-enabled platform across data, AI, orchestration, and integration layers with some real hands-on experience doing POCs
- Design and govern agentic orchestration framework for multi-step production workflows
- Establish architecture patterns for - RAG and grounding, Vector search and retrieval, MCP tool access layer, prompt management and evaluation
- Have a deep understanding of Agentic coding and best practices of using Agentic coding for large scale implementations
-
Familiarity in implementing A2A or similar frameworks in a large scale environment
-
Platform & Integration Design
-
Define integration architecture across - Lakehouse, ODS, document systems, Underwriting systems and third-party APIs
- Design configurable, metadata-driven framework for multi-LOB onboarding
-
Define API/microservices patterns (Python/.NET hybrid)
-
AI & GenAI Enablement
-
Define where and how to use - GenAI vs deterministic logic, agentic workflows vs pipeline workflows
- Establish multimodal integration approach combining structured, unstructured, and external data
-
Design prompt lifecycle, evaluation, and optimization strategy
-
Governance, Safety & ModelOps
-
Define AI safety and guardrails (PII, hallucination control, policy constraints)
- Establish ModelOps and PromptOps frameworks
-
Ensure explainability, auditability, and traceability of AI outputs
-
Program Leadership
-
Lead technical execution across AI, data, and platform teams
- Guide engineers (AI, data, full-stack) and ensure alignment with architecture
- Drive technical decisions and stakeholder communication
Qualifications: Education:
Bachelor’s or Master’s in Computer Science, Engineering, Data Science, or related field
Job Description:
Technical skills:
- GenAI & Agentic Frameworks - Semantic Kernel/ LangGraph (or similar orchestration frameworks); LLM integration (Azure OpenAI, OpenAI APIs, etc.); Prompt engineering, prompt lifecycle design
- Retrieval & RAG - Azure AI Search (indexing, vector search, hybrid search); Embedding pipelines and retrieval optimization; RAG design, grounding strategies, context management
- Tool Access & Integration - MCP (Model Context Protocol) architecture and tool design; API design (FastAPI / REST / microservices); Integration with enterprise systems and third-party APIs
- AI Safety & Governance - NVIDIA NeMo Guardrails; Microsoft Presidio (PII detection/masking); Guardrails for prompt injection, hallucination control
- Evaluation & ModelOps - Azure AI Foundry (model hosting, versioning, monitoring); Evaluation frameworks (LLM-as-judge, test datasets); Prompt/version control, cost/latency monitoring
- DevOps & Observability - CI/CD pipelines (Azure DevOps / GitHub Actions); Logging, monitoring, observability (App Insights, etc.); Performance tuning and scalability
Responsibilities: Role & Responsibilities Overview:
-
Architecture & Technical Leadership
-
Define end-to-end architecture for agentic AI-enabled platform across data, AI, orchestration, and integration layers with some real hands-on experience doing POCs
- Design and govern agentic orchestration framework for multi-step production workflows
- Establish architecture patterns for - RAG and grounding, Vector search and retrieval, MCP tool access layer, prompt management and evaluation
- Have a deep understanding of Agentic coding and best practices of using Agentic coding for large scale implementations
-
Familiarity in implementing A2A or similar frameworks in a large scale environment
-
Platform & Integration Design
-
Define integration architecture across - Lakehouse, ODS, document systems, Underwriting systems and third-party APIs
- Design configurable, metadata-driven framework for multi-LOB onboarding
-
Define API/microservices patterns (Python/.NET hybrid)
-
AI & GenAI Enablement
-
Define where and how to use - GenAI vs deterministic logic, agentic workflows vs pipeline workflows
- Establish multimodal integration approach combining structured, unstructured, and external data
-
Design prompt lifecycle, evaluation, and optimization strategy
-
Governance, Safety & ModelOps
-
Define AI safety and guardrails (PII, hallucination control, policy constraints)
- Establish ModelOps and PromptOps frameworks
-
Ensure explainability, auditability, and traceability of AI outputs
-
Program Leadership
-
Lead technical execution across AI, data, and platform teams
- Guide engineers (AI, data, full-stack) and ensure alignment with architecture
- Drive technical decisions and stakeholder communication
Qualifications: Education:
Bachelor’s or Master’s in Computer Science, Engineering, Data Science, or related field
See All 10 Cloud AI Architect Jobs in New Jersey
Find roles in New Jersey that match your experience and apply in just a few clicks.
Find Cloud AI Architect JobsCloud AI Architect Jobs by City in New Jersey
Where New Jersey roles are concentrated, by current openings.
Cloud AI Architect Job Market in New Jersey
A snapshot from current New Jersey openings, updated as new roles post.
Who's Hiring
- Boston Consulting1
- Coaction Specialty Insurance1
- Delviom1
- EXL Service1
- FreshDirect1
Top Industries Hiring
- Technology & Software5
- Consulting & Professional Services3
- Insurance2
- Retail1
What New Jersey Employers Look For
The qualifications that appear most often in cloud AI architect jobs across New Jersey.
- Five or more years of hands-on experience designing production cloud infrastructure on AWS, Azure, or Google Cloud
- Demonstrated experience building and deploying machine learning or generative AI workloads at enterprise scale
- Proficiency with MLOps tooling such as Kubeflow, MLflow, Vertex AI Pipelines, or SageMaker Pipelines
- Strong programming skills in Python and familiarity with model serving frameworks like TensorFlow Serving, TorchServe, or Triton
- Experience with containerization and orchestration using Docker and Kubernetes in a cloud-native environment
- Bachelor's degree in computer science, engineering, or a related technical field, or equivalent professional experience
Cloud AI Architect Jobs in New Jersey: Frequently Asked Questions
How many cloud AI architect jobs are there in New Jersey?
There are 10+ cloud AI architect openings in New Jersey on Migrate Mate as of June 2026, with the most roles in Princeton, Berkeley Heights, and Edison. New positions post regularly as employers across New Jersey hire.
Which New Jersey cities have the most cloud AI architect jobs?
Princeton, Berkeley Heights, and Edison have the most cloud AI architect openings in New Jersey right now, with additional roles spread across smaller metros statewide.
Which companies hire cloud AI architects in New Jersey?
Employers hiring cloud AI architects in New Jersey include Boston Consulting, Coaction Specialty Insurance, and Delviom, based on current listings on Migrate Mate as of June 2026.
Are there remote cloud AI architect jobs in New Jersey?
Yes. About 10% of cloud AI architect openings tied to New Jersey are remote or hybrid as of June 2026. The rest are on-site roles based in New Jersey metros.
How do I apply for cloud AI architect jobs in New Jersey?
You can apply to cloud AI architect jobs in New Jersey directly on Migrate Mate. Search the listings above, find roles that match your experience and preferred New Jersey location, then apply to each one that fits.
See All 10 Cloud AI Architect Jobs in New Jersey
Find roles in New Jersey that match your experience and apply in just a few clicks.
Find Cloud AI Architect Jobs