AI Architect Jobs in San Jose, CA
AI Architect jobs in San Jose concentrate in North San Jose's tech corridor, the downtown innovation district, and along the Highway 101 employment corridor, with demand driven by enterprise software, semiconductors, and cloud infrastructure. Employers like AMD, TikTok, and WD are actively hiring across applied AI, MLOps, and large language model deployment. See the openings below and apply to the ones that match your experience.
Find AI Architect JobsOverview
Showing 5 of 146+ AI Architect jobs











About Cognizant Consulting
Cognizant Consulting is where curious minds come together to solve complex challenges and create meaningful impact. Blending industry insight, technology expertise, and the power of AI, we partner with leading organizations to transform the way they work, serve customers, and grow.
About the role
As a Principal Enterprise Architect — AI Specialty (Platforms & Services / Hi-Tech), you will make an impact by acting as the senior AI architecture authority for a portfolio of Platforms & Services and Hi-Tech accounts, defining how agentic and machine-learning capabilities are grounded in each client's data, governed responsibly, and standardized into reusable reference patterns so that AI becomes a dependable layer of the client's platform rather than a collection of disconnected pilots. You will be a valued member of the Enterprise Architecture team and work collaboratively with client executives, delivery, engineering, data, and product teams, and clients.
In this role, you will
- Set the enterprise-wide AI architecture vision and target-state roadmaps for each account, aligning every solution to the broader enterprise-architecture framework and advising leadership on emerging technologies and their business impact
- Architect complex, multi-layered AI systems — scalable, resilient, secure, and explainable — and design reference architectures for GenAI and autonomous/agentic frameworks grounded in enterprise context and orchestrated safely across SaaS and internal systems via APIs
- Standardize reusable building blocks (LLM onboarding, RAG pipelines, vector stores, agent/application patterns) and build hands-on proofs of concept and prototypes to validate feasibility, de-risk decisions, and win client confidence
- Establish and run architecture governance, standards, and responsible-AI practices — embedding data privacy and domain-specific compliance (e.g., PCI-DSS, SOX, IP sensitivity) and defining model-evaluation and benchmarking gates for production
- Provide technical leadership and mentorship to solution architects and engineering teams, lead conversations with client executives up to C-level as a trusted advisor, and support pre-sales, solutioning, and discovery/design workshops
Work model
At Cognizant, we strive to provide flexibility wherever possible. Based on this role's business requirements, this is a hybrid position requiring 3 days a week in a client or Cognizant office in San Jose, California. Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.
What you must have to be considered
- 12–15+ years in IT/enterprise architecture, including multiple years delivering architecture for large, complex programs at enterprise scale, with deep TOGAF practice and architecture review-board governance
- Proven track record architecting enterprise-grade AI solutions on cloud-native architectures (AWS, Azure, and/or GCP), with architectural experience across enterprise GenAI platforms, ML model deployment, RAG pipelines, and autonomous/agentic AI frameworks
- Substantial experience serving Platforms & Services and/or Hi-Tech clients (SaaS, fintech/payments, or semiconductor/capital-equipment) with deep domain depth in at least one and the range to ramp quickly on the others
- Hands-on enough to personally stand up quick proofs of concept and prototypes (Python, notebooks, agent/LLM SDKs, cloud services), with a track record of taking AI from PoC through to production at scale
- Client-facing / consulting experience including pre-sales, solutioning, and executive engagement, plus responsible-AI, data privacy, model governance, and domain-specific compliance expertise
These will help you succeed
- Real-time / low-latency decisioning and large-scale distributed systems (billions of transactions) for payments or risk platforms
- Data architecture — lakehouse strategies, information/data modeling, streaming (Kafka/Spark), and governance across domains
- Hands-on with AI frameworks and tooling — LangChain/LlamaIndex, vector databases, MLflow, PyTorch/TensorFlow, Hugging Face
- For Hi-Tech: familiarity with semiconductor design/manufacturing, EDA/CAD workflows, or yield/manufacturing analytics
- TOGAF certification strongly preferred and relevant cloud architecture certifications a plus; Bachelor's or higher in Computer Science, Engineering, Applied Science, or Mathematics, or equivalent practical experience
We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.
Salary and Other Compensation
Applications will be accepted until November 4, 2026.
- The annual salary for this position is between $165,000 - $194,000 depending on the experience and other qualifications of the successful candidate.
- This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.
Benefits
- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long-term/Short-term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan
See All 146+ AI Architect Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find AI Architect JobsAI Architect Job Market in San Jose
Who's Hiring
- AMD34

- TikTok22

- WD11

- Adobe11

- Cadence11

Top Industries Hiring
- Technology & Software
- Electronics & Hardware
AI Architect Jobs in San Jose: Frequently Asked Questions
How do I get a ai architect job in San Jose?
Focus your search on North San Jose's semiconductor and cloud infrastructure companies, downtown's enterprise software firms, and the corridor of AI-native startups clustered near Santana Row and the Caltrain stations. Candidates with hands-on experience in production ML systems, LLM integration, or edge AI stand out here. Building visibility through local tech meetups and Silicon Valley AI communities also gives you a concrete edge over remote applicants.
Which companies hire ai architects in San Jose?
Companies currently hiring ai architects in San Jose include AMD, TikTok, and WD, per current listings on Migrate Mate as of November 2026. The San Jose market skews toward established enterprise technology companies and hardware-adjacent AI firms, alongside a steady pipeline of well-funded AI startups headquartered in the city's innovation districts.
Are there remote ai architect jobs in San Jose?
Yes, though many ai architect roles require on-site collaboration during design and build phases, making fully remote positions less common than in purely analytical disciplines. About 61% of ai architect openings tied to San Jose are remote or hybrid as of November 2026, which reflects the city's hybrid-first culture among enterprise tech employers. Strategic planning and model evaluation work tends to be most remote-friendly in this market.
How can I get a ai architect job in San Jose with little or no experience?
The most realistic entry path in San Jose is moving laterally from a senior machine learning engineer or data platform role at one of the city's mid-size enterprise software companies, which regularly promote from within. Local employers also hire associate AI architects for internal tooling and AI governance projects. Completing a production-grade portfolio project, contributing to open-source LLM frameworks, and engaging with San Jose's active Silicon Valley AI meetup scene all accelerate that transition.
Which industries hire the most ai architects in San Jose?
Most ai architect openings in San Jose sit in Technology & Software and Electronics & Hardware, per current listings on Migrate Mate as of November 2026. San Jose's identity as the hardware and enterprise software capital of Silicon Valley means demand is especially concentrated in companies building AI into semiconductor design tools, cloud platforms, and large-scale business applications.
Related Jobs in California
See All 146+ AI Architect Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find AI Architect Jobs