Senior AI Software Engineer Jobs in San Jose, CA
Senior AI Software Engineer jobs in San Jose are in high demand, concentrated in North San Jose's tech corridor, Downtown, and the Santana Row area, with strong hiring across semiconductor design, enterprise software, and cloud infrastructure. Employers hiring right now include TikTok, Google, and AMD. Find a role that fits below and apply directly.
Find JobsOverview
Showing 5 of 17+ Senior AI Software Engineer jobs
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 7 years of experience leading technical project strategy, ML design, and end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging).
- 5 years of experience with design and architecture; and testing/launching software products.
- 5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
- Experience designing software architecture for applications, including AI/ML systems.
Preferred qualifications:
- Experience designing and building distributed systems.
- Experience programming in C++, Java, Protocol Buffers, and SQL data pipelines.
- Experience designing and operating distributed data telemetry systems, streaming or batch ingestion pipelines, or observability infrastructure.
- Experience translating difficult technical challenges into production architectures with measurable reliability and adoption.
- Experience with AI or Large Language Model agent architectures, agent trajectory logging, and evaluation pipelines.
- Experience designing privacy-preserving analytics systems and high-performance analytical serving layers.
About the job
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.US: $262000 - $364000 (USD) + 25% bonus target + equity + benefits
Learn more about benefits at Google.
Responsibilities
- Architect canonical, evolution-safe telemetry agreements and schemas building on integration event protos, trajectory schemas, and AI-assisted instrumentation across developer and DevAI surfaces so new agentic tools emit structured, high-signal telemetry by default.
- Design and build low-latency ingestion, deterministic sampling, Personally Identifiable Information (PII) redaction, and LLM-powered trajectory classification pipelines.
- Build core attribution engines linking multi-turn agent trajectories, tool calls, skill invocations, token spend, and downstream artifacts including Piper CLs, Critique reviews, Tracker issues, and test runs to power Levels of Autonomy and end-to-end Critical User Journeys.
- Establish engineering standards across the data and serving stack to eliminate pipeline fragility and enforce data freshness and completeness SLOs.
- Partner with Engineering Directors, Principal Engineers, Data Scientists, and sibling DevAI/CodeAI platform leads to unblock cross-organization instrumentation bottlenecks, review critical CLs and RFCs, and mentor engineers through example.
Minimum qualifications:
- Bachelor’s degree or equivalent practical experience.
- 8 years of experience in software development.
- 7 years of experience leading technical project strategy, ML design, and end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging).
- 5 years of experience with design and architecture; and testing/launching software products.
- 5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.
- Experience designing software architecture for applications, including AI/ML systems.
Preferred qualifications:
- Experience designing and building distributed systems.
- Experience programming in C++, Java, Protocol Buffers, and SQL data pipelines.
- Experience designing and operating distributed data telemetry systems, streaming or batch ingestion pipelines, or observability infrastructure.
- Experience translating difficult technical challenges into production architectures with measurable reliability and adoption.
- Experience with AI or Large Language Model agent architectures, agent trajectory logging, and evaluation pipelines.
- Experience designing privacy-preserving analytics systems and high-performance analytical serving layers.
About the job
Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.
The Core team builds the technical foundation behind Google’s flagship products. We are owners and advocates for the underlying design elements, developer platforms, product components, and infrastructure at Google. These are the essential building blocks for excellent, safe, and coherent experiences for our users and drive the pace of innovation for every developer. We look across Google’s products to build central solutions, break down technical barriers and strengthen existing systems. As the Core team, we have a mandate and a unique opportunity to impact important technical decisions across the company.
Individual pay is determined by factors including job-related skills, experience, and relevant education or training.US: $262000 - $364000 (USD) + 25% bonus target + equity + benefits
Learn more about benefits at Google.
Responsibilities
- Architect canonical, evolution-safe telemetry agreements and schemas building on integration event protos, trajectory schemas, and AI-assisted instrumentation across developer and DevAI surfaces so new agentic tools emit structured, high-signal telemetry by default.
- Design and build low-latency ingestion, deterministic sampling, Personally Identifiable Information (PII) redaction, and LLM-powered trajectory classification pipelines.
- Build core attribution engines linking multi-turn agent trajectories, tool calls, skill invocations, token spend, and downstream artifacts including Piper CLs, Critique reviews, Tracker issues, and test runs to power Levels of Autonomy and end-to-end Critical User Journeys.
- Establish engineering standards across the data and serving stack to eliminate pipeline fragility and enforce data freshness and completeness SLOs.
- Partner with Engineering Directors, Principal Engineers, Data Scientists, and sibling DevAI/CodeAI platform leads to unblock cross-organization instrumentation bottlenecks, review critical CLs and RFCs, and mentor engineers through example.
See All 17 Senior AI Software Engineer Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find JobsSenior AI Software Engineer Job Market in San Jose
Who's Hiring
Top Industries Hiring
- Technology & Software
Senior AI Software Engineer Jobs in San Jose: Frequently Asked Questions
How do I get a senior ai software engineer job in San Jose?
The strongest path into a senior ai software engineer role in San Jose runs through the city's dense concentration of semiconductor, cloud, and enterprise software companies. Candidates who can demonstrate production-scale AI system design, LLM integration, or ML infrastructure work stand out most. Targeting employers in North San Jose's tech corridor and engaging directly through company career portals gives you the clearest route to interviews.
Which companies hire senior ai software engineers in San Jose?
Employers hiring senior ai software engineers in San Jose right now include TikTok, Google, and AMD, based on current listings on Migrate Mate as of November 2026. San Jose's employer mix skews heavily toward established tech firms, semiconductor companies, and enterprise software providers, with a growing number of well-funded AI-focused startups operating out of the North San Jose and Downtown corridors.
Are there remote senior ai software engineer jobs in San Jose?
Yes, though fully remote roles are less common for senior positions that involve hardware integration or on-site infrastructure work. About 40% of senior ai software engineer openings tied to San Jose are remote or hybrid as of November 2026, reflecting the desk-heavy nature of model development and MLOps work. Roles focused on applied research, ML platform engineering, and AI product development tend to offer the most location flexibility in San Jose.
How can I get a senior ai software engineer job in San Jose with little or no experience?
The most realistic entry path is through mid-level machine learning engineer or AI software engineer roles at San Jose's larger tech employers, which often have structured leveling paths and internal transfer programs. Semiconductor and enterprise software companies in North San Jose regularly hire engineers from adjacent disciplines who can demonstrate strong Python, PyTorch, or data pipeline fundamentals. Contributing to open-source AI projects and targeting companies with known AI expansion initiatives gives early-career candidates a concrete edge in this market.
Which industries hire the most senior ai software engineers in San Jose?
San Jose senior ai software engineer roles concentrate in Technology & Software, based on current listings on Migrate Mate as of November 2026. San Jose's position as a global hub for semiconductor manufacturing and enterprise cloud infrastructure means these sectors consistently drive the highest volume of senior-level AI engineering demand in the city.
Related Jobs in California
See All 17 Senior AI Software Engineer Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find Jobs