ML Software Engineer Jobs in Cupertino, CA
ML Software Engineer jobs in Cupertino concentrate in the Main Street corridor, the Vallco district, and along De Anza Boulevard, driven by consumer electronics, on-device AI, and cloud infrastructure. Employers hiring right now include Apple, Amazon Web Services, and Amazon, with strong demand for NLP, computer vision, and foundation model work. Scan the live roles below and apply to whichever ones fit.
Find ML Software Engineer JobsOverview
Showing 5 of 118+ ML Software Engineer jobs
DESCRIPTION
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.
Key job responsibilities
- Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference.
- Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism.
- Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets.
- Own features end-to-end: from design through implementation, testing, and integration into the broader software stack.
- Contribute to CI/CD pipelines that gate model and kernel changes on correctness and performance regressions.
- Mentor engineers, drive design reviews, and raise the engineering bar across the team.
BASIC QUALIFICATIONS
- Bachelor's degree in computer science or equivalent
- 7+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Strong proficiency in C/C++
- Strong Linux systems knowledge
- Experience developing compute kernels for GPUs, DSPs, or custom accelerators
- Proven track record of owning and delivering complex software features end-to-end
PREFERRED QUALIFICATIONS
- Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques
- Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
- Familiarity with speculative decoding, KV cache optimization, or other LLM serving optimizations
- Experience with hardware simulation environments and model validation workflows
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Cupertino - 193,300.00 - 261,500.00 USD annually
DESCRIPTION
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.
Key job responsibilities
- Develop and optimize compute kernels for a custom ML accelerator architecture, targeting production-level performance for large language model inference.
- Integrate custom accelerator backends into open-source ML serving frameworks (vLLM, PyTorch), including scheduler extensions, memory management, and model parallelism.
- Build and maintain test infrastructure for model correctness validation across CPU, GPU, simulator, and hardware targets.
- Own features end-to-end: from design through implementation, testing, and integration into the broader software stack.
- Contribute to CI/CD pipelines that gate model and kernel changes on correctness and performance regressions.
- Mentor engineers, drive design reviews, and raise the engineering bar across the team.
BASIC QUALIFICATIONS
- Bachelor's degree in computer science or equivalent
- 7+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Strong proficiency in C/C++
- Strong Linux systems knowledge
- Experience developing compute kernels for GPUs, DSPs, or custom accelerators
- Proven track record of owning and delivering complex software features end-to-end
PREFERRED QUALIFICATIONS
- Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques
- Knowledge of ML frameworks including JAX, PyTorch, vLLM, SGLang, Dynamo, TorchXLA, and TensorRT
- Familiarity with speculative decoding, KV cache optimization, or other LLM serving optimizations
- Experience with hardware simulation environments and model validation workflows
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Cupertino - 193,300.00 - 261,500.00 USD annually
See All 118+ ML Software Engineer Jobs in Cupertino
Find roles in Cupertino that match your experience and apply in just a few clicks.
Find ML Software Engineer JobsML Software Engineer Job Market in Cupertino
Who's Hiring
- Apple64
- Amazon Web Services43
- Amazon11
Top Industries Hiring
- Electronics & Hardware
ML Software Engineer Jobs in Cupertino: Frequently Asked Questions
How do I get a ml software engineer job in Cupertino?
Focus on employers in consumer electronics, silicon design, and on-device AI, which are the sectors that define Cupertino's local market. Roles here lean heavily toward deploying models at scale on hardware-constrained devices, so experience with model quantization, edge inference, or CoreML-style optimization gives candidates a concrete edge. Targeting the dense cluster of tech campuses along De Anza Boulevard and Stevens Creek Boulevard puts you in front of the highest volume of openings.
Which companies hire ml software engineers in Cupertino?
Companies currently hiring ml software engineers in Cupertino include Apple, Amazon Web Services, and Amazon, per current listings on Migrate Mate as of August 2026. Cupertino's employer base skews toward large consumer-technology firms and their direct partners, so hardware-adjacent AI teams and embedded ML groups are unusually common compared to other Bay Area cities.
Are there remote ml software engineer jobs in Cupertino?
Yes, though ml software engineer roles in Cupertino skew toward on-site work because much of the local demand involves proprietary hardware, silicon testing environments, and lab-based model validation. About 100% of ml software engineer openings tied to Cupertino are remote or hybrid as of August 2026, with the remote subset concentrated in MLOps, data pipeline, and applied research positions that don't require physical device access.
How can I get a ml software engineer job in Cupertino with little or no experience?
The most realistic entry path in Cupertino is through an internship or new-grad program at one of the large consumer-technology campuses, where rotational ML programs regularly hire candidates with strong fundamentals and project portfolios over extensive industry tenure. Roles like ML data annotator, ML quality specialist, or junior ML engineer on a platform team are common stepping stones locally. A portfolio demonstrating a full training-to-deployment pipeline, even on a personal project, meaningfully differentiates entry-level applicants in this market.
Which industries hire the most ml software engineers in Cupertino?
The sectors hiring the most ml software engineers in Cupertino are Electronics & Hardware, based on current listings on Migrate Mate as of August 2026. Cupertino's concentration of consumer hardware and silicon R&D creates sustained local demand for ML talent that sits closer to the device layer than is typical in other Bay Area tech hubs.
Related Jobs in California
See All 118+ ML Software Engineer Jobs in Cupertino
Find roles in Cupertino that match your experience and apply in just a few clicks.
Find ML Software Engineer Jobs