Senior AI Software Engineer Jobs
Senior AI Software Engineer jobs are open across technology, finance, healthcare, and defense, from mid-level to staff and principal, with specializations in large language models, computer vision, and MLOps. Find a role that fits from the openings below and apply directly.
Find JobsLooking for remote work? View remote senior AI software engineer jobs →Overview
Showing 5 of 1,407+ Senior AI Software Engineer jobs
The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We build state-of-the-art AI compilers and design new AI programming abstractions for Microsoft’s next-generation supercomputers and the Maia-200 AI accelerator. Our interdisciplinary team operates at the intersection of compiler engineering, programming language design, algorithmic innovation, AI, and high-performance computing. Our culture is highly collaborative and we regularly partner with hardware architects, platform engineers, researchers, and other groups across Microsoft. We also participate in the open-source community. We are seeking Software Engineers II and/or Senior Software Engineer - AI Compilers to join our AI Compiler team. This is a unique opportunity to join a dynamic team, working on cutting-edge technology that has a direct impact on every Microsoft business.
Responsibilities
As a member of the AI Compilers team you will have the opportunity to work on the following:
- Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton.
- Develop code generation techniques for new hardware platforms.
- Design and develop cutting edge AI software in C++ and Python.
- Optimize AI workloads.
- Design new programming abstractions for AI.
- Collaborate broadly across multiple disciplines from hardware architects to ML developers.
- Identify requirements, plan and design solutions, estimate effort, and schedule deliverables.
- Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture.
- Embody Microsoft's culture and values
Qualifications
Required Qualifications
Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
Other Requirements
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
Or PhD in Computer Science or related technical field AND 4+ years technical software engineering experience
3+ years experience programming in C/C++.1+ years experience with optimized systems‑level programming.
Experience building compilers, using compiler frameworks like LLVM/MLIR, OR experience optimizing AI/numerical workloads, OR experience in numerical high-performance computing.
Experience with AI frameworks, AI inference systems, AI kernel development, and AI workload optimization.
Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process.
The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We build state-of-the-art AI compilers and design new AI programming abstractions for Microsoft’s next-generation supercomputers and the Maia-200 AI accelerator. Our interdisciplinary team operates at the intersection of compiler engineering, programming language design, algorithmic innovation, AI, and high-performance computing. Our culture is highly collaborative and we regularly partner with hardware architects, platform engineers, researchers, and other groups across Microsoft. We also participate in the open-source community. We are seeking Software Engineers II and/or Senior Software Engineer - AI Compilers to join our AI Compiler team. This is a unique opportunity to join a dynamic team, working on cutting-edge technology that has a direct impact on every Microsoft business.
Responsibilities
As a member of the AI Compilers team you will have the opportunity to work on the following:
- Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton.
- Develop code generation techniques for new hardware platforms.
- Design and develop cutting edge AI software in C++ and Python.
- Optimize AI workloads.
- Design new programming abstractions for AI.
- Collaborate broadly across multiple disciplines from hardware architects to ML developers.
- Identify requirements, plan and design solutions, estimate effort, and schedule deliverables.
- Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture.
- Embody Microsoft's culture and values
Qualifications
Required Qualifications
Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
Other Requirements
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications
Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
Or PhD in Computer Science or related technical field AND 4+ years technical software engineering experience
3+ years experience programming in C/C++.1+ years experience with optimized systems‑level programming.
Experience building compilers, using compiler frameworks like LLVM/MLIR, OR experience optimizing AI/numerical workloads, OR experience in numerical high-performance computing.
Experience with AI frameworks, AI inference systems, AI kernel development, and AI workload optimization.
Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process.
Senior AI Software Engineer Jobs by Experience Level
Top Cities Hiring Senior AI Software Engineers
Explore senior AI software engineer openings in the cities hiring most right now.
See All 1,407+ Senior AI Software Engineer Jobs
Find roles that match your experience and apply in just a few clicks.
Find JobsSenior AI Software Engineer Job Market
Who's Hiring
- CVS Health83
- JPMorganChase75
- Google65
- Amazon41
- Advanced Monitored Caregiving34A
Top Industries Hiring
- Technology & Software170
- Healthcare & Medical Services75
- Electronics & Hardware42
- Artificial Intelligence31
- Banking & Financial Services31
What Employers Look For
The qualifications that appear most often in senior AI software engineer jobs.
- Advanced degree or equivalent experience in computer science, machine learning, or a related field
- Production experience designing, training, and deploying large-scale machine learning models
- Proficiency in Python and at least one deep learning framework such as PyTorch or TensorFlow
- Hands-on experience with cloud ML platforms including AWS SageMaker, Google Vertex AI, or Azure ML
- Demonstrated ability to lead technical projects and mentor junior engineers across the AI stack
- Familiarity with MLOps tooling, model monitoring, and CI/CD pipelines for ML systems
Tips for Your Senior AI Software Engineer Job Search
Quantify model performance on your resume
Hiring managers for senior AI roles scan for concrete outcomes, not just tools. Replace vague claims with metrics like latency improvements, accuracy gains, or cost reductions your models delivered in production. Generic AI buzzwords without numbers get filtered out fast.
Match your stack to the job description
Senior AI roles split sharply between PyTorch and TensorFlow shops, between cloud-native MLOps and on-prem deployments. Read each posting carefully and mirror its exact tooling language in your resume so automated screening systems surface your application correctly.
Apply early to roles that fit
Migrate Mate lists senior ai software engineer openings from across the United States in one place, so you can find roles that match and apply directly to each listing.
Target postings by model deployment environment
Filter openings by whether they describe edge deployment, cloud inference, or real-time serving pipelines. Your experience transfers differently across these environments, and applying to roles that match your actual deployment background lifts your interview conversion rate significantly.
Prepare a system design answer for AI infrastructure
Most senior AI interviews include a design round covering data pipelines, feature stores, or model serving at scale. Practice walking through trade-offs between batch and online inference, retraining cadence, and monitoring drift so you can answer confidently without over-rehearsing a script.
Negotiate scope before you negotiate compensation
Before discussing pay, confirm whether the role owns model research, deployment, or both, and who controls compute budgets. Scope mismatches at the senior level are a leading reason engineers leave within a year, so clarifying ownership early protects you from a poor fit.
Senior AI Software Engineer Jobs: Frequently Asked Questions
Which companies are hiring the most senior ai software engineers?
The companies hiring the most senior ai software engineers right now include CVS Health, JPMorganChase, and Google, with the largest share of openings in California, Texas, and Washington, based on current listings on Migrate Mate as of August 2026. Demand is concentrated in technology, financial services, and defense sectors, though healthcare and retail are adding senior AI roles steadily.
How many senior ai software engineer jobs are remote?
About 67% of senior ai software engineer openings are fully remote or hybrid as of August 2026, though the share varies by specialization. Roles focused on NLP, LLM fine-tuning, and recommendation systems tend to offer the most location flexibility, while positions involving proprietary hardware, on-prem infrastructure, or defense clearances are more likely to require on-site presence.
How do you become a senior ai software engineer?
You become a senior ai software engineer by building a foundation in machine learning fundamentals and software engineering, then deepening expertise in a specific domain such as NLP, computer vision, or reinforcement learning. Getting models into production is the key differentiator at the senior level, so focus on shipping end-to-end systems, owning post-deployment monitoring, and progressively taking on technical leadership within a team.
Can you get hired as a senior ai software engineer without prior senior-level experience?
You can move into a senior ai software engineer role without holding a previous senior title if you have demonstrable impact at scale. Employers look for engineers who have owned a model from research through production, led cross-functional delivery, or published work that shows independent technical judgment. A strong portfolio of shipped AI systems often carries more weight than a senior job title from a previous employer.
What does the senior ai software engineer interview process look like?
The senior ai software engineer interview process typically includes a recruiter screen, a technical phone interview covering ML fundamentals and coding, a machine learning system design round, and a full virtual or on-site loop. The loop usually combines coding exercises, a research or paper discussion, a system design session focused on AI infrastructure, and behavioral interviews assessing technical leadership and cross-team collaboration. Final rounds often include a presentation of past work.
Where can I find and apply to senior ai software engineer jobs?
You can find and apply to senior ai software engineer jobs on Migrate Mate, which lists current openings from across the United States in one place. Search the available roles, find the ones that match your background and target specialization, and apply directly to each listing that fits.
See All 1,407+ Senior AI Software Engineer Jobs
Find roles that match your experience and apply in just a few clicks.
Find Jobs