ML Software Engineer Jobs
ML Software Engineer jobs are open across technology, finance, healthcare, and autonomous systems, from new-grad to principal and staff levels, with specializations in NLP, computer vision, and MLOps. Find a role that fits from the openings below and apply directly.
Find ML Software Engineer JobsOverview
Showing 5 of 4,269+ ML Software Engineer jobs
INTRODUCTION
The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical leadership role responsible for defining, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set architecture and engineering direction for production-grade agentic AI platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI applications used in large-scale, business-critical environments.
This role requires a proven engineer who can translate ambiguous product and platform goals into durable technical strategy, lead multi-team execution without direct authority, and remain deeply hands-on in design, code, reviews, operations, and incident follow-up. The ideal candidate combines deep distributed systems experience with practical AI-native engineering, including orchestration of LLMs, tools, APIs, memory, retrieval, evaluation, guardrails, and cloud services. The expectation is to ship, scale, and operate reliable, secure, observable, and cost-aware AI platform systems while raising the technical bar for engineers across the organization.
Responsibilities
- Serve as a senior technical owner for OCI AI platform capabilities, including agent execution, inference systems, model serving, AI workflow orchestration, evaluation, and observability.
- Design, architect, and deliver scalable agentic AI systems capable of reasoning, planning, tool use, workflow execution, multi-step task orchestration, and safe human-in-the-loop escalation.
- Build production-grade services for tool calling, agent memory, context management, Model Context Protocol (MCP) integration, vector retrieval, multi-agent coordination, policy enforcement, and evaluation.
- Lead architecture across distributed services optimized for low latency, high throughput, GPU efficiency, reliability, cost, operability, and secure multi-tenant operation.
- Define service boundaries, APIs, data models, state management, consistency tradeoffs, failure modes, SLIs/SLOs, rollout strategies, and operational readiness criteria for AI platform services.
- Drive technical strategy across infrastructure, platform, security, data, and application engineering teams, converting broad goals into executable multi-quarter plans and measurable milestones.
- Integrate AI agents securely and reliably with enterprise APIs, cloud services, databases, identity systems, secrets management, and external systems.
- Establish AgentOps and LLMOps practices for tracing, monitoring, eval suites, regression testing, experimentation, safety guardrails, prompt/tool versioning, and production reliability.
- Evaluate and operationalize emerging technologies in generative AI, agentic workflows, inference optimization, long-context systems, reasoning models, AI developer tooling, and agentic-first development.
- Drive engineering excellence through code reviews, design reviews, test strategy, deployment automation, incident analysis, documentation, and AI-assisted development practices using tools such as Codex, Claude Code, Cursor, Copilot, or similar systems.
- Mentor Staff and senior engineers, raise architectural standards, and influence engineering practices across OCI without requiring direct management authority.
- Own critical production outcomes, including reliability, performance, security posture, cost efficiency, and supportability for the systems delivered.
REQUIRED QUALIFICATIONS
- Bachelor's, Master's, or Ph.D. in Computer Science, AI/ML, Engineering, or a related field, or equivalent practical experience.
- 12+ years of professional software engineering experience, including significant ownership of production systems; or equivalent experience demonstrating Senior Staff / Principal-level impact.
- Proven track record as a Staff, Senior Staff, Principal, or equivalent technical leader influencing architecture and execution across multiple teams.
- Deep experience designing, building, and operating high-scale distributed systems, cloud services, infrastructure platforms, or AI/ML platform services.
- Hands-on experience with production AI systems, agentic AI applications, autonomous workflows, tool-using agents, multi-step orchestration, or multi-agent systems.
- Practical experience with orchestration frameworks such as LangGraph, LangChain, CrewAI, AutoGen, LlamaIndex, or similar ecosystems.
- Deep understanding of LLM application patterns, including prompt design, structured outputs, function/tool calling, context management, RAG, memory, tool safety, and evaluation.
- Strong programming skills in Python and ability to contribute high-quality production code, reviews, tests, and debugging in complex distributed environments.
- Strong expertise with Kubernetes, Docker, cloud-native infrastructure, service-to-service communication, scalability, fault tolerance, observability, and performance analysis.
- Experience defining SLIs/SLOs, production readiness criteria, incident response practices, monitoring, tracing, experiments, and reliability programs for AI or distributed systems.
- Strong understanding of AI safety, governance, security, and operational risks for autonomous or semi-autonomous systems, including data handling, access control, auditability, and human accountability.
- Excellent written and verbal communication, with demonstrated ability to lead technical direction, resolve ambiguity, and influence senior stakeholders.
PREFERRED QUALIFICATIONS
- Experience optimizing large-scale GPU inference or training workloads for latency, throughput, utilization, availability, and cost.
- Experience building or operating model serving, inference gateways, agent runtimes, workflow engines, developer platforms, or internal AI productivity platforms.
- Experience integrating AI systems with enterprise APIs, databases, cloud services, vector databases, embeddings, retrieval systems, identity systems, and policy enforcement layers.
- Experience with LLM fine-tuning, long-context systems, reasoning models, model routing, caching, batching, quantization, or emerging generative AI research.
- Experience building evaluation frameworks for agentic systems, including offline evals, online experiments, golden tasks, adversarial testing, regression gates, and observability dashboards.
- Experience using AI-assisted software development tools such as Codex, Claude Code, Cursor, Copilot, or similar systems in large-scale engineering environments.
- Track record of defining architectural standards, platform capabilities, or engineering practices adopted across multiple teams or organizations.
- Experience in enterprise, cloud infrastructure, regulated, security-sensitive, or mission-critical environments.
INTRODUCTION
The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical leadership role responsible for defining, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will set architecture and engineering direction for production-grade agentic AI platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI applications used in large-scale, business-critical environments.
This role requires a proven engineer who can translate ambiguous product and platform goals into durable technical strategy, lead multi-team execution without direct authority, and remain deeply hands-on in design, code, reviews, operations, and incident follow-up. The ideal candidate combines deep distributed systems experience with practical AI-native engineering, including orchestration of LLMs, tools, APIs, memory, retrieval, evaluation, guardrails, and cloud services. The expectation is to ship, scale, and operate reliable, secure, observable, and cost-aware AI platform systems while raising the technical bar for engineers across the organization.
Responsibilities
- Serve as a senior technical owner for OCI AI platform capabilities, including agent execution, inference systems, model serving, AI workflow orchestration, evaluation, and observability.
- Design, architect, and deliver scalable agentic AI systems capable of reasoning, planning, tool use, workflow execution, multi-step task orchestration, and safe human-in-the-loop escalation.
- Build production-grade services for tool calling, agent memory, context management, Model Context Protocol (MCP) integration, vector retrieval, multi-agent coordination, policy enforcement, and evaluation.
- Lead architecture across distributed services optimized for low latency, high throughput, GPU efficiency, reliability, cost, operability, and secure multi-tenant operation.
- Define service boundaries, APIs, data models, state management, consistency tradeoffs, failure modes, SLIs/SLOs, rollout strategies, and operational readiness criteria for AI platform services.
- Drive technical strategy across infrastructure, platform, security, data, and application engineering teams, converting broad goals into executable multi-quarter plans and measurable milestones.
- Integrate AI agents securely and reliably with enterprise APIs, cloud services, databases, identity systems, secrets management, and external systems.
- Establish AgentOps and LLMOps practices for tracing, monitoring, eval suites, regression testing, experimentation, safety guardrails, prompt/tool versioning, and production reliability.
- Evaluate and operationalize emerging technologies in generative AI, agentic workflows, inference optimization, long-context systems, reasoning models, AI developer tooling, and agentic-first development.
- Drive engineering excellence through code reviews, design reviews, test strategy, deployment automation, incident analysis, documentation, and AI-assisted development practices using tools such as Codex, Claude Code, Cursor, Copilot, or similar systems.
- Mentor Staff and senior engineers, raise architectural standards, and influence engineering practices across OCI without requiring direct management authority.
- Own critical production outcomes, including reliability, performance, security posture, cost efficiency, and supportability for the systems delivered.
REQUIRED QUALIFICATIONS
- Bachelor's, Master's, or Ph.D. in Computer Science, AI/ML, Engineering, or a related field, or equivalent practical experience.
- 12+ years of professional software engineering experience, including significant ownership of production systems; or equivalent experience demonstrating Senior Staff / Principal-level impact.
- Proven track record as a Staff, Senior Staff, Principal, or equivalent technical leader influencing architecture and execution across multiple teams.
- Deep experience designing, building, and operating high-scale distributed systems, cloud services, infrastructure platforms, or AI/ML platform services.
- Hands-on experience with production AI systems, agentic AI applications, autonomous workflows, tool-using agents, multi-step orchestration, or multi-agent systems.
- Practical experience with orchestration frameworks such as LangGraph, LangChain, CrewAI, AutoGen, LlamaIndex, or similar ecosystems.
- Deep understanding of LLM application patterns, including prompt design, structured outputs, function/tool calling, context management, RAG, memory, tool safety, and evaluation.
- Strong programming skills in Python and ability to contribute high-quality production code, reviews, tests, and debugging in complex distributed environments.
- Strong expertise with Kubernetes, Docker, cloud-native infrastructure, service-to-service communication, scalability, fault tolerance, observability, and performance analysis.
- Experience defining SLIs/SLOs, production readiness criteria, incident response practices, monitoring, tracing, experiments, and reliability programs for AI or distributed systems.
- Strong understanding of AI safety, governance, security, and operational risks for autonomous or semi-autonomous systems, including data handling, access control, auditability, and human accountability.
- Excellent written and verbal communication, with demonstrated ability to lead technical direction, resolve ambiguity, and influence senior stakeholders.
PREFERRED QUALIFICATIONS
- Experience optimizing large-scale GPU inference or training workloads for latency, throughput, utilization, availability, and cost.
- Experience building or operating model serving, inference gateways, agent runtimes, workflow engines, developer platforms, or internal AI productivity platforms.
- Experience integrating AI systems with enterprise APIs, databases, cloud services, vector databases, embeddings, retrieval systems, identity systems, and policy enforcement layers.
- Experience with LLM fine-tuning, long-context systems, reasoning models, model routing, caching, batching, quantization, or emerging generative AI research.
- Experience building evaluation frameworks for agentic systems, including offline evals, online experiments, golden tasks, adversarial testing, regression gates, and observability dashboards.
- Experience using AI-assisted software development tools such as Codex, Claude Code, Cursor, Copilot, or similar systems in large-scale engineering environments.
- Track record of defining architectural standards, platform capabilities, or engineering practices adopted across multiple teams or organizations.
- Experience in enterprise, cloud infrastructure, regulated, security-sensitive, or mission-critical environments.
See All 4,269+ ML Software Engineer Jobs
Jump back to the full list of openings and apply to any ML software engineer role that fits.
Find ML Software Engineer JobsML Software Engineer Job Market
A snapshot from current openings nationwide, updated as new roles post.
Who's Hiring
- Apple352
- Amazon211
- Capital One145
- TikTok97
- Google94
Top Industries Hiring
- Technology & Software1,633
- Electronics & Hardware478
- Banking & Financial Services303
- Consulting & Professional Services298
- Artificial Intelligence232
What Employers Look For
The qualifications that appear most often in ML software engineer jobs.
- Proficiency in Python and at least one major ML framework such as PyTorch or TensorFlow
- Experience designing, training, and deploying machine learning models in production environments
- Familiarity with MLOps practices including experiment tracking, model versioning, and CI/CD pipelines
- Strong foundations in statistics, probability, and linear algebra relevant to model development
- Bachelor's or master's degree in computer science, electrical engineering, or a related quantitative field
- Experience with cloud platforms such as AWS, Google Cloud, or Azure for scalable model serving
Tips for Your ML Software Engineer Job Search
Quantify model impact on your resume
Hiring managers want to see what your models actually did. Replace vague descriptions with outcomes: latency reductions, accuracy gains, or throughput improvements. Concrete metrics on your resume make it past automated screens and give interviewers something specific to dig into.
Tailor your GitHub to the stack
Before applying, check which frameworks the job listing emphasizes, whether PyTorch, TensorFlow, or JAX, and make sure your pinned repositories reflect that stack. A portfolio aligned to the team's toolchain signals you can contribute from day one.
Apply early to roles that fit
Migrate Mate lists ml software engineer openings from across the United States in one place, so you can find roles that match and apply directly to each listing.
Distinguish research from production experience
Many ML engineer job listings separate model-building skills from deployment and serving experience. If you've shipped models to production, call that out explicitly in a dedicated bullet rather than burying it under a research project description.
Prepare a system design answer for ML pipelines
Most ML software engineer loops include at least one ML system design round covering feature stores, training pipelines, or online inference. Walk through data flow, latency requirements, and failure modes out loud so interviewers can see your architectural thinking, not just your coding ability.
Negotiate scope before accepting an offer
Once you have an offer, ask whether the role owns model deployment or hands off to a platform team. That distinction affects your day-to-day work significantly. Clarifying scope before you accept helps you evaluate fit beyond the title and compensation package.
ML Software Engineer Jobs: Frequently Asked Questions
Which companies are hiring the most ml software engineers?
The companies hiring the most ml software engineers right now include Apple, Amazon, and Capital One, with the largest share of openings in California, New York, and Washington, based on current listings on Migrate Mate as of June 2026. Demand is concentrated at technology companies, financial institutions, and healthcare platforms scaling their AI infrastructure.
How many ml software engineer jobs are remote?
About 28% of ml software engineer openings are fully remote or hybrid as of June 2026, making it one of the more flexible engineering disciplines. Roles focused on NLP research, MLOps tooling, and model evaluation tend to have the highest share of remote options, while positions tied to robotics or on-device inference typically require on-site presence.
How do you become a ml software engineer?
Start by building a foundation in Python, linear algebra, and statistics, then work through core ML concepts using hands-on projects rather than coursework alone. Develop production-facing skills in model deployment, monitoring, and pipeline orchestration, since most roles expect more than research ability. A portfolio of shipped projects, even personal ones, carries significant weight with hiring teams.
Can you get hired as a ml software engineer with little or no experience?
You can break in without industry experience by building a focused portfolio that demonstrates end-to-end work: a model trained on real data, deployed to an endpoint, and monitored over time. Contributing to open-source ML projects, publishing reproducible experiments, and targeting companies with structured early-career programs all improve your chances without requiring years of prior employment.
What does the ml software engineer interview process look like?
Most loops include a recruiter screen, a take-home or live coding round covering data manipulation and model implementation, an ML system design session where you architect a pipeline end-to-end, and a behavioral round. Some companies add a research presentation or a debugging exercise on a broken training run. Loops typically run over one to three weeks.
Where can I find and apply to ml software engineer jobs?
You can find and apply to ml software engineer jobs on Migrate Mate, which lists current openings from companies across the United States. Search the listings to find roles that match your experience and specialization, then apply directly to each one that fits.
See All 4,269+ ML Software Engineer Jobs
Jump back to the full list of openings and apply to any ML software engineer role that fits.
Find ML Software Engineer Jobs