Mid Level ML Software Engineer Jobs
Mid level ml software engineer jobs go to engineers ready to own model pipelines end to end, make architecture decisions with limited oversight, and bring junior teammates up to speed. Openings cover remote, hybrid, and on-site settings across Technology & Software, Electronics & Hardware, and Artificial Intelligence, with Apple, Scale AI, and Adobe actively hiring at this level now.
Find JobsOverview
Showing 5 of 733+ Mid Level ML Software Engineer jobs
Imagine what you could do here. At Apple, great ideas have a way of becoming phenomenal products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish.
Do you love solving complex distributed systems challenges at massive scale? Are you passionate about Kubernetes scheduling, resource management, and building platforms that power the next generation of Machine Learning and Data workloads? Do you thrive in designing and operating highly reliable, large-scale job scheduling and orchestration systems that serve as the backbone of AI and Data infrastructure? If so, join the Apple Data Platform team to design and build a scalable batch and ML infrastructure platform used across Apple.
As part of Apple Data Platform, you will play a meaningful role in designing, developing, and deploying high-performance systems that power batch and ML workloads across Apple's global infrastructure spanning public clouds and Apple data centers. This enormous scale brings unique and complex challenges in resource scheduling, workload orchestration, and operational excellence that require extraordinarily creative problem-solving.
Description
Apple Batch is a fully managed platform within the Apple Data Platform that supports large-scale batch and ML workloads across Apple data centers and AWS/GCP. It orchestrates containerized workloads such as Spark, Ray, and LLM batch inference using YuniKorn/Kueue for advanced multi-cluster scheduling. The platform delivers org/team quota management, automatic node repair, end-to-end observability, strong security, and granular cost reporting.
As part of the Apple Batch team, you will have a meaningful role in designing, developing, and deploying high-performance systems that power large-scale batch processing and ML workloads daily. We are building critical infrastructure that provides scalable batch execution, intelligent Kubernetes-native job scheduling, multi-tenant resource management, and efficient workload orchestration for ML training, inference, and data processing workloads across multi-cloud and on-premises environments.
We are looking for a strong, enthusiastic engineer with deep expertise in Kubernetes scheduling and distributed systems. You will have significant individual responsibility and influence over critical platform services. You are someone with ideas and a real passion for building infrastructure that improves reliability, efficiency, and simplicity at Apple scale.
","responsibilities":"Design, build, and deploy highly reliable, large-scale distributed systems for batch processing and ML infrastructure across public clouds and Apple data centers using Go, Java, or Python
Architect and operate Kubernetes-native scheduling systems such as Kueue and YuniKorn, building custom operators and CRDs to manage complex ML and data workloads
Implement advanced scheduling strategies including gang scheduling, topology-aware routing, bin-packing, and fair-share queuing to maximize GPU efficiency and hardware utilization
Build and manage secure, multi-tenant Kubernetes environments with strict resource isolation, quota governance, and priority-based preemption
Drive end-to-end observability, monitoring, and incident response practices to ensure high availability and fault tolerance of production systems
Collaborate with ML researchers, data engineers, SRE, and product teams to integrate scheduling solutions into Apple's broader AI and data platform ecosystem
Contribute to platform adoption by guiding internal customers, gathering requirements, and delivering impactful platform capabilities
Preferred Qualifications
GPU scheduling, accelerator-aware placement, and optimization for large-scale AI/ML workloads
Experience with distributed data and ML frameworks such as Apache Spark, Ray, PyTorch, JAX, or Flink at scale
Experience contributing to open-source projects in Kubernetes scheduling, container technologies, or ML infrastructure ecosystems such as Apache YuniKorn, Kueue, or similar systems
Experience using GenAI technologies to improve developer productivity, streamline engineering processes, and accelerate team execution
Minimum Qualifications
5+ years of experience designing, developing, and operating highly available, large-scale distributed systems and data or ML infrastructure
Strong software engineering skills with deep programming expertise in Go, Java, or Python
Advanced knowledge of Kubernetes internals including custom controllers, scheduler architecture, resource quotas, and workload lifecycle management
Hands-on experience with Kubernetes-native batch scheduling frameworks such as Kueue or YuniKorn and advanced scheduling concepts like gang scheduling, bin-packing, and priority preemption
Experience with cloud-native infrastructure across multi-cloud environments including AWS, GCP, and on-premises systems
Strong commitment to operational excellence, system observability, and continuous improvement for mission-critical services
Pay & Benefits
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $171,600 and $302,200, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
See All 733+ Mid Level ML Software Engineer Jobs
Find roles that match your experience and apply in just a few clicks.
Find JobsMid Level ML Software Engineer Job Market
Who's Hiring
- Apple131
- Scale AI19

- Adobe18
- Zoox16
- Iterable14

Top Industries Hiring
- Technology & Software285
- Electronics & Hardware135
- Artificial Intelligence67
- Banking & Financial Services48
- Retail33
Mid Level ML Software Engineer Jobs: Frequently Asked Questions
How do I get a mid level ml software engineer job?
Position yourself around ownership, not just contribution. Highlight projects where you drove the modeling approach, debugged production issues independently, or improved a deployed system's performance with measurable results. Recruiters at this level want to see that you can take a problem from scoping through deployment without heavy supervision. Tailor your resume to show depth in at least one ML domain, whether that is computer vision, NLP, or recommendation systems.
Which companies hire mid level ml software engineers?
Companies hiring mid level ml software engineers right now include Apple, Scale AI, and Adobe, based on current listings on Migrate Mate as of July 2026. Hiring at this level comes from a wide range of employers, including technology-native companies scaling their ML infrastructure, enterprises modernizing data products, and well-funded startups building their first production ML systems.
Are there remote mid level ml software engineer jobs?
Yes, remote and hybrid options are common at this level. About 30% of mid level ml software engineer openings are remote or hybrid as of July 2026, reflecting how broadly distributed ML teams have become. Engineers with strong asynchronous communication habits and experience working across time zones tend to be the most competitive for fully remote positions.
How do I move up to a mid level ml software engineer role?
The path from entry level to mid level is built on demonstrated ownership and technical depth. Focus on taking full responsibility for discrete ML features or models, not just completing assigned tasks. Seek out projects where you make design decisions, handle unexpected model behavior in production, and explain tradeoffs to non-technical stakeholders. Consistent, measurable impact across multiple shipped projects is what signals readiness for mid level responsibility.
Which industries hire the most mid level ml software engineers?
Mid Level ml software engineer roles concentrate in Technology & Software, Electronics & Hardware, and Artificial Intelligence, based on current listings on Migrate Mate as of July 2026. These sectors drive hiring because they operate at the scale where ML moves from experimental to business-critical, creating sustained demand for engineers who can own and maintain production systems rather than just prototype models.