Infrastructure Lead Jobs
Infrastructure Lead jobs are open across cloud, enterprise IT, defense, healthcare, and financial services, from mid-level engineer to principal and director, with specializations in network engineering, systems architecture, and site reliability. See the openings below and apply to the ones that match your experience.
Find Infrastructure Lead JobsLooking for remote work? View remote infrastructure lead jobs →Overview
Showing 5 of 239+ Infrastructure Lead jobs
Responsibilities
We are a group of applied machine learning engineers that focus on TikTok recommendations and search engineers powering multiple product areas such as For-You-Page (FYP), Live Streaming, Global E-commerce, Local Services and more. We are developing innovative algorithms and techniques to improve user engagement and satisfaction, converting creative ideas into business-impacting solutions. We are interested in and excited about pushing the envelope of State-of-the-Art (SOTA) large scale machine learning to solve various real-world problems.
What You'll Do
- Technical Leadership: Drive the technical roadmap for our large-scale (in billions parameters) distributed real-time ML training and inferencing platforms that power the TikTok recommendation and search engines, Short Form Video (SFV) ecosystem. Have a direct business impact on Live, Global E-Commerce, Local Services and many businesses domains.
- Large-Scale Parallelism Architecture: Architect and scale multi-node distributed training systems, implementing advanced 3D parallelism strategies (Data, Tensor, Pipeline) to maximize compute efficiency and model scalability. Lead the architecture, scale-testing, and maintenance of massive distributed computing foundations, GPU cluster configurations, and orchestration pipelines, establish robust SLI/SLO frameworks while maximizing hardware utilization and cluster efficiency to expedite innovation.
- Production Inference & Serving: Build and scale low-latency, high-throughput model serving infrastructure, optimizing inference pipelines and leveraging low-level execution paths to handle massive live traffic under strict boundary isolation.
- Algorithm-Infrastructure Co-Design: Partner closely with Applied ML Research teams to co-design and pioneer next-generation Generative Recommendation systems, abstracting general-purpose components to support advanced generative paradigms in production.
- Resiliency & Fault Tolerance: Design robust, automated fault-detection systems and asynchronous checkpointing mechanisms to gracefully handle hardware drops, silent data corruption (SDC), or network-switch failures in multi-thousand GPU clusters.
- Cross-Functional Collaboration: Partner with Applied ML researchers and data platform teams to engineer high-throughput, secure multi-modal data processing and storage engines that prevent compliance friction.
- Security & Compliance Hardening: Implement and enforce strict encryption-at-rest/in-transit controls, access control lists (ACLs), and secure tenant isolation protocols across the entire compute stack to meet compliance objectives.
Qualifications
Minimum Qualifications
- Bachelor’s or Master's degree in Computer Science, Computer Engineering, or a related technical discipline.
- 5+ years of professional software engineering experience with deep expertise in Python, C++/Java and a proven track record of designing large-scale distributed systems.
- 3+ years of direct experience building and maintaining machine learning infrastructure at enterprise scale (managing large GPU clusters, Kubernetes, or native Slurm environments).
- Deep technical familiarity with the internals of core ML frameworks (PyTorch / Tensorflow) and a strong understanding of low-level GPU memory management, CUDA interactions, and networking topologies (InfiniBand/RoCE).
- Solid understanding of production-grade LLM training and inference tools, with hands-on profiling skills to eliminate I/O, compute, or network bottlenecks.
- Strong system-level troubleshooting and debugging skills, with experience profiling and eliminating I/O, compute, or network bottlenecks.
Preferred Qualifications
- Experience optimizing high-performance training loops to maximize Model Flops Utilization (MFU) through advanced communication-computation overlap and zero-bubble pipeline scheduling across large-scale distributed clusters using industry-standard frameworks (e.g., Megatron, DeepSpeed).
- Proven track record of scaling LLM training or inference workloads across hundreds of GPUs, with deep familiarity in advanced serving techniques such as KV Cache management, Prefill-Decoding (PD) separation, and model quantization.
- Experience working in highly regulated industries, sovereign cloud environments, or dealing with federal data security compliance frameworks.
- Strong flavor in low-level kernel development and graph compilation, with experience in CUDA, Triton, Cutlass, TensorRT, or Triton Inference Server being a huge plus.
- Active background or interest in keeping up with the latest industry breakthroughs in MLOps, MoE (Mixture of Experts) routing infrastructure, and specialized hardware optimization.
- Excellent technical leadership skills, with the ability to mentor junior engineers, draft clear architecture designs, and communicate complex infrastructure needs to non-technical stakeholders.
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Our foundation is a comprehensive data privacy and cybersecurity program we operate under defined safeguards to protect national security and secure U.S. user data, apps and the algorithm. We safeguard the U.S. content ecosystem, holding decision-making authority for trust and safety policies and moderation. USDS Joint Venture helps ensure Americans can continue to express their creativity, discover new hobbies and interests, and build thriving communities and businesses on a global scale.
On-site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real-time decision-making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in-person schedule up to 5 days a week.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy – a mission we work towards every day. We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
USDS Reasonable Accommodation
USDS is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/USDS-RA
Job Information
【For Pay Transparency】Compensation Description (Annually) The base salary range for this position in the selected city is $198360 - $416100 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.
Responsibilities
We are a group of applied machine learning engineers that focus on TikTok recommendations and search engineers powering multiple product areas such as For-You-Page (FYP), Live Streaming, Global E-commerce, Local Services and more. We are developing innovative algorithms and techniques to improve user engagement and satisfaction, converting creative ideas into business-impacting solutions. We are interested in and excited about pushing the envelope of State-of-the-Art (SOTA) large scale machine learning to solve various real-world problems.
What You'll Do
- Technical Leadership: Drive the technical roadmap for our large-scale (in billions parameters) distributed real-time ML training and inferencing platforms that power the TikTok recommendation and search engines, Short Form Video (SFV) ecosystem. Have a direct business impact on Live, Global E-Commerce, Local Services and many businesses domains.
- Large-Scale Parallelism Architecture: Architect and scale multi-node distributed training systems, implementing advanced 3D parallelism strategies (Data, Tensor, Pipeline) to maximize compute efficiency and model scalability. Lead the architecture, scale-testing, and maintenance of massive distributed computing foundations, GPU cluster configurations, and orchestration pipelines, establish robust SLI/SLO frameworks while maximizing hardware utilization and cluster efficiency to expedite innovation.
- Production Inference & Serving: Build and scale low-latency, high-throughput model serving infrastructure, optimizing inference pipelines and leveraging low-level execution paths to handle massive live traffic under strict boundary isolation.
- Algorithm-Infrastructure Co-Design: Partner closely with Applied ML Research teams to co-design and pioneer next-generation Generative Recommendation systems, abstracting general-purpose components to support advanced generative paradigms in production.
- Resiliency & Fault Tolerance: Design robust, automated fault-detection systems and asynchronous checkpointing mechanisms to gracefully handle hardware drops, silent data corruption (SDC), or network-switch failures in multi-thousand GPU clusters.
- Cross-Functional Collaboration: Partner with Applied ML researchers and data platform teams to engineer high-throughput, secure multi-modal data processing and storage engines that prevent compliance friction.
- Security & Compliance Hardening: Implement and enforce strict encryption-at-rest/in-transit controls, access control lists (ACLs), and secure tenant isolation protocols across the entire compute stack to meet compliance objectives.
Qualifications
Minimum Qualifications
- Bachelor’s or Master's degree in Computer Science, Computer Engineering, or a related technical discipline.
- 5+ years of professional software engineering experience with deep expertise in Python, C++/Java and a proven track record of designing large-scale distributed systems.
- 3+ years of direct experience building and maintaining machine learning infrastructure at enterprise scale (managing large GPU clusters, Kubernetes, or native Slurm environments).
- Deep technical familiarity with the internals of core ML frameworks (PyTorch / Tensorflow) and a strong understanding of low-level GPU memory management, CUDA interactions, and networking topologies (InfiniBand/RoCE).
- Solid understanding of production-grade LLM training and inference tools, with hands-on profiling skills to eliminate I/O, compute, or network bottlenecks.
- Strong system-level troubleshooting and debugging skills, with experience profiling and eliminating I/O, compute, or network bottlenecks.
Preferred Qualifications
- Experience optimizing high-performance training loops to maximize Model Flops Utilization (MFU) through advanced communication-computation overlap and zero-bubble pipeline scheduling across large-scale distributed clusters using industry-standard frameworks (e.g., Megatron, DeepSpeed).
- Proven track record of scaling LLM training or inference workloads across hundreds of GPUs, with deep familiarity in advanced serving techniques such as KV Cache management, Prefill-Decoding (PD) separation, and model quantization.
- Experience working in highly regulated industries, sovereign cloud environments, or dealing with federal data security compliance frameworks.
- Strong flavor in low-level kernel development and graph compilation, with experience in CUDA, Triton, Cutlass, TensorRT, or Triton Inference Server being a huge plus.
- Active background or interest in keeping up with the latest industry breakthroughs in MLOps, MoE (Mixture of Experts) routing infrastructure, and specialized hardware optimization.
- Excellent technical leadership skills, with the ability to mentor junior engineers, draft clear architecture designs, and communicate complex infrastructure needs to non-technical stakeholders.
About USDS
TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Our foundation is a comprehensive data privacy and cybersecurity program we operate under defined safeguards to protect national security and secure U.S. user data, apps and the algorithm. We safeguard the U.S. content ecosystem, holding decision-making authority for trust and safety policies and moderation. USDS Joint Venture helps ensure Americans can continue to express their creativity, discover new hobbies and interests, and build thriving communities and businesses on a global scale.
On-site presence across teams allows the company to operate with greater speed, alignment, and agility — especially in areas like real-time decision-making, team development, and integrated execution. As such, the company is shifting from a hybrid work model to a fully in-person schedule up to 5 days a week.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy – a mission we work towards every day. We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
USDS Reasonable Accommodation
USDS is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/USDS-RA
Job Information
【For Pay Transparency】Compensation Description (Annually) The base salary range for this position in the selected city is $198360 - $416100 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.
Infrastructure Lead Jobs by Experience Level
See All 239+ Infrastructure Lead Jobs
Find roles that match your experience and apply in just a few clicks.
Find Infrastructure Lead JobsInfrastructure Lead Job Market
Who's Hiring
- JPMorganChase43
- Google13
- Oracle13
- Alvarez & Marsal7
- KLA6
Top Industries Hiring
- Technology & Software14
- Manufacturing5
- Consulting & Professional Services3
- Energy1
- Science & Research1
What Employers Look For
The qualifications that appear most often in infrastructure lead jobs.
- Five or more years of hands-on infrastructure engineering or systems administration experience
- Proficiency with at least one major cloud platform such as AWS, Azure, or Google Cloud
- Experience leading or mentoring a team of infrastructure or platform engineers
- Strong knowledge of networking fundamentals including routing, switching, DNS, and load balancing
- Familiarity with infrastructure-as-code tools such as Terraform, Ansible, or Pulumi
- Relevant certifications in cloud, networking, or systems such as CCNP, AWS Solutions Architect, or RHCE
Tips for Your Infrastructure Lead Job Search
Quantify your infrastructure scope clearly
Hiring managers want numbers, not adjectives. List the size of the environments you managed: server counts, uptime percentages, budget figures, and team headcount. Vague phrases like 'large-scale infrastructure' get skipped where specific metrics get interviews.
Align certifications to the target stack
An AWS certification carries different weight than Azure or GCP depending on the employer's platform. Read each job posting for the cloud or on-prem stack mentioned and lead with the certification that matches it, rather than listing every credential you hold.
Apply early to roles that fit
Migrate Mate lists infrastructure lead openings from across the United States in one place, so you can find roles that match and apply directly to each listing.
Target postings by infrastructure discipline
Job titles vary widely: 'infrastructure lead,' 'platform lead,' 'network lead,' and 'systems lead' often describe overlapping roles with different emphasis. Search each variation to surface openings that match your specialty and avoid missing relevant postings filed under a different label.
Prepare a system-design narrative for interviews
Infrastructure lead interviews almost always include a system-design or architecture scenario. Prepare two or three examples from past work where you made a defensible design decision under real constraints, covering the tradeoffs you weighed and the outcome you achieved.
Negotiate scope before negotiating compensation
Before discussing pay, clarify the team size, on-call expectations, and budget authority the role carries. These define the actual scope of the lead position, and two offers with the same title can differ dramatically in responsibility, which affects both what you accept and what you ask for.
Infrastructure Lead Jobs: Frequently Asked Questions
Which companies are hiring the most infrastructure leads?
JPMorganChase, Google, and Oracle are hiring the most infrastructure leads right now, with openings concentrated in California, Texas, and Ohio, based on current listings on Migrate Mate as of November 2026. Demand is especially consistent in sectors running large on-premises or hybrid environments, including financial services, healthcare, and defense contracting.
How many infrastructure lead jobs are remote?
About 58% of infrastructure lead openings are fully remote or hybrid as of November 2026, though the share varies significantly by specialization. Cloud and DevOps-adjacent infrastructure roles tend to offer more remote flexibility, while network and data center leads are more frequently required on-site for hands-on hardware access and security compliance reasons.
How do you become an infrastructure lead?
Start by building deep expertise in a core discipline, whether that is network engineering, cloud architecture, or systems administration. Take on increasingly complex projects, document the outcomes you delivered, and earn certifications that reflect your stack. Move into informal leadership by mentoring teammates or owning a critical system end-to-end. When you apply for lead roles, emphasize decisions you made independently, teams or projects you guided, and infrastructure problems you solved at scale.
Can you get hired as an infrastructure lead with limited experience?
Getting hired as an infrastructure lead with limited experience is possible if you demonstrate ownership rather than just participation. Build a portfolio of personal or open-source projects where you designed and operated the full stack yourself. Certifications in cloud or networking help close the gap when formal experience is thin. Target smaller organizations or startups where infrastructure teams are lean and a motivated engineer can step into a lead role earlier than at larger enterprises.
What does the infrastructure lead interview process look like?
The process typically starts with a recruiter screen focused on your background and team experience, followed by a technical phone or video interview covering your domain knowledge. Most employers then run a system-design or architecture round where you walk through how you would solve a real infrastructure problem. A final loop with engineering managers or cross-functional stakeholders assesses your communication, prioritization, and leadership approach before an offer is extended.
Where can I find and apply to infrastructure lead jobs?
You can find and apply to infrastructure lead jobs on Migrate Mate, which lists current openings from across the United States in one place. Search the listings to find roles that match your experience level and specialization, then apply directly to each opening that fits.
See All 239+ Infrastructure Lead Jobs
Find roles that match your experience and apply in just a few clicks.
Find Infrastructure Lead Jobs