Infrastructure Engineer Jobs in Palo Alto, CA
Infrastructure Engineer jobs in Palo Alto are concentrated along University Avenue, the Stanford Research Park corridor, and the North Palo Alto tech corridor, with the heaviest demand coming from enterprise software, semiconductor, and AI infrastructure companies. Employers hiring right now include Tesla, SpaceXSI, and SpaceX. Scan the live roles below and apply to whichever ones fit.
Find Infrastructure Engineer JobsOverview
Showing 5 of 657+ Infrastructure Engineer jobs
About the role
Help build and operate the compute foundation for demanding AI workloads. As a Senior Systems Engineer, you will own the reliability and lifecycle of Linux-based GPU servers—from bare-metal provisioning and firmware management to performance troubleshooting and automation. You’ll work closely with networking, storage, and operations teammates to keep production clusters healthy and ready for customer workloads.
What you’ll do
- Own provisioning, configuration, and lifecycle management for Linux GPU servers, including imaging, PXE boot, drivers, firmware, and hardware validation.
- Diagnose server and GPU issues such as ECC errors, Xid events, thermal faults, driver problems, and performance degradation.
- Operate and improve configuration management and automation using tools such as Ansible, Python, and Bash.
- Support Slurm or a comparable workload scheduler, including node states, partitions, job accounting, and operational troubleshooting.
- Build repeatable health checks, burn-in tests, drain/repair workflows, and maintenance procedures.
- Lead root-cause analysis for incidents, document corrective actions, and contribute to an on-call rotation with clear escalation paths.
- Partner with network, storage, and data center teams to resolve cross-stack issues and support cluster expansions.
What we’re looking for
- 5+ years of Linux systems administration or systems engineering experience in a production environment; experience managing fleets at scale is strongly preferred.
- Strong working knowledge of Ubuntu or RHEL, systemd, boot processes, kernel/OS troubleshooting, and performance tuning.
- Hands-on experience with NVIDIA GPU servers and related drivers/tooling; familiarity with CUDA, nvidia-smi, or DCGM is valuable.
- Experience with Python and/or Bash automation and a configuration-management tool such as Ansible.
- Experience with Slurm or another HPC/workload scheduler, or the ability to demonstrate closely related production experience.
- A disciplined approach to incident response, change management, documentation, and operational reliability.
Helpful, but not required
- BMC/IPMI/Redfish and out-of-band management; BIOS, NIC, and GPU firmware lifecycle management.
- Bare-metal automation tools such as MAAS or Foreman; Kubernetes on bare metal.
- InfiniBand or RoCE fundamentals, data center hardware repair, or large GPU/HPC cluster experience.
How success will be measured
Reliable, well-documented server operations; faster and more repeatable fault recovery; fewer recurring incidents; and improved visibility into fleet health.
Application note
Please submit a resume and a brief cover letter describing the experience most relevant to this role. Candidates do not need to match every preferred qualification to apply.
Pay: From $100,000.00 per year
Work Location: In person
About the role
Help build and operate the compute foundation for demanding AI workloads. As a Senior Systems Engineer, you will own the reliability and lifecycle of Linux-based GPU servers—from bare-metal provisioning and firmware management to performance troubleshooting and automation. You’ll work closely with networking, storage, and operations teammates to keep production clusters healthy and ready for customer workloads.
What you’ll do
- Own provisioning, configuration, and lifecycle management for Linux GPU servers, including imaging, PXE boot, drivers, firmware, and hardware validation.
- Diagnose server and GPU issues such as ECC errors, Xid events, thermal faults, driver problems, and performance degradation.
- Operate and improve configuration management and automation using tools such as Ansible, Python, and Bash.
- Support Slurm or a comparable workload scheduler, including node states, partitions, job accounting, and operational troubleshooting.
- Build repeatable health checks, burn-in tests, drain/repair workflows, and maintenance procedures.
- Lead root-cause analysis for incidents, document corrective actions, and contribute to an on-call rotation with clear escalation paths.
- Partner with network, storage, and data center teams to resolve cross-stack issues and support cluster expansions.
What we’re looking for
- 5+ years of Linux systems administration or systems engineering experience in a production environment; experience managing fleets at scale is strongly preferred.
- Strong working knowledge of Ubuntu or RHEL, systemd, boot processes, kernel/OS troubleshooting, and performance tuning.
- Hands-on experience with NVIDIA GPU servers and related drivers/tooling; familiarity with CUDA, nvidia-smi, or DCGM is valuable.
- Experience with Python and/or Bash automation and a configuration-management tool such as Ansible.
- Experience with Slurm or another HPC/workload scheduler, or the ability to demonstrate closely related production experience.
- A disciplined approach to incident response, change management, documentation, and operational reliability.
Helpful, but not required
- BMC/IPMI/Redfish and out-of-band management; BIOS, NIC, and GPU firmware lifecycle management.
- Bare-metal automation tools such as MAAS or Foreman; Kubernetes on bare metal.
- InfiniBand or RoCE fundamentals, data center hardware repair, or large GPU/HPC cluster experience.
How success will be measured
Reliable, well-documented server operations; faster and more repeatable fault recovery; fewer recurring incidents; and improved visibility into fleet health.
Application note
Please submit a resume and a brief cover letter describing the experience most relevant to this role. Candidates do not need to match every preferred qualification to apply.
Pay: From $100,000.00 per year
Work Location: In person
See All 657+ Infrastructure Engineer Jobs in Palo Alto
Find roles in Palo Alto that match your experience and apply in just a few clicks.
Find Infrastructure Engineer JobsInfrastructure Engineer Job Market in Palo Alto
Who's Hiring
- Tesla257
- SpaceXSI71S
- SpaceX57
- GEICO29
- Palantir Technologies29
Top Industries Hiring
- Technology & Software57
- Manufacturing29
- Gaming & Esports14
- Artificial Intelligence14
- Healthcare & Medical Services14
Infrastructure Engineer Jobs in Palo Alto: Frequently Asked Questions
How do I get a infrastructure engineer job in Palo Alto?
Target the Stanford Research Park corridor and the downtown University Avenue cluster first, where enterprise software, AI platform companies, and semiconductor firms post the most infrastructure roles. Hands-on experience with cloud-native architectures, network automation, or large-scale data center operations gives candidates a clear edge here. Smaller deep-tech startups in the California Avenue district are also active and often hire engineers who can own infrastructure end to end without a large team behind them.
Which companies hire infrastructure engineers in Palo Alto?
Palo Alto infrastructure engineer roles are posted by Tesla, SpaceXSI, and SpaceX and others right now, based on current listings on Migrate Mate as of November 2026. The local employer mix leans toward established enterprise technology companies, AI-focused startups, and semiconductor firms that maintain significant on-site infrastructure alongside cloud operations.
Are there remote infrastructure engineer jobs in Palo Alto?
Yes, though availability depends heavily on the role, since positions involving physical data center work, network hardware, or on-site lab environments are typically in-person. About 42% of infrastructure engineer openings tied to Palo Alto are remote or hybrid as of November 2026, reflecting the city's strong base of cloud-first and software-driven employers. Cloud infrastructure, automation, and monitoring roles are the most likely to offer remote or hybrid arrangements in this market.
How can I get a infrastructure engineer job in Palo Alto with little or no experience?
The most realistic entry path in Palo Alto is through IT operations or junior systems administrator roles at mid-size enterprise software companies, which regularly hire candidates who can demonstrate foundational Linux, networking, or scripting skills. Several AI startups and platform companies in the Stanford Research Park corridor bring on associate infrastructure engineers and site reliability engineer apprentices who grow into senior roles. A home lab portfolio, relevant certifications, or a visible open-source contribution to infrastructure tooling can differentiate a candidate in a market where most applicants come with some prior technical exposure.
Which industries hire the most infrastructure engineers in Palo Alto?
The sectors hiring the most infrastructure engineers in Palo Alto are Technology & Software, Manufacturing, and Gaming & Esports, based on current listings on Migrate Mate as of November 2026. Palo Alto's concentration of enterprise software headquarters, AI research labs, and semiconductor design firms creates consistent demand for engineers who can support both cloud-scale and on-premises environments.
Related Jobs in California
See All 657+ Infrastructure Engineer Jobs in Palo Alto
Find roles in Palo Alto that match your experience and apply in just a few clicks.
Find Infrastructure Engineer Jobs