Principal Software Engineer Jobs in San Jose, CA
Principal Software Engineer jobs in San Jose are in high demand, concentrated in North San Jose, Downtown, and the Santana Row corridor across semiconductors, cloud infrastructure, enterprise software, and AI. Employers actively hiring include AMD, Cadence Design Systems, and Cisco. Find a role that fits below and apply directly.
Find JobsOverview
Showing 5 of 330+ Principal Software Engineer jobs
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
We are seeking a highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler and performance optimizations that enable state-of-the-art AI training and inference workloads on AMD GPU platforms. You will work at the intersection of compiler technology, machine learning frameworks, GPU architecture, and performance engineering, contributing to the ROCm software ecosystem and ONNX Runtime execution stack. The ideal candidate combines deep compiler expertise with hands-on experience optimizing AI workloads, and thrives in a fast-paced environment collaborating across architecture, kernel, runtime, and framework teams.
THE PERSON:
You are passionate about building high-performance AI software and solving complex optimization challenges. You possess strong compiler fundamentals, GPU programming expertise, and a proven ability to improve performance for large-scale AI models.
KEY RESPONSIBILITIES:
- Work with AMD’s architecture specialists to improve future products
- Design, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.
- Develop scalable solutions that improve portability and performance across AMD GPU architectures.
- Collaborate with compiler and runtime teams to develop advanced optimization strategies for AI workloads.
- Implement, validate, and maintain ONNX operators and microbenchmark test suites.
- Lead performance optimization efforts for AI training, fine-tuning, reinforcement learning (RL), and inference workloads on AMD GPUs.
- Design and implement graph-level, kernel-level, and runtime-level optimizations that deliver measurable performance gains.
- Analyze workload execution characteristics and identify opportunities for improvements in compute efficiency, memory utilization, and communication overhead.
- Drive performance characterization and benchmarking across pre-silicon and post-silicon environments.
PREFERRED EXPERIENCE:
- Strong proficiency in C++ and object-oriented software development.
- Hands-on experience with GPU programming technologies such as HIP, CUDA, Triton, or equivalent parallel programming frameworks.
- Experience with compiler technologies including MLIR, LLVM, or related compiler infrastructures.
- Strong understanding of machine learning frameworks, model execution pipelines, and AI workload optimization.
- Experience profiling and optimizing performance-critical software systems.
- Proficiency with Linux development environments, source control systems (Git), debugging tools, and performance profilers.
- Strong analytical, communication, and problem-solving skills.
ACADEMIC CREDENTIALS:
- Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
This role is not eligible for visa sponsorship.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
We are seeking a highly motivated and technically exceptional PMTS AI/ML Compiler Engineer to join AMD's AI Software organization. In this role, you will drive compiler and performance optimizations that enable state-of-the-art AI training and inference workloads on AMD GPU platforms. You will work at the intersection of compiler technology, machine learning frameworks, GPU architecture, and performance engineering, contributing to the ROCm software ecosystem and ONNX Runtime execution stack. The ideal candidate combines deep compiler expertise with hands-on experience optimizing AI workloads, and thrives in a fast-paced environment collaborating across architecture, kernel, runtime, and framework teams.
THE PERSON:
You are passionate about building high-performance AI software and solving complex optimization challenges. You possess strong compiler fundamentals, GPU programming expertise, and a proven ability to improve performance for large-scale AI models.
KEY RESPONSIBILITIES:
- Work with AMD’s architecture specialists to improve future products
- Design, develop, and optimize compiler transformations and operator lowerings within MLIR, LLVM, and the ROCm software stack.
- Develop scalable solutions that improve portability and performance across AMD GPU architectures.
- Collaborate with compiler and runtime teams to develop advanced optimization strategies for AI workloads.
- Implement, validate, and maintain ONNX operators and microbenchmark test suites.
- Lead performance optimization efforts for AI training, fine-tuning, reinforcement learning (RL), and inference workloads on AMD GPUs.
- Design and implement graph-level, kernel-level, and runtime-level optimizations that deliver measurable performance gains.
- Analyze workload execution characteristics and identify opportunities for improvements in compute efficiency, memory utilization, and communication overhead.
- Drive performance characterization and benchmarking across pre-silicon and post-silicon environments.
PREFERRED EXPERIENCE:
- Strong proficiency in C++ and object-oriented software development.
- Hands-on experience with GPU programming technologies such as HIP, CUDA, Triton, or equivalent parallel programming frameworks.
- Experience with compiler technologies including MLIR, LLVM, or related compiler infrastructures.
- Strong understanding of machine learning frameworks, model execution pipelines, and AI workload optimization.
- Experience profiling and optimizing performance-critical software systems.
- Proficiency with Linux development environments, source control systems (Git), debugging tools, and performance profilers.
- Strong analytical, communication, and problem-solving skills.
ACADEMIC CREDENTIALS:
- Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
This role is not eligible for visa sponsorship.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
See All 330+ Principal Software Engineer Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find JobsPrincipal Software Engineer Job Market in San Jose
Who's Hiring
- AMD57
- Cadence Design Systems43
- Cisco29
- Bloom Energy29
- Cadence14
Top Industries Hiring
- Electronics & Hardware
- Technology & Software
Principal Software Engineer Jobs in San Jose: Frequently Asked Questions
How do I get a principal software engineer job in San Jose?
Target San Jose's densest hiring pockets: the semiconductor and chip design firms clustered in North San Jose, the cloud and enterprise software companies anchored Downtown and near Santana Row, and the AI and networking companies throughout the north corridor. Candidates who stand out combine deep systems expertise with cross-functional leadership experience. A portfolio of shipped product at scale and familiarity with large distributed systems carries significant weight with San Jose hiring teams.
Which companies hire principal software engineers in San Jose?
Companies currently hiring principal software engineers in San Jose include AMD, Cadence Design Systems, and Cisco, per current listings on Migrate Mate as of August 2026. San Jose's employer base skews toward established technology companies, semiconductor manufacturers, and networking hardware firms, giving principal-level candidates a range of product and infrastructure-focused opportunities.
Are there remote principal software engineer jobs in San Jose?
Yes, though the picture is mixed: principal software engineer roles tied to hardware, chip design, or hands-on lab work are largely on-site, while those focused on distributed systems, platform engineering, or enterprise software tend to be more remote-friendly. About 64% of principal software engineer openings tied to San Jose are remote or hybrid as of August 2026. Platform and backend architecture roles attract the highest share of remote-eligible postings from San Jose employers.
How can I get a principal software engineer job in San Jose with little or no experience?
The most realistic path is moving up through staff or senior engineer roles at San Jose's mid-size technology and semiconductor companies, which often have clearer promotion tracks than large enterprises. Firms in North San Jose's networking and storage corridors regularly develop principal-level talent internally. Contributing to high-visibility infrastructure projects, taking technical lead ownership on a product area, and building a reputation for cross-team design work positions candidates for that first principal offer without waiting for an opening to appear externally.
Which industries hire the most principal software engineers in San Jose?
Most principal software engineer openings in San Jose sit in Electronics & Hardware and Technology & Software, per current listings on Migrate Mate as of August 2026. San Jose's identity as a hub for semiconductors, networking hardware, and cloud infrastructure means these sectors consistently generate principal-level demand that outpaces most other U.S. cities.
Related Jobs in California
See All 330+ Principal Software Engineer Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find Jobs