Principal Software Engineer Jobs in San Jose, CA
Principal Software Engineer jobs in San Jose are in high demand, concentrated in North San Jose, Downtown, and the Santana Row corridor across semiconductors, cloud infrastructure, enterprise software, and AI. Employers actively hiring include Collins Aerospace, Cadence Design Systems, and AMD. Find a role that fits below and apply directly.
Find JobsOverview
Open roles33
Top employerCollins Aerospace
Work type67% Hybrid
Top credentialMaster's degree
Companies hiring14
Showing 5 of 33+ Principal Software Engineer jobs
Principal Software Development Engineer
We won't show you this job again
New 17h ago
AMD
Principal Software Development Engineer
San Jose, California
New 17h ago
Principal Software Engineer
We won't show you this job again
Added 1d ago
Index Engines
Principal Software Engineer
San Jose, California
Added 1d ago
Principal Systems Software Engineer
We won't show you this job again
Added 3d ago
NetApp
Principal Systems Software Engineer
San Jose, California
Added 3d ago
Principal Engineer, Quantum Software Development
We won't show you this job again
Added 1w ago
Cisco
Principal Engineer, Quantum Software Development
San Jose, California
Added 1w ago
Principal Software Engineer - Mobile Applications
We won't show you this job again
Added 1w ago
Boston Scientific
Principal Software Engineer - Mobile Applications
San Jose, California
Added 1w ago
New 17h ago
Principal Software Development Engineer
AMD·San Jose, California
Job functions:
Master's degree
5,001-10,000 employees
Job Description
Overview:
Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.
Responsibilities:
This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization.
THE PERSON:
You are comfortable operating across layers—from kernels and runtimes to frameworks and distributed strategies—and have a track record of driving impactful optimizations and influencing technical direction.
KEY RESPONSIBILITIES:
This role is not eligible for visa sponsorship
#LI-JG1
Qualifications:
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.
Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.
THE ROLE:
We are seeking a GPU performance engineering lead to join our team. This role focuses on maximizing performance and efficiency of large-scale AI training/RL/inference workloads on AMD GPU platforms. You will drive innovations across the full software-hardware stack, optimizing at scale and pushing the limits of system throughput, scalability, and utilization for generative AI workloads.
This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization.
THE PERSON:
The ideal candidate is a recognized technical leader with deep expertise in GPU performance optimization, large-scale distributed system, and system-level bottleneck analysis. You have a strong understanding of GPU architecture, interconnects, memory hierarchies, and communication patterns, and can translate this knowledge into measurable improvements in training efficiency at scale.
You are comfortable operating across layers—from kernels and runtimes to frameworks and distributed strategies—and have a track record of driving impactful optimizations and influencing technical direction.
KEY RESPONSIBILITIES:
- Lead performance optimization of large-scale AI training/RL/inference workloads on AMD GPU platforms across single-node and multi-node environments.
- Identify and eliminate system bottlenecks across compute, memory, and communication (e.g., kernel efficiency, memory bandwidth, network utilization).
- Drive cross-stack optimizations spanning kernels, compilers, runtimes, communication libraries, and ML frameworks.
- Develop and apply advanced profiling, benchmarking, and performance modeling methodologies.
- Collaborate with hardware, compiler, and framework teams to influence next-generation GPU architecture and software stack design.
- Contribute to and lead open-source efforts to improve ecosystem performance on AMD platforms.
- Stay at the forefront of advancements in large-scale systems and performance optimization techniques.
PREFERRED EXPERIENCE:
- Deep expertise in GPU architecture and performance characteristics (compute units, memory hierarchy, interconnects such as PCIe/Infinity Fabric/RDMA).
- Strong experience with performance profiling tools (e.g., ROCm tools, Nsight-like systems, custom profilers) and bottleneck analysis.
- Proven experience optimizing large-scale distributed training workloads across thousands of GPUs.
- Experience with frameworks such as Megatron-LM, Torchtitan, vLLM, Sglang, or equivalent.
- Strong understanding of communication libraries and patterns (e.g., NCCL/RCCL, collective ops, overlap of compute and communication).
- Proficiency in Python and at least one systems language (C++/CUDA/HIP), including debugging and low-level optimization.
- Experience with compiler stacks, kernel optimization, or graph-level optimization is a strong plus.
- Demonstrated technical leadership and ability to influence cross-functional team
ACADEMIC CREDENTIALS:
- Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field
This role is not eligible for visa sponsorship
#LI-JG1
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
AMD
Principal Software Development Engineer
San Jose, California
New 17h ago5,001-10,000 employees
Job functions:
Master's degree
Job Description
Overview:
Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.
Responsibilities:
This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization.
THE PERSON:
You are comfortable operating across layers—from kernels and runtimes to frameworks and distributed strategies—and have a track record of driving impactful optimizations and influencing technical direction.
KEY RESPONSIBILITIES:
This role is not eligible for visa sponsorship
#LI-JG1
Qualifications:
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future.
Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.
THE ROLE:
We are seeking a GPU performance engineering lead to join our team. This role focuses on maximizing performance and efficiency of large-scale AI training/RL/inference workloads on AMD GPU platforms. You will drive innovations across the full software-hardware stack, optimizing at scale and pushing the limits of system throughput, scalability, and utilization for generative AI workloads.
This position requires deep expertise in GPU performance analysis, distributed systems, and ML workloads, along with the ability to influence architecture, software ecosystems, and best practices across the organization.
THE PERSON:
The ideal candidate is a recognized technical leader with deep expertise in GPU performance optimization, large-scale distributed system, and system-level bottleneck analysis. You have a strong understanding of GPU architecture, interconnects, memory hierarchies, and communication patterns, and can translate this knowledge into measurable improvements in training efficiency at scale.
You are comfortable operating across layers—from kernels and runtimes to frameworks and distributed strategies—and have a track record of driving impactful optimizations and influencing technical direction.
KEY RESPONSIBILITIES:
- Lead performance optimization of large-scale AI training/RL/inference workloads on AMD GPU platforms across single-node and multi-node environments.
- Identify and eliminate system bottlenecks across compute, memory, and communication (e.g., kernel efficiency, memory bandwidth, network utilization).
- Drive cross-stack optimizations spanning kernels, compilers, runtimes, communication libraries, and ML frameworks.
- Develop and apply advanced profiling, benchmarking, and performance modeling methodologies.
- Collaborate with hardware, compiler, and framework teams to influence next-generation GPU architecture and software stack design.
- Contribute to and lead open-source efforts to improve ecosystem performance on AMD platforms.
- Stay at the forefront of advancements in large-scale systems and performance optimization techniques.
PREFERRED EXPERIENCE:
- Deep expertise in GPU architecture and performance characteristics (compute units, memory hierarchy, interconnects such as PCIe/Infinity Fabric/RDMA).
- Strong experience with performance profiling tools (e.g., ROCm tools, Nsight-like systems, custom profilers) and bottleneck analysis.
- Proven experience optimizing large-scale distributed training workloads across thousands of GPUs.
- Experience with frameworks such as Megatron-LM, Torchtitan, vLLM, Sglang, or equivalent.
- Strong understanding of communication libraries and patterns (e.g., NCCL/RCCL, collective ops, overlap of compute and communication).
- Proficiency in Python and at least one systems language (C++/CUDA/HIP), including debugging and low-level optimization.
- Experience with compiler stacks, kernel optimization, or graph-level optimization is a strong plus.
- Demonstrated technical leadership and ability to influence cross-functional team
ACADEMIC CREDENTIALS:
- Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field
This role is not eligible for visa sponsorship
#LI-JG1
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
See All 33 Principal Software Engineer Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find JobsPrincipal Software Engineer Job Market in San Jose
Who's Hiring
Top Industries Hiring
- Electronics & Hardware
Principal Software Engineer Jobs in San Jose: Frequently Asked Questions
How do I get a principal software engineer job in San Jose?
Target San Jose's densest hiring pockets: the semiconductor and chip design firms clustered in North San Jose, the cloud and enterprise software companies anchored Downtown and near Santana Row, and the AI and networking companies throughout the north corridor. Candidates who stand out combine deep systems expertise with cross-functional leadership experience. A portfolio of shipped product at scale and familiarity with large distributed systems carries significant weight with San Jose hiring teams.
Which companies hire principal software engineers in San Jose?
Companies currently hiring principal software engineers in San Jose include Collins Aerospace, Cadence Design Systems, and AMD, per current listings on Migrate Mate as of November 2026. San Jose's employer base skews toward established technology companies, semiconductor manufacturers, and networking hardware firms, giving principal-level candidates a range of product and infrastructure-focused opportunities.
Are there remote principal software engineer jobs in San Jose?
Yes, though the picture is mixed: principal software engineer roles tied to hardware, chip design, or hands-on lab work are largely on-site, while those focused on distributed systems, platform engineering, or enterprise software tend to be more remote-friendly. About 80% of principal software engineer openings tied to San Jose are remote or hybrid as of November 2026. Platform and backend architecture roles attract the highest share of remote-eligible postings from San Jose employers.
How can I get a principal software engineer job in San Jose with little or no experience?
The most realistic path is moving up through staff or senior engineer roles at San Jose's mid-size technology and semiconductor companies, which often have clearer promotion tracks than large enterprises. Firms in North San Jose's networking and storage corridors regularly develop principal-level talent internally. Contributing to high-visibility infrastructure projects, taking technical lead ownership on a product area, and building a reputation for cross-team design work positions candidates for that first principal offer without waiting for an opening to appear externally.
Which industries hire the most principal software engineers in San Jose?
Most principal software engineer openings in San Jose sit in Electronics & Hardware, per current listings on Migrate Mate as of November 2026. San Jose's identity as a hub for semiconductors, networking hardware, and cloud infrastructure means these sectors consistently generate principal-level demand that outpaces most other U.S. cities.
Related Jobs in California
Software Development Manager JobsCalifornia
Embedded JobsCalifornia
Infrastructure Platform Engineer JobsCalifornia
Python Developer JobsCalifornia
Platform Engineer JobsCalifornia
Mobile Developer JobsCalifornia
Developer JobsCalifornia
Senior Mobile Developer JobsCalifornia
Full Stack Developer JobsCalifornia
See All 33 Principal Software Engineer Jobs in San Jose
Find roles in San Jose that match your experience and apply in just a few clicks.
Find Jobs