Mid Level Llm Engineer Jobs
Mid level llm engineer jobs go to engineers ready to own model pipelines end to end, make architectural decisions with limited oversight, and help junior teammates level up. Openings are concentrated in Technology & Software, Electronics & Hardware, and Automotive, with a strong mix of remote and hybrid positions, and employers like FUKU, Zoox, and Qualcomm hiring at this level now.
Find Mid Level Llm Engineer JobsOverview
Showing 5 of 26+ Mid Level Llm Engineer jobs
At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.
We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together, we can help shape the endless possibilities of AI.
Location: Hybrid, working on-site at our Santa Clara, CA, headquarters 3 days per week.
The role: Senior Staff ML Researcher - LLM Algorithmic Optimization
What You Will Do:
d-Matrix is seeking machine learning researchers to join our Algo team. We’re looking for someone to invent, design, and implement efficient algorithms that will be used to optimize large language model inference on DNN accelerators we develop. You would be part of a close-knit team of mathematicians, ML researchers, and ML engineers who create and apply advanced algorithmic and numerical techniques to the most cutting-edge and high-impact research in the overlap of mathematics, ML, and modern LLM applications.
Qualifications:
Strong mathematical skills—MSc or PhD in math, CS, statistics, physics, or a related STEM field and 5+ years of hands-on experience
Experience in Python and OOP code design
Experience with transformer architecture is advantageous but not mandatory
Equal Opportunity Employment Policy
d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.
d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.
Compensation Range: $175K - $265K
See All 26 Mid Level Llm Engineer Jobs
Find roles that match your experience and apply in just a few clicks.
Find Mid Level Llm Engineer JobsMid Level Llm Engineer Job Market
Who's Hiring
- FUKU8
- Zoox3
- Qualcomm3
- FIS1
- Apple1
Top Industries Hiring
- Technology & Software9
- Electronics & Hardware4
- Automotive3
- Telecommunications3
- Artificial Intelligence3
Mid Level Llm Engineer Jobs: Frequently Asked Questions
How do I get a mid level llm engineer job?
Position your experience around ownership, not just contribution. Highlight projects where you drove the full development cycle, from prompt engineering and fine-tuning through evaluation and deployment. Concrete outcomes matter most: latency improvements, accuracy gains, or production systems you shipped. Tailor your resume to show depth in a specific LLM stack rather than breadth across many tools, and be ready to discuss tradeoffs you made independently.
Which companies hire mid level llm engineers?
Companies hiring mid level llm engineers right now include FUKU, Zoox, and Qualcomm, based on current listings on Migrate Mate as of July 2026. Hiring at this level comes from a wide range of employers, including AI-native startups building core products, enterprise technology teams integrating LLMs into existing platforms, and research-adjacent organizations scaling early prototypes into production systems.
Are there remote mid level llm engineer jobs?
Yes, remote and hybrid options are well represented at this level. About 36% of mid level llm engineer openings are remote or hybrid as of July 2026, reflecting how distributed AI teams have become standard across the industry. Engineers with strong async communication skills and documented systems thinking tend to be competitive for fully remote positions.
How do I move up to a mid level llm engineer role?
The path from entry level to mid level llm engineer is built through accumulated ownership. Early in your career, focus on contributing to production LLM systems rather than only prototypes. Over time, take on full feature ownership, propose architectural improvements, and document the measurable impact of your work. Demonstrating that you can operate with less supervision and mentor peers signals readiness for mid level responsibilities.
Which industries hire the most mid level llm engineers?
Mid Level llm engineer roles concentrate in Technology & Software, Electronics & Hardware, and Automotive, based on current listings on Migrate Mate as of July 2026. These sectors drive hiring at this level because they are actively moving LLM applications from pilot stages into scalable production, requiring engineers who can own that transition rather than just assist with it.