Genai Software Engineer Jobs
Genai Software Engineer jobs are open across technology, finance, healthcare, and enterprise software, from new-grad to principal and staff level, with specializations in large language model fine-tuning, retrieval-augmented generation, and agentic system design. Find a role that fits from the openings below and apply directly.
Find Genai Software Engineer JobsOverview
Showing 5 of 148+ Genai Software Engineer jobs











At Freddie Mac, our mission of Making Home Possible is what motivates us, and it’s at the core of everything we do. Since our charter in 1970, we have made home possible for more than 90 million families across the country. Join an organization where your work contributes to a greater purpose.
Position Overview:
Freddie Mac Enterprise Risk organization is seeking a hands-on Software Engineer Tech Lead (Gen AI) to lead the design and development of cutting-edge Generative AI (Gen AI) Agents, Agentic Workflows, RAG pipelines, and Gen AI Applications that solve complex business problems. This role requires advanced proficiency in Python-based microservices for the orchestration layer deployed to AWS EKS (Kubernetes). You will serve as a tech lead and a hands-on engineer, working alongside Gen AI scientists, product managers, and data engineers to shape and implement enterprise-grade Gen AI solutions.
Key Responsibilities:
- Design and implement scalable Full Stack Gen AI Agents, Agentic Workflows, RAG pipelines and applications to address diverse and complex business use cases.
- Design and deploy Python-based microservices for robust orchestration and integration with Gen AI Large Language Models (LLMs).
- Collaborate with Gen AI scientists to integrate machine learning models such as LLMs, RAG, and multi-modal AI into the application architecture.
- Implement solutions leveraging modern design patterns and best practices for full stack development.
- Build and maintain RESTful APIs to enable seamless communication between different system components.
- Collaborate with cross-functional teams of full stack engineers, data engineers and Gen AI scientists to build full-stack Gen AI experiences.
- Integrate Gen AI solutions with enterprise platforms via API-based methods and standardized patterns.
- Establish and enforce validation procedures with Evaluation Frameworks, bias mitigation, safety protocols, and guardrails for production-ready deployment.
- Lead DevOps initiatives, including CI/CD pipelines, to ensure scalable and efficient deployment of Gen AI applications.
Our Impact:
At Freddie Mac, we are at the forefront of technological innovation, developing AI solutions that transform complex business challenges into streamlined, automated processes. By leveraging cutting-edge AI Agents, Agentic Workflows, and Gen AI Applications, we enable businesses to enhance their operational efficiency, make data-driven decisions, and unlock new opportunities for growth. Our commitment to integrating advanced technologies like LLMs and multi-modal AI into enterprise solutions ensures that we remain leaders in the AI industry, delivering impactful and sustainable results for our clients.
Your Impact:
As a Software Engineer Tech Lead (Gen AI), your role is pivotal in shaping the future of AI-driven business solutions. You will have the opportunity to design and develop scalable applications that integrate sophisticated AI models, directly influencing how businesses operate and succeed. Your expertise in Python-based microservices will be crucial in creating robust quality-controlled frameworks for Gen AI solutions that will help with Governance Approvals. By collaborating with Gen AI scientists, UX designers, and other cross-functional teams, you will drive the implementation of enterprise-grade Gen AI solutions, ensuring they meet the highest standards of performance and reliability.
Qualifications
- Bachelor's degree in computer science, Computer Engineering, IT or a related field. Advanced studies/degree preferred.
- 8-10 years overall software development experience
- 2+ years hands-on experience in GenAI solutions, including experience with LLMs (OpenAI, Anthropic, AWS Bedrock, etc.)
- 2+ year building RAG systems using vector DBs
- 1+ year with agentic frameworks (Lang Graph, Lang Chain, etc.)
- 5+ years in cloud development leveraging AWS, REST, microservices
- Strong Python, Typescript, and Java experience
- Background in ML Ops and CI/CD
- Experience building enterprise or customer-facing GenAI products
- Demonstrated ability to work in cross-functional agile teams.
- Experience with CI/CD practices and DevOps methodologies
Keys to Success in this Role:
Technical Proficiency: Demonstrate deep expertise in Python for creating microservices. Your ability to design and implement scalable solutions will be essential.
Quality and Compliance: Establish and enforce validation frameworks and procedures to ensure production-ready deployment of Gen AI solutions.
Collaboration: Work effectively with Gen AI scientists, UX designers, product managers, and data engineers to build comprehensive Gen AI experiences. Strong communication skills and a team-oriented mindset will be key.
Innovation and Problem-Solving: Employ modern Gen AI based design patterns and best practices to solve complex business problems. Your innovative approach will help integrate Gen AI into application architectures successfully.
Agility and Adaptability: Thrive in a fast-paced, agile environment. Your flexibility and ability to adapt to new challenges and technologies will ensure the continuous improvement of our AI solutions.
Current Freddie Mac employees please apply through the internal career site.
We consider all applicants for all positions without regard to gender, race, color, religion, national origin, age, marital status, veteran status, sexual orientation, gender identity/expression, physical and mental disability, pregnancy, ethnicity, genetic information or any other protected categories under applicable federal, state or local laws. We will ensure that individuals are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
A safe and secure environment is critical to Freddie Mac’s business. This includes employee commitment to our acceptable use policy, applying a vigilance-first approach to work, supporting regulatory mandates, and using best practices to protect Freddie Mac from potential threats and risk. Employees exercise this responsibility by executing against policies and procedures and adhering to privacy & security obligations as required via training programs.
CA Applicants: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
Notice to External Search Firms: Freddie Mac partners with BountyJobs for contingency search business through outside firms. Resumes received outside the BountyJobs system will be considered unsolicited and Freddie Mac will not be obligated to pay a placement fee. If interested in learning more, please visit www.BountyJobs.com and register with our referral code: MAC.
Time-type: Full time
FLSA Status: Exempt
Freddie Mac offers a comprehensive total rewards package to include competitive compensation and market-leading benefit programs. Information on these benefit programs is available on our Careers site.
This position has an annualized market-based salary range of $165,000 - $247,000 and is eligible to participate in the annual incentive program. The final salary offered will generally fall within this range and is dependent on various factors including but not limited to the responsibilities of the position, experience, skill set, internal pay equity and other relevant qualifications of the applicant.
See All 148+ Genai Software Engineer Jobs
Jump back to the full list of openings and apply to any genai software engineer role that fits.
Find Genai Software Engineer JobsGenai Software Engineer Job Market
A snapshot from current openings nationwide, updated as new roles post.
Who's Hiring
- Tata Consultancy Services (TCS)12

- Citi9

- Humana9

- Apple8

- Infosys7

Top Industries Hiring
- Technology & Software80
- Banking & Financial Services15
- Consulting & Professional Services14
- Electronics & Hardware13
- Investment & Asset Management5
What Employers Look For
The qualifications that appear most often in genai software engineer jobs.
- Proficiency in Python and experience with LLM APIs such as OpenAI, Anthropic, or open-source models
- Hands-on experience building or deploying retrieval-augmented generation pipelines
- Familiarity with vector databases such as Pinecone, Weaviate, Chroma, or pgvector
- Experience with orchestration frameworks including LangChain, LlamaIndex, or semantic kernel
- Strong foundation in machine learning concepts, model evaluation, and prompt engineering
- Bachelor's or master's degree in computer science, machine learning, or a related engineering field
Tips for Your Genai Software Engineer Job Search
Tailor your resume to model stacks
Recruiters scanning genai engineer resumes look for specific model families and orchestration frameworks. Name the exact tools you've worked with, such as LangChain, LlamaIndex, or OpenAI APIs, and tie each to a concrete output like latency reduction or accuracy improvement.
Show evaluation benchmarks you've built
Hiring teams increasingly ask how candidates measure model quality beyond user feedback. If you've built eval harnesses, defined ground-truth datasets, or run A/B experiments on prompt variants, describe that process explicitly. Many applicants skip this and it differentiates you quickly.
Apply early to roles that fit
Migrate Mate lists genai software engineer openings from across the United States in one place, so you can find roles that match and apply directly to each listing.
Target job descriptions by deployment context
Some roles focus on inference optimization and cost control, others on prompt engineering pipelines, and others on RAG architecture for enterprise search. Filter openings by the deployment context closest to your experience so your application speaks directly to what the team is actually building.
Prepare a live demo or notebook walkthrough
Technical screens for genai roles often move faster than traditional coding rounds. Having a Jupyter notebook or hosted demo that shows a real RAG pipeline, fine-tuned model, or agent loop lets you anchor the conversation in working code rather than abstract explanations.
Negotiate scope before you negotiate pay
Genai engineering roles vary widely in autonomy, model access, and infra ownership. Before accepting an offer, confirm whether you control model selection, whether the team runs evals consistently, and what the compute budget looks like. Scope mismatches surface within the first month.
Genai Software Engineer Jobs: Frequently Asked Questions
Which companies are hiring the most genai software engineers?
The companies hiring the most genai software engineers right now include Tata Consultancy Services (TCS), Citi, and Humana, with the largest share of openings in Texas, California, and New York, based on current listings on Migrate Mate as of June 2026. Demand is concentrated in enterprise software, cloud infrastructure, and financial services firms building internal AI products.
How many genai software engineer jobs are remote?
About 28% of genai software engineer openings are fully remote or hybrid as of June 2026, making it one of the more remote-accessible engineering specializations available today. Roles focused on prompt engineering, RAG pipeline development, and model evaluation tend to be the most location-flexible, while positions tied to on-premise inference infrastructure or regulated data environments more often require on-site presence.
How do you become a genai software engineer?
Start by building a strong Python foundation and getting comfortable calling LLM APIs to complete real tasks. From there, learn the core patterns: prompt engineering, retrieval-augmented generation, and agent design using a framework like LangChain or LlamaIndex. Build at least one end-to-end project you can demo, document your eval methodology, and deploy something publicly. Contributions to open-source genai tooling and published notebooks accelerate credibility significantly.
Can you get a genai software engineer job with little experience?
Yes, entry-level genai software engineer roles exist, particularly at startups and in companies building internal AI tools for the first time. The most effective path is a portfolio of working projects that demonstrate you can move from a problem statement to a deployed solution using modern LLM tooling. Employers hiring junior genai engineers typically care more about your ability to learn fast and ship quickly than about years of experience in the field.
What does the genai software engineer interview process look like?
Most genai software engineer interviews include a recruiter screen, a technical phone round focused on Python and ML fundamentals, and a take-home or live coding exercise involving an LLM task such as building a RAG pipeline or evaluating model outputs. A system design round covering AI infrastructure, latency, and cost tradeoffs is common for mid-level and senior roles. Final rounds often include a presentation of a past project and a conversation with engineering leadership about model strategy.
Where can I find and apply to genai software engineer jobs?
You can find and apply to genai software engineer jobs on Migrate Mate, which lists current openings from across the United States. Find roles that match your experience and the specific genai domains you work in, then apply directly to each listing. The openings on this page are updated regularly, so checking back when your search is active gives you access to the latest opportunities.
See All 148+ Genai Software Engineer Jobs
Jump back to the full list of openings and apply to any genai software engineer role that fits.
Find Genai Software Engineer Jobs