AI/ML Software Engineer Jobs
AI/ML Software Engineer jobs are open from new-grad to staff and principal level across tech, finance, healthcare, and defense, with specializations in large language models, computer vision, and recommendation systems. Scan the live roles below and apply to whichever ones fit.
Find AI/ML Software Engineer JobsLooking for remote work? View remote AI/ML software engineer jobs →Overview
Showing 5 of 155+ AI/ML Software Engineer jobs
You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential.
An individual contributor role that provides a high level of leadership and expertise in building Artificial Intelligence and Machine Learning (AI & ML) platforms and solutions for financial services and insurance. The role will be responsible for developing data into usable information to create automated analytics solutions.JOB DESCRIPTION:
Essential Duties & Responsibilities
Performs a combination of duties in accordance with departmental guidelines:
- Build, apply, and promote adoption of platform-wide standards, reusable design patterns, and golden-path templates that enable product and feature teams to build, deploy, and operate AI solutions safely and consistently.
- Drive end-to-end delivery of new platform capabilities, from technical discovery and design through prototyping, hardening, and full production rollout, with hands-on involvement at critical technical milestones to ensure quality and coherence.
- Build and operationalize the core platform service catalog, including LLM gateway and routing layers, prompt lifecycle management, agentic orchestration frameworks, Retrieval-Augmented Generation (RAG) pipelines, vector stores, model registries, and rigorous automated evaluation infrastructure.
- Build and maintain robust CI/CD and AIOps pipelines for AI systems, incorporating automated evaluation gates, model and data versioning controls, staged deployment promotion, and continuous cost and performance optimization guardrails.
- Implement enterprise-grade multi-agent and single-agent workflow patterns for high-value business use cases, following clear standards for orchestration design, state and memory management, tool and API integration, and safe autonomy controls, including human-in-the-loop approvals, permission scoping, and comprehensive audit trails.
- Design and implement knowledge grounding systems, including hybrid retrieval strategies, semantic reranking, ontology-driven entity modeling, and knowledge graph integration, to measurably improve AI output accuracy, explainability, traceability, and readiness for regulatory audit.
- Embed responsible AI and compliance-by-design principles across the platform, covering data privacy protections, enterprise secrets management, granular access controls, output leakage prevention, and model risk governance practices aligned to enterprise and regulatory standards.
- Participate in code and design reviews, and contribute to testing, documentation, and operational readiness.
May perform additional duties as assigned.
Reporting Relationship
Typically Director or above
Skills, Knowledge & Abilities
- Deep AI platform and AIOps engineering expertise, with hands-on experience building, deploying, and operating shared AI platform capabilities such as model serving layers, LLM gateway and proxy services, prompt registries, vector databases, and automated evaluation harnesses at enterprise scale.
- Proven agentic system design capability, with hands-on experience building multi-agent and single-agent workflow systems using orchestration frameworks such as LangGraph and Google ADK, including tool and function calling patterns, state and memory persistence strategies, and robust safe autonomy controls.
- Applied GenAI depth spanning LLM solution architecture patterns, model selection and routing strategies, advanced prompt engineering techniques, fine-tuning and RLHF tradeoffs, and production-grade RAG and hybrid retrieval system design and optimization.
- Strong cloud-native and distributed systems skills, with deep GCP expertise across Vertex AI, Cloud Run, GKE, Pub/Sub, and BigQuery, and a solid command of API and service-based design, event-driven architecture, and high-availability and fault-tolerant system patterns.
- Knowledge grounding and semantic layer proficiency, including experience building canonical ontology and entity models, designing vector search and hybrid retrieval pipelines, integrating knowledge graphs, implementing reranking strategies, and establishing citation and traceability mechanisms that support explainability and compliance.
- Solid AIOps and platform reliability engineering experience, including CI/CD pipeline design for AI systems, automated evaluation and quality gates, model and dataset versioning, production monitoring and observability, reliability engineering practices, and systematic cost-performance optimization.
- Practical responsible AI and security expertise, with experience implementing enterprise AI governance frameworks, model risk management practices, PII and data privacy controls, audit and event logging, and compliance-by-design patterns suited to regulated industries.
- Strong SDLC and hands-on engineering fundamentals, including Python proficiency, architectural and code review practices, comprehensive testing strategies for AI systems, technical debt management, refactoring discipline, and operational readiness standards.
- Familiarity with Scaled Agile (SAFe), including contributing to Enabler Epics and PI planning. Strong communication skills, with the ability to collaborate with engineers, product partners, and business stakeholders, negotiate technology tradeoffs, mentor junior engineers, and explain technical concepts clearly to non-technical audiences.
Education & Experience
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or equivalent required; Master’s degree in AI, Machine Learning, Data Science, or a related discipline strongly preferred.
- 8+ years in software engineering and technical delivery, including work on large-scale, distributed enterprise systems across the full SDLC, from inception through production operations.
- 5+ years hands-on designing, delivering, and operating AI/ML or GenAI platform capabilities in production, with measurable outcomes in quality, reliability, and developer adoption.
- Strong Python proficiency and deep practical GCP experience (Vertex AI, GCP Agent Builder, and Gemini), with the ability to do hands-on technical work as part of the engineering team.
- Prior experience in regulated industries (insurance, financial services, or healthcare) strongly preferred, given stringent governance, auditability, and model risk management requirements. Consulting or enterprise delivery background is a plus, bringing structured problem-solving and stakeholder management.
#LI-KJ1 #LI-HYBRID
I n certain jurisdictions, CNA is legally required to include a reasonable estimate of the compensation for this role. In District of Columbia , California, Colorado, Connecticut, Illinois , Maryland , Massachusetts , New York and Washington, the national base pay range for this job level is $72,000 to $141,000 annually. Salary determinations are based on various factors, including but not limited to, relevant work experience, skills, certifications and location. CNA offers a comprehensive and competitive benefits package to help our employees – and their family members – achieve their physical, financial, emotional and social wellbeing goals. For a detailed look at CNA’s benefits, please visit cnabenefits.com .
CNA utilizes AI-enabled technology during the recruiting process. For more information, please visit our careers page .
CNA is committed to providing reasonable accommodations to qualified individuals with disabilities in the recruitment process. To request an accommodation, please contact leaveadministration@cna.com
You have a clear vision of where your career can go. And we have the leadership to help you get there. At CNA, we strive to create a culture in which people know they matter and are part of something important, ensuring the abilities of all employees are used to their fullest potential.
An individual contributor role that provides a high level of leadership and expertise in building Artificial Intelligence and Machine Learning (AI & ML) platforms and solutions for financial services and insurance. The role will be responsible for developing data into usable information to create automated analytics solutions.JOB DESCRIPTION:
Essential Duties & Responsibilities
Performs a combination of duties in accordance with departmental guidelines:
- Build, apply, and promote adoption of platform-wide standards, reusable design patterns, and golden-path templates that enable product and feature teams to build, deploy, and operate AI solutions safely and consistently.
- Drive end-to-end delivery of new platform capabilities, from technical discovery and design through prototyping, hardening, and full production rollout, with hands-on involvement at critical technical milestones to ensure quality and coherence.
- Build and operationalize the core platform service catalog, including LLM gateway and routing layers, prompt lifecycle management, agentic orchestration frameworks, Retrieval-Augmented Generation (RAG) pipelines, vector stores, model registries, and rigorous automated evaluation infrastructure.
- Build and maintain robust CI/CD and AIOps pipelines for AI systems, incorporating automated evaluation gates, model and data versioning controls, staged deployment promotion, and continuous cost and performance optimization guardrails.
- Implement enterprise-grade multi-agent and single-agent workflow patterns for high-value business use cases, following clear standards for orchestration design, state and memory management, tool and API integration, and safe autonomy controls, including human-in-the-loop approvals, permission scoping, and comprehensive audit trails.
- Design and implement knowledge grounding systems, including hybrid retrieval strategies, semantic reranking, ontology-driven entity modeling, and knowledge graph integration, to measurably improve AI output accuracy, explainability, traceability, and readiness for regulatory audit.
- Embed responsible AI and compliance-by-design principles across the platform, covering data privacy protections, enterprise secrets management, granular access controls, output leakage prevention, and model risk governance practices aligned to enterprise and regulatory standards.
- Participate in code and design reviews, and contribute to testing, documentation, and operational readiness.
May perform additional duties as assigned.
Reporting Relationship
Typically Director or above
Skills, Knowledge & Abilities
- Deep AI platform and AIOps engineering expertise, with hands-on experience building, deploying, and operating shared AI platform capabilities such as model serving layers, LLM gateway and proxy services, prompt registries, vector databases, and automated evaluation harnesses at enterprise scale.
- Proven agentic system design capability, with hands-on experience building multi-agent and single-agent workflow systems using orchestration frameworks such as LangGraph and Google ADK, including tool and function calling patterns, state and memory persistence strategies, and robust safe autonomy controls.
- Applied GenAI depth spanning LLM solution architecture patterns, model selection and routing strategies, advanced prompt engineering techniques, fine-tuning and RLHF tradeoffs, and production-grade RAG and hybrid retrieval system design and optimization.
- Strong cloud-native and distributed systems skills, with deep GCP expertise across Vertex AI, Cloud Run, GKE, Pub/Sub, and BigQuery, and a solid command of API and service-based design, event-driven architecture, and high-availability and fault-tolerant system patterns.
- Knowledge grounding and semantic layer proficiency, including experience building canonical ontology and entity models, designing vector search and hybrid retrieval pipelines, integrating knowledge graphs, implementing reranking strategies, and establishing citation and traceability mechanisms that support explainability and compliance.
- Solid AIOps and platform reliability engineering experience, including CI/CD pipeline design for AI systems, automated evaluation and quality gates, model and dataset versioning, production monitoring and observability, reliability engineering practices, and systematic cost-performance optimization.
- Practical responsible AI and security expertise, with experience implementing enterprise AI governance frameworks, model risk management practices, PII and data privacy controls, audit and event logging, and compliance-by-design patterns suited to regulated industries.
- Strong SDLC and hands-on engineering fundamentals, including Python proficiency, architectural and code review practices, comprehensive testing strategies for AI systems, technical debt management, refactoring discipline, and operational readiness standards.
- Familiarity with Scaled Agile (SAFe), including contributing to Enabler Epics and PI planning. Strong communication skills, with the ability to collaborate with engineers, product partners, and business stakeholders, negotiate technology tradeoffs, mentor junior engineers, and explain technical concepts clearly to non-technical audiences.
Education & Experience
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or equivalent required; Master’s degree in AI, Machine Learning, Data Science, or a related discipline strongly preferred.
- 8+ years in software engineering and technical delivery, including work on large-scale, distributed enterprise systems across the full SDLC, from inception through production operations.
- 5+ years hands-on designing, delivering, and operating AI/ML or GenAI platform capabilities in production, with measurable outcomes in quality, reliability, and developer adoption.
- Strong Python proficiency and deep practical GCP experience (Vertex AI, GCP Agent Builder, and Gemini), with the ability to do hands-on technical work as part of the engineering team.
- Prior experience in regulated industries (insurance, financial services, or healthcare) strongly preferred, given stringent governance, auditability, and model risk management requirements. Consulting or enterprise delivery background is a plus, bringing structured problem-solving and stakeholder management.
#LI-KJ1 #LI-HYBRID
I n certain jurisdictions, CNA is legally required to include a reasonable estimate of the compensation for this role. In District of Columbia , California, Colorado, Connecticut, Illinois , Maryland , Massachusetts , New York and Washington, the national base pay range for this job level is $72,000 to $141,000 annually. Salary determinations are based on various factors, including but not limited to, relevant work experience, skills, certifications and location. CNA offers a comprehensive and competitive benefits package to help our employees – and their family members – achieve their physical, financial, emotional and social wellbeing goals. For a detailed look at CNA’s benefits, please visit cnabenefits.com .
CNA utilizes AI-enabled technology during the recruiting process. For more information, please visit our careers page .
CNA is committed to providing reasonable accommodations to qualified individuals with disabilities in the recruitment process. To request an accommodation, please contact leaveadministration@cna.com
AI/ML Software Engineer Jobs by Experience Level
See All 155+ AI/ML Software Engineer Jobs
Find roles that match your experience and apply in just a few clicks.
Find AI/ML Software Engineer JobsAI/ML Software Engineer Job Market
Who's Hiring
- JPMorganChase18
- Apple10
- Amazon Web Services9
- Booz Allen Hamilton6
- Meta4
Top Industries Hiring
- Technology & Software
- Banking & Financial Services
- Investment & Asset Management
- Fintech
- Retail
What Employers Look For
The qualifications that appear most often in AI/ML software engineer jobs.
- Proficiency in Python and core ML frameworks such as PyTorch or TensorFlow
- Experience building and deploying models in production cloud environments
- Familiarity with MLOps tools including experiment tracking, model registries, and serving infrastructure
- Strong foundation in statistics, linear algebra, and machine learning theory
- Experience with large-scale data processing using Spark, SQL, or distributed compute platforms
- Bachelor's or master's degree in computer science, statistics, or a related quantitative field
Tips for Your AI/ML Software Engineer Job Search
Tailor your resume to model type
Hiring managers in AI/ML scan for the model families you've worked with, not just 'machine learning' as a catch-all. Call out whether your experience is in LLMs, vision models, or tabular data systems so your resume surfaces in the right searches.
Show experiments, not just deployments
Many ai/ml software engineer roles care as much about how you run experiments as what shipped. Document your ablation approach, evaluation metrics, and what you learned from failed runs in your portfolio or GitHub README.
Filter openings by infrastructure stack
An ai/ml software engineer role at a company running Kubernetes-based training pipelines on cloud GPUs demands different skills than one doing edge inference on embedded hardware. Check the job description's infrastructure details before applying.
Apply early to roles that fit
Migrate Mate lists ai/ml software engineer openings from across the United States in one place, so you can find roles that match and apply directly to each listing.
Prepare a system design answer for ML
Most ai/ml software engineer interviews include an ML system design round covering data pipelines, feature stores, model serving, and monitoring. Walk through a real system you've built or studied in depth, with trade-offs named explicitly.
Negotiate around compute access, not just salary
When evaluating an offer, ask about GPU cluster access, experiment budget, and whether model training runs are centrally queued or team-controlled. These constraints shape what you can actually accomplish and are worth discussing before you accept.
AI/ML Software Engineer Jobs: Frequently Asked Questions
Which companies are hiring the most ai/ml software engineers?
The companies hiring the most ai/ml software engineers right now include JPMorganChase, Apple, and Amazon Web Services, with the largest share of openings in California, Texas, and Virginia, based on current listings on Migrate Mate as of November 2026. Demand is concentrated in companies scaling generative AI products and those modernizing legacy data systems with ML-driven automation.
How many ai/ml software engineer jobs are remote?
About 76% of ai/ml software engineer openings are fully remote or hybrid as of November 2026, with remote availability highest in research-adjacent roles, NLP engineering, and recommendation systems work. Roles that require hands-on hardware, edge deployment, or close collaboration with robotics teams are more likely to be on-site.
How do you become an ai/ml software engineer?
Start by building a strong foundation in Python, statistics, and linear algebra, then work through ML fundamentals using structured coursework or project-based learning. Build a portfolio of end-to-end projects that include data preprocessing, model training, evaluation, and deployment. Contributing to open-source ML projects and publishing reproducible experiments on GitHub accelerates visibility with technical hiring teams.
Can you get hired as an ai/ml software engineer with little experience?
Yes, entry-level ai/ml software engineer roles exist at companies building new ML capabilities who value potential over years on a resume. Focus on a portfolio that demonstrates you can take a problem from raw data to a deployed model, even if the project is personal or academic. Roles in ML data engineering or model evaluation are common entry points that lead to core engineering positions.
What does the ai/ml software engineer interview process look like?
The process typically includes a recruiter screen, a coding round focused on algorithms and data structures, an ML fundamentals round covering model selection and evaluation, an ML system design round where you architect a production system end to end, and a final loop with the team. Some companies also include a take-home project asking you to train a model on a provided dataset and present your approach and results.
Where can I find and apply to ai/ml software engineer jobs?
You can find and apply to ai/ml software engineer jobs on Migrate Mate, which lists current openings from companies across the United States. Search the roles available, find the ones that match your experience and the type of work you want to do, and apply directly to each listing that fits.
See All 155+ AI/ML Software Engineer Jobs
Find roles that match your experience and apply in just a few clicks.
Find AI/ML Software Engineer Jobs