Genai Engineer Jobs in New York
Genai Engineer jobs in New York place the state among the most active markets for this role nationally, with demand concentrated in financial services, media and entertainment, healthcare technology, and enterprise software across seniority levels from entry-level to principal engineer. The heaviest hiring is in New York City, with additional activity in Albany and Buffalo as state government and regional tech sectors expand AI initiatives. Anchor employers with consistent genai engineering needs include JPMorgan Chase, IBM, and Microsoft, with specializations in large language model development, retrieval-augmented generation, and AI application integration drawing the most interest. Find a role that fits below and apply directly.
Find Genai Engineer JobsOverview
Showing 5 of 18+ Genai Engineer jobs
INTRODUCTION
We're looking for a Staff Software Engineer with deep experience in GenAI/ML to join Datadog's Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting.
You'll act as a technical leader within the APM group, focused on agentic workflows. You'll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We're looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.
At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What You'll Do:
- Act as a technical leader within the APM organization, driving GenAI/machine learning projects from concept to production.
- Build and benchmark GenAI/ML models using state-of-the-art techniques.
- Collaborate with cross-functional teams to build automated investigation and triaging tools.
- Influence product direction by bringing a strong product mindset to your work, always advocating for the end user.
- Guide teams through ambiguity, scaling challenges, and evolving requirements with clear technical direction.
- Actively mentor engineers and influence engineering culture through leadership in design reviews, technical talks, and working groups.
Who You Are:
- You have a BS/MS/PhD in a scientific field or equivalent experience
- 10+ years of relevant engineering experience, as well as experience acting as a technical lead
- Proven track record of leading large-scale GenAI/ML initiatives in a product-driven environment
- You have significant experience in model deployment, development, training, fine-tuning, or evaluation
- Ability to drive initiatives across cross-functional teams, and solve ambiguous challenges
Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you're passionate about technology and want to grow your skills, we encourage you to apply.
Benefits and Growth:
- Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
- Have a lot of influence on product direction and impact on the business.
- Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
- Competitive global benefits
- Continuous professional development
Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.
LI-Hybrid
About Datadog:
Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.
Equal Opportunity at Datadog:
Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.
Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications.
Privacy and AI Guidelines:
Any information you submit to Datadog as part of your application will be processed in accordance with Datadog's Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.
INTRODUCTION
We're looking for a Staff Software Engineer with deep experience in GenAI/ML to join Datadog's Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting.
You'll act as a technical leader within the APM group, focused on agentic workflows. You'll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We're looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.
At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What You'll Do:
- Act as a technical leader within the APM organization, driving GenAI/machine learning projects from concept to production.
- Build and benchmark GenAI/ML models using state-of-the-art techniques.
- Collaborate with cross-functional teams to build automated investigation and triaging tools.
- Influence product direction by bringing a strong product mindset to your work, always advocating for the end user.
- Guide teams through ambiguity, scaling challenges, and evolving requirements with clear technical direction.
- Actively mentor engineers and influence engineering culture through leadership in design reviews, technical talks, and working groups.
Who You Are:
- You have a BS/MS/PhD in a scientific field or equivalent experience
- 10+ years of relevant engineering experience, as well as experience acting as a technical lead
- Proven track record of leading large-scale GenAI/ML initiatives in a product-driven environment
- You have significant experience in model deployment, development, training, fine-tuning, or evaluation
- Ability to drive initiatives across cross-functional teams, and solve ambiguous challenges
Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you're passionate about technology and want to grow your skills, we encourage you to apply.
Benefits and Growth:
- Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
- Have a lot of influence on product direction and impact on the business.
- Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
- Competitive global benefits
- Continuous professional development
Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.
LI-Hybrid
About Datadog:
Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.
Equal Opportunity at Datadog:
Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.
Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications.
Privacy and AI Guidelines:
Any information you submit to Datadog as part of your application will be processed in accordance with Datadog's Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.
See All 18 Genai Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Genai Engineer JobsGenai Engineer Jobs by City in New York
Where New York roles are concentrated, by current openings.
Genai Engineer Job Market in New York
A snapshot from current New York openings, updated as new roles post.
Who's Hiring
- Capgemini3
- Datadog3
- GE Vernova2
- Trinity Life Sciences2
- Acronotics1
Top Industries Hiring
- Technology & Software11
- Consulting & Professional Services4
- Banking & Financial Services3
- Cybersecurity2
- Automotive1
What New York Employers Look For
The qualifications that appear most often in genai engineer jobs across New York.
- Proficiency in Python and experience with large language model frameworks such as LangChain or LlamaIndex
- Hands-on experience building or fine-tuning generative AI models using OpenAI, Anthropic, or open-source alternatives
- Strong understanding of retrieval-augmented generation architecture and vector database integration
- Bachelor's or master's degree in computer science, machine learning, or a closely related field
- Experience deploying AI applications to cloud platforms such as AWS, Azure, or Google Cloud
- Demonstrated ability to evaluate model outputs for accuracy, bias, and safety in production environments
Genai Engineer Jobs in New York: Frequently Asked Questions
How do you become a genai engineer in New York?
Most genai engineers hired in New York hold at least a bachelor's degree in computer science, artificial intelligence, or a related technical field, with a master's degree increasingly preferred at competitive employers. There is no state-issued license required for this role in New York. Employers in the city's financial and media sectors typically prioritize candidates with a portfolio of deployed AI projects, documented experience with production-grade LLM systems, and familiarity with cloud infrastructure alongside foundational machine learning skills.
Which companies hire genai engineers in New York?
Employers hiring genai engineers in New York right now include Capgemini, Datadog, and GE Vernova, based on current listings on Migrate Mate as of June 2026. New York's concentration of financial institutions, media companies, and enterprise technology firms means demand for this role is unusually broad across industries rather than limited to dedicated AI startups.
Which New York cities have the most genai engineer jobs?
New York, Brooklyn, and Niskayuna account for the most genai engineer openings in New York. New York City dominates because of its density of financial services firms, global media companies, and enterprise technology offices, while Albany attracts openings tied to state government AI modernization efforts and Buffalo's growing tech sector is drawing regional employers investing in applied AI capabilities.
Are there remote genai engineer jobs in New York?
Yes, and more than most technical fields. About 44% of genai engineer openings tied to New York are remote or hybrid as of June 2026, reflecting the nature of a role built around software development and model experimentation rather than on-site infrastructure. The work that most consistently stays remote involves prompt engineering, model evaluation, and API integration, while roles requiring collaboration with proprietary data systems often require at least partial in-office presence.
How can I get hired as a genai engineer in New York with little or no experience?
The most realistic entry path is building a public portfolio of generative AI projects, such as a retrieval-augmented generation application or a fine-tuned open-source model, before applying to associate or junior AI engineer roles at mid-size New York technology firms. Large employers including IBM and JPMorgan Chase run new graduate programs in their New York offices that accept candidates with strong project work in lieu of commercial experience. Moving laterally from a data analyst, backend developer, or machine learning research assistant role is also common, particularly at financial services firms and media companies headquartered in the city.
Where can I find and apply to genai engineer jobs in New York?
You can find and apply to genai engineer jobs in New York on Migrate Mate, which lists current openings across the state. Search the available roles, find the ones that fit your experience and target location, and apply directly to each position that matches.
See All 18 Genai Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Genai Engineer Jobs