Genai Engineer Jobs in New York
Genai Engineer jobs in New York place the state among the most active markets for this role nationally, with demand concentrated in financial services, media and entertainment, healthcare technology, and enterprise software across seniority levels from entry-level to principal engineer. The heaviest hiring is in New York City, with additional activity in Albany and Buffalo as state government and regional tech sectors expand AI initiatives. Anchor employers with consistent genai engineering needs include JPMorgan Chase, IBM, and Microsoft, with specializations in large language model development, retrieval-augmented generation, and AI application integration drawing the most interest. Find a role that fits below and apply directly.
Find Genai Engineer JobsOverview
Showing 4 of 6+ Genai Engineer jobs









Senior GenAI & High Performance Computing (HPC) Delivery Engineer
Dell Technologies has delivered HPC solutions for 25+ years, including support for Bright Cluster Manager (now NVIDIA BCM) since 2011. Today, Dell is NVIDIA’s preferred partner for GenAI Factory systems, using Dell GenAI PowerEdge XE servers and NVIDIA NVAIE to help customers build and scale end to end GenAI and High-Performance Computing environments.
Join us to do the best work of your career and make a profound social impact as a Senior GenAI & High Performance Computing (HPC) Delivery Engineer on our Service Delivery Team in New York
What you’ll achieve
We’re seeking a Senior GenAI & HPC Engineer with deep experience in GPU accelerated systems, Linux performance tuning, and benchmarking. This role is highly hands on and customer facing, supporting onsite deployments across the U.S. for advanced HPC and GenAI solutions.
You will work as a part of a team to help build, integrate, and test some of the world’s largest multi GPU systems, benchmark them using industry standard tools, and deliver the next generations of AI and HPC infrastructure.
You will:
- Deploy, configure, and validate GPU accelerated compute clusters for AI, ML, and HPC with NVIDIA Base Command Manager (Warewulf and OpenHPC knowledge are a plus)
- Perform benchmarking with HPL GPU, HPL MxP, STREAM, NCCL, RCCL, OSU Microbenchmarks, and related tools
- Produce as-built documentation, performance reports, and share best practices amongst the team.
- Configure and secure RHEL, Ubuntu, Rocky for GenAI or HPC workloads
- Work directly with customers onsite (travel both regionally and across the U.S.)
Take the first step towards your dream career
Every Dell Technologies team member brings something unique to the table. Here’s what we are looking for with this role:
Essential Requirements
- 7+ years with HPC or GenAI clusters, GPU based systems, AI infrastructure, or related fields
- Deep hands on experience with GPU deployment, configuration, and multi-node testing using NVIDIA Base Command Manager
- Proficiency with benchmarking tools: HPL, STREAM, NCCL, RCCL, MxP, OSU Microbenchmarks
- Red Hat certification (RHCSA/RHCE) or 7+ years of relevant RH distros experience
- Experience with GenAI/HPC networking (InfiniBand and/or RoCE)
- Experience working in Linux based parallel computing environments at scale
- Experience with containers/orchestration (Docker, Singularity/Apptainer, Kubernetes, Slurm)
- Ability to travel up to 70% of the time across the U.S. as needed for projects
- Strong customer facing and communication skills
Desirable Requirements
- Bachelor’s degree
- NVIDIA certifications (NCA, NCE, DGX)
- Experience with NVIDIA UFM, Infiniband, and SpectrumX fabrics
- Exposure to hybrid cloud or GPU cloud environments
- Experience with GPU observability/performance profiling tools
Compensation
Dell is committed to fair and equitable compensation practices. The salary range for this position is USD 176,927 - USD 228,965
Benefits and Perks of Working at Dell Technologies
Your life. Your health. Supported by your benefits. You can explore the overall benefits experience that awaits you as a Dell Technologies team member — right now at MyWellatDell.com
See All 6 Genai Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Genai Engineer JobsGenai Engineer Jobs by City in New York
Where New York roles are concentrated, by current openings.
Genai Engineer Job Market in New York
A snapshot from current New York openings, updated as new roles post.
Who's Hiring



What New York Employers Look For
The qualifications that appear most often in genai engineer jobs across New York.
- Proficiency in Python and experience with large language model frameworks such as LangChain or LlamaIndex
- Hands-on experience building or fine-tuning generative AI models using OpenAI, Anthropic, or open-source alternatives
- Strong understanding of retrieval-augmented generation architecture and vector database integration
- Bachelor's or master's degree in computer science, machine learning, or a closely related field
- Experience deploying AI applications to cloud platforms such as AWS, Azure, or Google Cloud
- Demonstrated ability to evaluate model outputs for accuracy, bias, and safety in production environments
Genai Engineer Jobs in New York: Frequently Asked Questions
How do you become a genai engineer in New York?
Most genai engineers hired in New York hold at least a bachelor's degree in computer science, artificial intelligence, or a related technical field, with a master's degree increasingly preferred at competitive employers. There is no state-issued license required for this role in New York. Employers in the city's financial and media sectors typically prioritize candidates with a portfolio of deployed AI projects, documented experience with production-grade LLM systems, and familiarity with cloud infrastructure alongside foundational machine learning skills.
Which companies hire genai engineers in New York?
Employers hiring genai engineers in New York right now include Capital One, Google, and Infosys, based on current listings on Migrate Mate as of November 2026. New York's concentration of financial institutions, media companies, and enterprise technology firms means demand for this role is unusually broad across industries rather than limited to dedicated AI startups.
Which New York cities have the most genai engineer jobs?
New York account for the most genai engineer openings in New York. New York City dominates because of its density of financial services firms, global media companies, and enterprise technology offices, while Albany attracts openings tied to state government AI modernization efforts and Buffalo's growing tech sector is drawing regional employers investing in applied AI capabilities.
Are there remote genai engineer jobs in New York?
Yes, and more than most technical fields. About 100% of genai engineer openings tied to New York are remote or hybrid as of November 2026, reflecting the nature of a role built around software development and model experimentation rather than on-site infrastructure. The work that most consistently stays remote involves prompt engineering, model evaluation, and API integration, while roles requiring collaboration with proprietary data systems often require at least partial in-office presence.
How can I get hired as a genai engineer in New York with little or no experience?
The most realistic entry path is building a public portfolio of generative AI projects, such as a retrieval-augmented generation application or a fine-tuned open-source model, before applying to associate or junior AI engineer roles at mid-size New York technology firms. Large employers including IBM and JPMorgan Chase run new graduate programs in their New York offices that accept candidates with strong project work in lieu of commercial experience. Moving laterally from a data analyst, backend developer, or machine learning research assistant role is also common, particularly at financial services firms and media companies headquartered in the city.
Where can I find and apply to genai engineer jobs in New York?
You can find and apply to genai engineer jobs in New York on Migrate Mate, which lists current openings across the state. Search the available roles, find the ones that fit your experience and target location, and apply directly to each position that matches.
See All 6 Genai Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Genai Engineer Jobs