Software Engineer AI Jobs in New York
Software Engineer AI jobs in New York are among the most actively recruited technology roles in the country, concentrated in financial services, media, healthcare technology, and enterprise software firms with deep roots in the state. Hiring runs from entry-level machine learning engineers through senior AI architects, with the heaviest demand in New York City, Buffalo, and Albany. Major employers with a lasting presence across the state include Google, JPMorgan Chase, and IBM, particularly in large language model development, MLOps engineering, and applied AI research. Find a role that fits below and apply directly.
Find Software Engineer AI JobsOverview
Showing 5 of 109+ Software Engineer AI jobs







What We Do
At Goldman Sachs, our Engineers don’t just make things – we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets. Goldman Sachs Engineers are innovators and problem-solvers, building solutions in Artificial Intelligence, risk management, big data, mobile and more.
Your Impact
We are seeking entrepreneurial Agentic Software Engineers to join a newly formed AI Agentic Systems team. This team is tasked with solving firmwide, large-scale application and infrastructure challenges by building and deploying swarms of agents. You will build systems that understand, plan, transform, and validate application modernization workflows across one of the largest and most complex technology estates in the industry.
As a founding member of this team, you will help incubate a new paradigm of software engineering—moving beyond static automation to dynamic, goal-oriented agentic systems that operate across all the firm’s business units.
Key Responsibilities:
- Agentic Orchestration: Design and deploy multi-agent systems (swarms) capable of autonomous planning, reasoning, and execution across distributed cloud environments.
- Learning and Feedback: Build human-in-the-loop systems, evaluation frameworks, and observability mechanisms that enable continuous agent improvement.
- Tool Integration: Design and build integrations with APIs, developer tooling, CI/CD pipelines, data platforms, or operational systems.
- Cross-Functional Collaboration: Partner with diverse business units to identify high-impact use cases for agents, translating ambiguous business needs into technical agentic workflows.
Basic Qualifications:
- Software Engineering Excellence: Strong proficiency in Python, Go, Java, Javascript or similar languages with a deep understanding of distributed systems and cloud-native architecture (AWS, Azure, or internal private clouds).
- Agentic Experience: Direct experience deploying and operating LLM-based agents in production environments. Familiarity with frameworks such as LangGraph, AutoGPT, or custom-built orchestration layers.
- AI Evals: Experience designing benchmarks, evaluations, and quality metrics for AI systems.
- Problem-Solving Domains: Proven track record of applying agentic patterns to at least two of the following:
- Data Analysis: Autonomous synthesis of large-scale datasets.
- Observability: Self-healing infrastructure and automated root-cause analysis.
- Optimization: Dynamic resource allocation and cost management.
- Planning: Multi-step task decomposition and execution in non-deterministic environments.
- Entrepreneurial Mindset: Ability to thrive in a 0-to-1 environment, comfortable with ambiguity, and driven to build systems that have never existed before.
Preferred Qualifications:
- Demonstrated interest in emerging agentic technologies such as Multi-Agent Reinforcement Learning (MARL), and swarm intelligence, with a willingness to experiment, learn, and apply new approaches where they create practical business value.
- Familiarity with Model Context Protocol (MCP), A2A and other emerging standards for agent-to-tool communication.
- Strong communication skills to bridge the gap between technical agentic logic and human-centric business processes.
About Goldman Sachs
At Goldman Sachs, we commit our people, capital and ideas to help our clients, shareholders and the communities we serve to grow. Founded in 1869, we are a leading global investment banking, securities and investment management firm. Headquartered in New York, we maintain offices around the world.
We believe who you are makes you better at what you do. We're committed to fostering and advancing diversity and inclusion in our own workplace and beyond by ensuring every individual within our firm has several opportunities to grow professionally and personally, from our training and development opportunities and firmwide networks to benefits, wellness and personal finance offerings and mindfulness programs. about our culture, benefits, and people at GS.com/careers.
We’re committed to finding reasonable accommodation for candidates with special needs or disabilities during our recruiting process. : https://www.goldmansachs.com/careers/footer/disability-statement.html
See All 109+ Software Engineer AI Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Software Engineer AI JobsSoftware Engineer AI Jobs by City in New York
Where New York roles are concentrated, by current openings.
Software Engineer AI Job Market in New York
A snapshot from current New York openings, updated as new roles post.
Who's Hiring



Top Industries Hiring
- Technology & Software16
- Investment & Asset Management3
- Science & Research2
- Consulting & Professional Services2
- Music1
What New York Employers Look For
The qualifications that appear most often in software engineer AI jobs across New York.
- Bachelor's or master's degree in computer science, machine learning, or a related field
- Proficiency in Python and experience with frameworks such as PyTorch or TensorFlow
- Hands-on experience designing, training, and deploying machine learning models in production
- Familiarity with large language models, prompt engineering, or generative AI development
- Experience working with cloud platforms such as AWS, Google Cloud, or Microsoft Azure
- Strong background in data pipelines, model evaluation, and software engineering best practices
Software Engineer AI Jobs in New York: Frequently Asked Questions
How do you become a software engineer ai in New York?
A bachelor's degree in computer science, artificial intelligence, or a closely related field is the standard entry point for software engineer ai roles in New York, with many employers in the state's financial and enterprise technology sectors preferring a master's degree for senior positions. There is no state-issued license required for the role in New York. Building a portfolio of deployed AI projects and contributing to open-source machine learning work strengthens candidacy considerably with New York employers.
How much do software engineer AIs make in New York?
Software engineer AIs in New York earn a median of about $166,180 a year, based on May 2025 Bureau of Labor Statistics wage data, ranging from around $97,430 for the lowest 10% to over $224,590 for the top 10%. Pay rises with experience, specialty, and employer.
Which companies hire software engineer ais in New York?
Employers hiring software engineer ais in New York right now include Databricks, Google, and JPMorganChase, based on current listings on Migrate Mate as of September 2026. New York's dense concentration of financial institutions, media companies, and enterprise technology firms means demand is distributed across a wide range of industries beyond traditional tech.
Which New York cities have the most software engineer ai jobs?
New York, New York City, and New York have the most software engineer ai openings in New York. New York City leads by a wide margin because of its concentration of financial services firms, large tech offices, and media companies, while Buffalo and Albany attract demand from healthcare systems, state government technology initiatives, and growing regional tech employers.
Are there remote software engineer ai jobs in New York?
Yes, and more than most fields. About 69% of software engineer ai openings tied to New York are remote or hybrid as of September 2026, reflecting the desk-based and code-centric nature of the work. Model development, research engineering, and MLOps roles are the most commonly offered in remote or hybrid formats among New York employers.
How can I get hired as a software engineer ai in New York with little or no experience?
The most realistic entry path is through an associate AI or machine learning engineer role, which many large New York employers in financial services and enterprise technology post specifically for recent graduates. IBM and JPMorgan Chase both run structured new-graduate technology programs in New York that include AI and data engineering rotations. Candidates coming from adjacent roles such as data analyst or software developer have a strong advantage, and a portfolio demonstrating a deployed model or fine-tuned language model is the single most effective credential when a formal degree is the only experience you have.
Where can I find and apply to software engineer ai jobs in New York?
You can find and apply to software engineer ai jobs in New York on Migrate Mate, which lists current New York openings from employers actively hiring for the role. Find roles that fit your background and apply directly from the listing.
See All 109+ Software Engineer AI Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Software Engineer AI Jobs