ML Software Engineer Jobs in New York
ML Software Engineer jobs in New York are among the most active in the country, concentrated in finance, media, advertising technology, and enterprise software across experience levels from entry-level associate to principal engineer. The heaviest hiring happens in New York City, with additional demand in Buffalo and Albany tied to healthcare systems and state government modernization efforts. IBM, JPMorgan Chase, and Bloomberg are among the most consistent large employers of ml software engineers in New York, with strong demand in natural language processing, recommendation systems, and MLOps. Find a role that fits below and apply directly.
Find ML Software Engineer JobsOverview
Showing 5 of 403+ ML Software Engineer jobs
About the Company
At Future Secure AI, we're building something genuinely new — and we're looking for people bold enough to build it with us. We work at the frontier of AI, tackling big, real-world problems for global enterprises across multiple industries, armed with state-of-the-art technology and a culture that prizes courage, rigor, and relentless curiosity. Our BRAVER values aren't just words on a wall — they describe the kind of people we are and the standard we hold ourselves to every day. Our leadership team is entrepreneurial, experienced, and accessible, with an open-door policy that means you'll never be just a number here. We invest seriously in your growth because we know our success depends on yours. If you're ready to work alongside some of the brightest minds in the industry, push into uncharted territory, and do work that genuinely matters, Future Secure AI is the place for you.
About the Role
We are seeking a highly skilled and motivated Sr. AI/ML Software Engineer to join our core Platform Team in Austin, Texas, New York, NY or Toronto, ON. You will be a key contributor to building and scaling the infrastructure that powers FutureSecure.AI’s intelligent interactions. This role is highly prioritized for engineers with a strong foundation in both high-level scripting languages and performant, compiled systems, coupled with experience in building robust distributed systems. You will be responsible for developing and maintaining the core components of our platform, enabling seamless integration of AI models and ensuring a world-class developer experience.
Responsibilities
- Platform Development: Design, develop, and maintain critical components of the FutureSecure.ai platform, focusing on scalability, reliability, and performance
- AI/ML Integration: Build and optimize integrations with large language models (LLMs), utilizing best practices for prompt engineering, tool use, streaming, and token management
- Distributed Systems Architecture: Implement and maintain robust distributed systems, leveraging concepts like durable execution, idempotency, retry semantics, and circuit breakers
- Developer Tooling: Develop and maintain developer-facing SDKs and platform tooling, prioritizing a clean, intuitive, and well-documented API surface
- Cloud Infrastructure: Provision and manage cloud infrastructure (AWS, Azure, or GCP) using cloud-native patterns and managed services
- Containerization & Orchestration: Deploy, operate, and scale containerized services using Docker and Kubernetes
- Performance Optimization: Identify and address performance bottlenecks across the entire stack, from application code to infrastructure
- Collaboration & Code Quality: Work closely with other engineers and researchers to deliver high-quality, well-tested code
Minimum Qualifications
- Bachelor's Degree in Computer Science, Electrical Engineering, a related field or relevant practical experience
- 5+ years of experience in a similar role
- Experience with TypeScript/Node.js and a compilation language such as Rust, Go, or C++
- Demonstrated experience with distributed systems concepts including durable execution, idempotency, retry semantics, and circuit breakers
- Experience with cloud platforms (AWS, Azure, or GCP) – infrastructure provisioning, managed services, and cloud-native patterns
- Experience deploying and operating containerized services (Docker, Kubernetes)
- Experience building or maintaining developer-facing SDKs or platform tooling where the API surface matters as much as the internals
- A broad and genuine curiosity across computer systems – operating systems, networking, security, databases, compilers
Preferred Qualifications
- Familiarity with LLM integration patterns including prompt engineering, tool use, streaming, and token management
Why Join Us?
- Impactful Work: Be part of a team that’s building the future of work and empowering people through AI
- Innovation: Work with cutting-edge machine learning technology and contribute to a rapidly evolving platform
- Growth Opportunities: We are a fast-growing company with ample opportunities for professional development
- Collaborative Culture: Join a team of passionate and talented individuals
- Competitive Compensation and Benefits: We offer a comprehensive package to reward your contributions
Disclaimer:
We do not wish to be contacted by recruitment agencies. Our hiring process is managed in-house and the best way for candidates to express interest is by applying with your resume through our company website.
Future Secure AI Privacy Policy
At Future Secure AI, we are committed to protecting your privacy and adhering to the principles of the General Data Protection Regulation (GDPR) and the Australian Privacy Principles (APPs) under the Privacy Act 1988 (Cth). Our Privacy Policy outlines how we collect, use, share, and protect your personal data when you visit our website and use our services.
About the Company
At Future Secure AI, we're building something genuinely new — and we're looking for people bold enough to build it with us. We work at the frontier of AI, tackling big, real-world problems for global enterprises across multiple industries, armed with state-of-the-art technology and a culture that prizes courage, rigor, and relentless curiosity. Our BRAVER values aren't just words on a wall — they describe the kind of people we are and the standard we hold ourselves to every day. Our leadership team is entrepreneurial, experienced, and accessible, with an open-door policy that means you'll never be just a number here. We invest seriously in your growth because we know our success depends on yours. If you're ready to work alongside some of the brightest minds in the industry, push into uncharted territory, and do work that genuinely matters, Future Secure AI is the place for you.
About the Role
We are seeking a highly skilled and motivated Sr. AI/ML Software Engineer to join our core Platform Team in Austin, Texas, New York, NY or Toronto, ON. You will be a key contributor to building and scaling the infrastructure that powers FutureSecure.AI’s intelligent interactions. This role is highly prioritized for engineers with a strong foundation in both high-level scripting languages and performant, compiled systems, coupled with experience in building robust distributed systems. You will be responsible for developing and maintaining the core components of our platform, enabling seamless integration of AI models and ensuring a world-class developer experience.
Responsibilities
- Platform Development: Design, develop, and maintain critical components of the FutureSecure.ai platform, focusing on scalability, reliability, and performance
- AI/ML Integration: Build and optimize integrations with large language models (LLMs), utilizing best practices for prompt engineering, tool use, streaming, and token management
- Distributed Systems Architecture: Implement and maintain robust distributed systems, leveraging concepts like durable execution, idempotency, retry semantics, and circuit breakers
- Developer Tooling: Develop and maintain developer-facing SDKs and platform tooling, prioritizing a clean, intuitive, and well-documented API surface
- Cloud Infrastructure: Provision and manage cloud infrastructure (AWS, Azure, or GCP) using cloud-native patterns and managed services
- Containerization & Orchestration: Deploy, operate, and scale containerized services using Docker and Kubernetes
- Performance Optimization: Identify and address performance bottlenecks across the entire stack, from application code to infrastructure
- Collaboration & Code Quality: Work closely with other engineers and researchers to deliver high-quality, well-tested code
Minimum Qualifications
- Bachelor's Degree in Computer Science, Electrical Engineering, a related field or relevant practical experience
- 5+ years of experience in a similar role
- Experience with TypeScript/Node.js and a compilation language such as Rust, Go, or C++
- Demonstrated experience with distributed systems concepts including durable execution, idempotency, retry semantics, and circuit breakers
- Experience with cloud platforms (AWS, Azure, or GCP) – infrastructure provisioning, managed services, and cloud-native patterns
- Experience deploying and operating containerized services (Docker, Kubernetes)
- Experience building or maintaining developer-facing SDKs or platform tooling where the API surface matters as much as the internals
- A broad and genuine curiosity across computer systems – operating systems, networking, security, databases, compilers
Preferred Qualifications
- Familiarity with LLM integration patterns including prompt engineering, tool use, streaming, and token management
Why Join Us?
- Impactful Work: Be part of a team that’s building the future of work and empowering people through AI
- Innovation: Work with cutting-edge machine learning technology and contribute to a rapidly evolving platform
- Growth Opportunities: We are a fast-growing company with ample opportunities for professional development
- Collaborative Culture: Join a team of passionate and talented individuals
- Competitive Compensation and Benefits: We offer a comprehensive package to reward your contributions
Disclaimer:
We do not wish to be contacted by recruitment agencies. Our hiring process is managed in-house and the best way for candidates to express interest is by applying with your resume through our company website.
Future Secure AI Privacy Policy
At Future Secure AI, we are committed to protecting your privacy and adhering to the principles of the General Data Protection Regulation (GDPR) and the Australian Privacy Principles (APPs) under the Privacy Act 1988 (Cth). Our Privacy Policy outlines how we collect, use, share, and protect your personal data when you visit our website and use our services.
See All 403+ ML Software Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find ML Software Engineer JobsML Software Engineer Jobs by City in New York
Where New York roles are concentrated, by current openings.
ML Software Engineer Job Market in New York
A snapshot from current New York openings, updated as new roles post.
Who's Hiring
- Capital One39
- Amazon37
- Spotify15
- Datadog9
- EY9
Top Industries Hiring
- Technology & Software128
- Banking & Financial Services48
- Investment & Asset Management26
- Music22
- Consulting & Professional Services19
What New York Employers Look For
The qualifications that appear most often in ML software engineer jobs across New York.
- Bachelor's or master's degree in computer science, statistics, or a related quantitative field
- Proficiency in Python and core ML frameworks such as TensorFlow, PyTorch, or scikit-learn
- Experience designing, training, and deploying machine learning models in production environments
- Familiarity with cloud platforms including AWS, Google Cloud, or Azure for ML workloads
- Strong understanding of data pipelines, feature engineering, and model evaluation techniques
- Ability to collaborate cross-functionally with data engineers, product managers, and business stakeholders
ML Software Engineer Jobs in New York: Frequently Asked Questions
How do you become a ml software engineer in New York?
There is no state-issued license required to work as an ml software engineer in New York. The standard path is a bachelor's or master's degree in computer science, mathematics, or a related field, followed by demonstrated project experience through internships, open-source contributions, or a strong portfolio. New York employers in finance and media often prioritize candidates who can show end-to-end model deployment, not just academic coursework.
How much do ML software engineers make in New York?
ML software engineers in New York earn a median of about $166,180 a year, based on May 2025 Bureau of Labor Statistics wage data, ranging from around $97,430 for the lowest 10% to over $224,590 for the top 10%. Pay rises with experience, specialty, and employer.
Which companies hire ml software engineers in New York?
Employers hiring ml software engineers in New York right now include Capital One, Amazon, and Spotify, based on current listings on Migrate Mate as of June 2026. New York's density of financial services firms, advertising technology companies, and large media organizations makes it one of the most diverse hiring markets for machine learning talent in the country.
Which New York cities have the most ml software engineer jobs?
New York, New York, and New York City have the most ml software engineer openings in New York. New York City drives the majority of demand through its concentration of investment banks, hedge funds, and tech companies, while Buffalo and Albany see steady openings tied to healthcare technology initiatives and state agency modernization projects that have drawn engineering teams outside the main metro.
Are there remote ml software engineer jobs in New York?
Yes, and more than most fields. About 31% of ml software engineer openings tied to New York are remote or hybrid as of June 2026, reflecting how well this work translates to distributed environments. Model development, experimentation, and code review are the parts of the role most commonly done fully remote, while on-site expectations tend to apply to embedded teams at trading firms or media companies with proprietary infrastructure.
How can I get hired as a ml software engineer in New York with little or no experience?
The most realistic entry path is a master's program with an industry capstone or internship at a New York employer, as firms like IBM and JPMorgan Chase run structured new-graduate programs that convert interns to full-time hires. Candidates transitioning from data analyst or software engineering roles can move laterally by completing a machine learning specialization and building a portfolio of deployed models. Contributing to open-source ML projects and targeting associate ML engineer postings at New York startups are also credible starting points.
Where can I find and apply to ml software engineer jobs in New York?
You can find and apply to ml software engineer jobs in New York on Migrate Mate, which lists current New York openings updated regularly. Search the listings, find roles that fit your experience and location, and apply directly to the employers posting them.
See All 403+ ML Software Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find ML Software Engineer Jobs