Infrastructure Platform Engineer Jobs in New York
Infrastructure Platform Engineer jobs in New York are in strong demand, concentrated in financial services, media and entertainment, healthcare systems, and large-scale enterprise technology, with openings at every level from junior site reliability engineers through principal platform architects. The heaviest hiring is in New York City, with meaningful activity in Albany and Buffalo driven by state government modernization and regional healthcare networks. Established employers such as JPMorgan Chase, IBM, and NYU Langone Health maintain significant infrastructure engineering teams in the state. Kubernetes and cloud-native platform management, hybrid cloud architecture, and internal developer platform tooling are the most consistently sought specialties. Find a role that fits below and apply directly.
Find JobsOverview
Showing 5 of 10+ Infrastructure Platform Engineer jobs











About Bedrock Ocean
Bedrock Ocean builds and operates autonomous underwater vehicles (AUVs) that collect georeferenced ocean-floor data at commercial scale. We deliver bathymetric and imagery data products to customers through our own platform, and we're scaling toward continuous, around-the-clock data collection campaigns spanning months at a time.
We are building AI agents on Amazon Bedrock to support our ocean data, internal operations, and customer platform. This role owns that architecture.
(One note on names. Amazon Bedrock is the AWS service. Bedrock Ocean is us. They are unrelated, and we are aware it is confusing.)
The Role
We are looking for a Staff Platform Engineer to lead our AI architecture. This role goes beyond building agents on existing platforms; you will create the infrastructure itself, including the orchestration layer, the data and retrieval pipeline, and the security model required to work with production data. You will also build the tools and abstractions that allow our engineering team to implement AI features independently.
This position combines software engineering, data engineering, and infrastructure operations. You will manage the full lifecycle of our Amazon Bedrock implementation, from initial data chunking to IAM access controls. While some of our data pipelines are already in place, they will require significant expansion, and others will need to be built from scratch.
Security is core to this role, not an afterthought. Because agents with tool access represent a new kind of system actor, you will define their operational boundaries, including what they can access, the actions they can perform autonomously, and the monitoring required to detect issues.
Our roadmap prioritizes internal engineering and operational systems first to ensure a fast feedback loop, followed by our ocean and survey data products. Customer-facing retrieval is the final, high-stakes phase. You will play a key role in defining this sequence. While you will not be responsible for the core data transport design (store-and-forward or hub-and-spoke), you will work closely with that team to ensure it meets our retrieval and data freshness requirements.
What You'll Do
Architect Agent Orchestration: Design the Amazon Bedrock integration, including agent and action group configuration, backend APIs, model access, throughput, and cross-environment deployment.
Manage Retrieval Data Plane: Own the end-to-end retrieval pipeline from ingestion and chunking to embedding and storage in Amazon OpenSearch Serverless. Focus on optimizing for index design, cost, and capacity.
Extend Data Pipelines: Adapt ingestion pipelines for internal knowledge, ocean data, and customer platforms, addressing challenges specific to geospatial and large-binary datasets.
Secure AI Infrastructure: Implement robust security including Bedrock Guardrails, VPC and PrivateLink network boundaries, least-privilege IAM, and audit trails to ensure data isolation.
Define Agent Governance: Build the mechanisms to enforce approval boundaries for autonomous actions, ensuring agents are safe and monitored.
Establish LLMOps & Observability: Implement comprehensive monitoring for tracing, tool calls, and retrieval performance, using CloudWatch and LLM-specific tools like Langfuse or Phoenix.
Build Evaluation Frameworks: Create the infrastructure to run automated evaluations, track results, and manage release gates for model accuracy.
Enable Engineering Productivity: Provide the team with abstraction layers, SDKs, and self-service environments that allow engineers to ship AI features independently.
Operational Excellence: Manage the environment as code across all stages, ensuring deployment safety and participating in incident reviews.
What We're Looking For
8+ years in software and infrastructure engineering, including deep production backend experience (Python or TypeScript preferred, Go fine) and staff-level ownership of technical direction.
Hands-on experience standing up Amazon Bedrock in production: agents, knowledge bases, guardrails, model access, and the throughput and quota decisions that come with them.
Containerized service deployment on ECS, EKS, or Lambda, with CI/CD you have owned rather than inherited. The models are managed, but the backend APIs, tool endpoints, and ingestion jobs still run somewhere real.
Practical RAG and vector search experience: embeddings, chunking strategies, semantic search quality, and operating a managed vector database (OpenSearch Serverless, Pinecone, pgvector, or similar) at production scale and cost.
Real data engineering: you have built or substantially extended ingestion pipelines over messy, heterogeneous, unstructured sources, and you think about freshness and correctness as SLAs rather than afterthoughts.
Strong AWS ecosystem expertise: IAM roles and least privilege for machine identities, VPC networking and PrivateLink, Lambda, S3, KMS, CloudWatch, and provisioning safely through infrastructure as code (Terraform, CDK, or CloudFormation).
Production LLM exposure: you have moved LLM features or autonomous agents past the prototype stage into environments other people depend on.
A working point of view on securing agentic systems: scoping tool permissions, prompt injection and exfiltration risk, sensitive data handling in retrieval, and where a human belongs in the loop.
Experience designing developer-facing APIs, SDKs, or platform services with an API-first mindset. The interface is the product for the engineers who consume it.
Experience building and operating multi-tenant services, with isolation guarantees that hold when the data belongs to customers rather than to us.
Platform instinct: you build the abstraction other engineers stand on, and you measure yourself by what they ship rather than by what you ship directly.
Demonstrated technical leadership and system design judgment at staff level: you have driven an architectural direction across pods or teams you do not manage, and made it stick through influence rather than authority.
A pragmatic builder's bias. You reach for boring, fully managed infrastructure before complex self-hosted alternatives, and you can tell the difference between the two in an architecture review.
Comfort wearing several hats on a small team, and the discipline to write things down so the system runs without you.
Nice to Have
Experience deploying LLM evaluations to measure accuracy over time and treating eval results as a release gate.
Involvement in AI red-teaming or the AI security community.
Experience with GraphRAG or knowledge graphs.
Experience running retrieval over geospatial, scientific, or large-binary datasets.
Experience moving data across intermittent or unreliable links: store-and-forward, hub-and-spoke topologies, offload from disconnected or edge systems, and reconciliation once a link comes back.
Compliance experience such as SOC 2, or handling government or defense customer data.
Background supporting data platforms, autonomous systems, or field operations.
Not a Fit If
Your AI work has been prototypes and notebooks rather than systems other people depend on in production.
You want to be a model researcher, a prompt engineer, or to spend your time fine-tuning models. This role owns the platform underneath agents and partners closely with the people building them.
You treat security as a gate at the end of a project rather than something designed from the start.
You would rather self-host and build from scratch than adopt a managed service that already works. We are optimizing for a small team shipping, not for architectural purity.
You want a mature platform team and a narrow, well-bounded scope. This is an early build with a lot of surface area and few existing answers.
Why This Role Matters
At Bedrock Ocean, our mission is to make the ocean transparent. We are building more than just a survey service; we are creating a source of deep ocean intelligence that grows with every mission.
To realize this, we need to make our data accessible and actionable. This role is about building the infrastructure that allows our teams and eventually our customers to directly query and learn from our findings. Because this data is strategically sensitive, security is woven into the foundation of your work, not added on later.
Ultimately, an AI agent with access to our production data is a powerful tool, but it requires careful design to be a success. You will build a secure, reliable platform that ensures these systems empower our mission safely and effectively.
The base compensation for this role is expected to be $180,000- $220,000 annually plus equity.
Bedrock Ocean is an equal opportunity employer.
See All 10 Infrastructure Platform Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find JobsInfrastructure Platform Engineer Jobs by City in New York
Where New York roles are concentrated, by current openings.
Infrastructure Platform Engineer Job Market in New York
A snapshot from current New York openings, updated as new roles post.
Who's Hiring



Top Industries Hiring
- Fintech
- Technology & Software
- Investment & Asset Management
What New York Employers Look For
The qualifications that appear most often in infrastructure platform engineer jobs across New York.
- Bachelor's degree in computer science, information technology, or a related engineering field
- Hands-on experience with Kubernetes, Terraform, and major cloud platforms such as AWS or Azure
- Proficiency in infrastructure-as-code practices and CI/CD pipeline automation tools
- Experience supporting large-scale distributed systems in regulated industries such as finance or healthcare
- Strong scripting ability in Python, Go, or Bash for platform automation and tooling
- Familiarity with observability stacks including Prometheus, Grafana, or Datadog in production environments
Infrastructure Platform Engineer Jobs in New York: Frequently Asked Questions
How do you become an infrastructure platform engineer in New York?
There is no state-issued license required to work as an infrastructure platform engineer in New York. The typical path begins with a bachelor's degree in computer science, information systems, or a related field, followed by hands-on experience in systems administration, cloud operations, or DevOps. New York employers, particularly in financial services and healthcare, place strong weight on cloud certifications from AWS, Google Cloud, or Microsoft Azure alongside demonstrated experience with container orchestration and infrastructure automation.
How much do infrastructure platform engineers make in New York?
Infrastructure platform engineers in New York earn a median of about $166,180 a year, based on May 2025 Bureau of Labor Statistics wage data, ranging from around $97,430 for the lowest 10% to over $224,590 for the top 10%. Pay rises with experience, specialty, and employer.
Which companies hire infrastructure platform engineers in New York?
Employers hiring infrastructure platform engineers in New York right now include Citi, Anrok, and Forus, based on current listings on Migrate Mate as of September 2026. New York's concentration of major financial institutions, global media companies, and large hospital networks means demand for platform engineers is distributed across several industries rather than being dominated by a single sector.
Which New York cities have the most infrastructure platform engineer jobs?
New York, Brooklyn, and Getzville have the most infrastructure platform engineer openings in New York. New York City dominates because of its density of financial institutions, technology firms, and enterprise media companies, while Albany generates steady demand through state government IT modernization initiatives and Buffalo draws hiring from regional healthcare systems and growing technology operations in western New York.
Are there remote infrastructure platform engineer jobs in New York?
Yes, and more than most fields. About 100% of infrastructure platform engineer openings tied to New York are remote or hybrid as of September 2026, reflecting the desk-based and cloud-centric nature of the work. Roles focused on cloud platform management, infrastructure-as-code development, and internal developer tooling tend to be the most remote-friendly, while positions requiring hands-on data center work or close collaboration with on-site operations teams are more likely to require a physical presence.
How can I get hired as an infrastructure platform engineer in New York with little or no experience?
The most realistic entry path is through a junior DevOps, systems administrator, or cloud operations associate role at a large New York employer or managed service provider. Financial institutions such as Goldman Sachs and Citigroup run technology analyst programs that place candidates in infrastructure tracks, and large healthcare networks like Northwell Health and Mount Sinai Health System hire entry-level IT infrastructure staff who can move into platform roles. Building a portfolio with public Terraform or Kubernetes projects and earning an associate-level cloud certification meaningfully strengthens a candidate's profile for New York employers.
Where can I find and apply to infrastructure platform engineer jobs in New York?
You can find and apply to infrastructure platform engineer jobs in New York on Migrate Mate, which lists current openings across the state. Search the listings for roles that match your experience level and preferred location, then apply directly to the ones that fit.
See All 10 Infrastructure Platform Engineer Jobs in New York
Find roles in New York that match your experience and apply in just a few clicks.
Find Jobs