Software Architect Jobs in New York

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.

Position Summary

We are looking for a Senior Software Architect to serve as a hands-on technical leader within the Clinical Insights Engine team at CVS Health. This is a senior individual contributor role with squad- and program-level influence. You will design and deliver scalable cloud-native systems that power clinical AI models, ML inference pipelines, enterprise reporting, and large-scale healthcare analytics on GCP and Azure. You will partner closely with engineering leads, ML engineers, and product teams within CIE — translating architectural vision into working systems, driving technical consistency across squads, and mentoring the next generation of engineers on the team.

Responsibilities

• Design and implement end-to-end software architecture for Clinical Insights Engine platform components across GCP and Azure environments
• Serve as a technical authority within your squad and across adjacent CIE engineering teams, leading design reviews and architectural decisions
• Lead the design of scalable, fault-tolerant systems supporting clinical AI/ML workloads — including LLM inference pipelines, document processing, and real-time clinical data services
• Implement and maintain ML architecture patterns — feature stores, model registries, model serving infrastructure, experiment tracking, and MLOps pipelines — with a focus on reliability and observability
• Contribute to LLM-integrated system design including RAG pipelines, embedding stores, prompt engineering frameworks, and clinical NLP processing
• Define and document squad-level engineering standards, reference architectures, and reusable platform patterns within CIE
• Collaborate with CIE product managers, ML engineers, and clinical stakeholders to translate program requirements into sound technical designs
• Participate in enterprise architecture forums and HCD data governance working groups as a CIE technical representative
• Apply engineering best practices across your workstreams: event-driven design, API-first development, data quality at source, and self-service platform patterns
• Identify and surface architectural risk, technical debt, and data quality issues within your area of ownership; propose and execute remediation plans
• Mentor mid-level engineers within CIE squads; contribute to a culture of technical rigor and continuous improvement
• Ensure systems you design meet HIPAA compliance, enterprise security standards, and clinical data governance requirements

Required Qualifications

• 5+ years of experience in software or data architecture, platform engineering, or a closely related field
• 3+ years of experience designing and delivering cloud-native systems in GCP and/or Azure in a production healthcare or regulated industry environment
• Solid hands-on experience with cloud-native services relevant to CIE's stack: BigQuery, Dataflow, Vertex AI, Cloud Run, GKE, Pub/Sub, Cloud Storage, or Azure equivalents
• Experience building or contributing to clinical AI/ML platforms — including model serving, MLOps pipelines, or LLM integration patterns applied to healthcare data
• Working knowledge of distributed systems design: event streaming, asynchronous processing, API gateway patterns, and fault-tolerant pipeline architecture
• Ability to influence technical direction within a squad or program and communicate architectural trade-offs clearly to engineering and product peers
• Familiarity with clinical and healthcare data domains: clinical notes, EHR data, claims, pharmacy, member, and/or provider data
• Understanding of HIPAA, PHI handling requirements, and enterprise security practices relevant to clinical data systems
• Experience working in SAFe Agile or similar large-scale Agile delivery models

Preferred Qualifications

• Google Cloud Professional Architect, GCP Data Engineer, or Azure Solutions Architect certification
• Hands-on experience with LLM-based clinical document processing, RAG architectures, OCR pipelines, or clinical NLP applicable to patient fact extraction or clinical summarization workflows
• Experience building or operating ML pipelines using Vertex AI Pipelines, Kubeflow, MLflow, or equivalent tooling
• Familiarity with data mesh principles and domain-oriented data ownership concepts
• Exposure to real-time ML serving, model monitoring, and drift detection in clinical or regulated AI contexts
• Background in health plan, healthcare delivery, or clinical operations environments

Education

Bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related field required

Master's degree in Computer Science, Machine Learning, or equivalent advanced technical experience preferred

Anticipated Weekly Hours

40

Time Type

Full time

Pay Range

The typical pay range for this role is:

$83,430.00 - $203,940.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full-time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well-being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 06/26/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.