Senior AI Software Engineer Jobs in Boston, MA

Who we are looking for

We are looking for an Artificial Intelligence & Machine Learning, Vice President with a robust background in Generative AI, Machine Learning, enterprise architecture, cloud platforms, and scalable solution design. You will be responsible for designing and implementing AI-enabled solutions that are secure, resilient, compliant, and aligned with enterprise architecture standards. This role requires strong experience in translating business requirements into end-to-end AI solution architectures, including platform integration, governance, observability, and production readiness. The ideal candidate will work across business, engineering, security, data, and risk teams to deliver scalable and responsible AI solutions for enterprise use cases.

Why this role is important to us

The team you will be joining plays a vital role in enabling enterprise AI adoption by building secure, scalable, and governance-aligned architecture for Generative AI and Machine Learning solutions. This role is important because it helps ensure AI solutions are designed for production readiness, compliance, interoperability, and long-term business value across the organization.

What you will be responsible for

As an Artificial Intelligence & Machine Learning, Vice President, you will:

• Design end-to-end AI/ML and Generative AI solution architectures for enterprise use cases, including model integration, orchestration, APIs, data flows, and downstream system interactions.
• Define and implement reference architectures, architecture standards, and best practices for AI platforms and shared services.
• Collaborate with business stakeholders, product teams, data scientists, and engineering teams to convert business problems into scalable technical solutions.
• Lead architecture design for multi-cloud and hybrid AI environments, ensuring scalability, resiliency, security, and interoperability.
• Ensure solutions comply with Responsible AI, governance, data handling, testing, and risk management requirements.
• Drive POCs, architecture assessments, technical reviews, and production onboarding for AI applications and platforms.
• Partner with platform, cloud, security, and DevSecOps teams to ensure production readiness, observability, access control, and operational excellence.
• Establish reusable design patterns for prompt engineering, RAG, model serving, agentic workflows, and AI service integration where applicable.
• Support architecture governance forums and provide technical leadership on solution trade-offs, standards, and modernization opportunities.

What we value

These skills will help you succeed in this role:

• Strong critical thinking, problem-solving, and decision-making skills in complex enterprise AI environments.
• Deep hands-on expertise in Generative AI, LLMs, ML systems, RAG, vector databases, prompt design, and AI application integration.
• Strong knowledge of cloud platforms such as Azure, AWS, or GCP, including AI/ML services, storage, networking, and security.
• Expertise in designing scalable, secure, and resilient enterprise architectures for data- and AI-driven applications.
• Strong stakeholder management and cross-functional collaboration skills, with the ability to communicate complex technical concepts clearly to both technical and non-technical audiences.

Education & Preferred Qualifications

• BS, B-TECH, or Master's degree in Computer Science, Computer Information Systems, Engineering, or Mathematics.
• 10+ years of experience in solution architecture, enterprise application architecture, or AI/ML platform architecture.
• Strong understanding of DevSecOps, CI/CD, monitoring, observability, and platform engineering concepts.
• Expertise in API architecture, microservices, distributed systems, system integration, and event-driven architectures.
• Experience with AI governance, Responsible AI, model risk, compliance, testing, and production controls.

Additional requirements

• Experience in financial services or other highly regulated industries.
• Exposure to agentic AI frameworks, AI gateways, federated AI patterns, and enterprise AI shared services.
• Hands-on knowledge of Databricks, Kubernetes, container platforms, and MLOps tooling.
• Familiarity with document intelligence, workflow orchestration, and intelligent automation platforms.
• Experience with architecture governance boards, security reviews, and control frameworks.
• Certifications in cloud architecture, AI/ML, or enterprise architecture are a plus.
• Experience mentoring engineering teams and driving architecture adoption across large organizations.

Work Requirement

• Hybrid work requirement: To be updated based on role/location requirement
• Shift timings: To be specified

Salary Range:

$120,000 - $202,500 Annual
The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.