AI Product Owner Jobs in Boston, MA

Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all.

Position Summary

Help shape how trustworthy AI is designed, evaluated, and communicated across athenahealth’s clinical products. The Senior Product Manager will lead the AI Trust & Transparency product area, developing evaluation, governance, and transparency capabilities that support safe, effective AI experiences for clinicians, administrators, clients, and prospects. This role is based in Boston, MA and operates in a hybrid work environment. This role reports to the Product Management Director within athenaClinicals.

About the Team

The Clinical Foundations team develops shared capabilities that support athenahealth’s electronic health record products and responsible use of AI in healthcare. The team manages the Clinical AI Feature Evaluation process, including evaluation methods, performance measures, governance practices, and publication of information about AI features. Team members partner with Product, Engineering, Design, Data Science, Patient Safety, Legal, Sales, Customer Success, and Product Marketing, while working with scrum teams in Boston and India. The team uses AI evaluation and observability platforms such as Arize and Kubeflow to assess solutions built with third-party large language models and internally developed machine learning models.

Essential Job Responsibilities

• Define the product vision, strategy, business cases, and multi-release roadmap for AI trust, evaluation, governance, and transparency capabilities.

• Translate clinician, administrator, client, and business needs into product requirements, including standards for accuracy, bias assessment, data quality, safety, and transparency.

• Lead the end-to-end product development lifecycle, including problem definition, requirements, user experience, objectives and key results, delivery, and measurement of customer and business outcomes.

• Serve as Product Owner for assigned scrum teams by defining epics and user stories, prioritizing the backlog, and making informed trade-offs among customer value, scope, timing, and technical constraints.

• Develop evaluation strategies and safe rollout approaches for AI features, including experiments, alpha testing, beta testing, and other validation methods when appropriate.

• Establish and monitor performance measures that provide visibility into product outcomes, risks, and opportunities for improvement.

• Partner with Product, Engineering, Design, Data Science, Patient Safety, Legal, and business leaders to align product decisions with healthcare safety, regulatory, and operational needs.

• Develop capabilities that clearly explain how AI features work, how they were developed and evaluated, and what evidence supports their appropriate use.

• Integrate AI-assisted research, analysis, requirements development, prototyping, and evaluation into product workflows; assess tool limitations and outputs, apply appropriate human review, and help team members use these methods responsibly.

• Evaluate market conditions, customer needs, product dependencies, and business value to guide prioritization and product investment decisions.

Additional Job Responsibilities

• Collaborate with Sales, Customer Success, and Product Marketing to develop clear customer-facing product information and service descriptions.

• Support product teams in applying shared AI evaluation tools and governance practices to their business areas.

• Share product management and responsible AI practices with colleagues through coaching, documentation, and working sessions.

• Contribute to planning and coordination across the broader Product Management organization.

Expected Education & Experience

• Required: At least 8 years of relevant professional experience, including 4 or more years in product management.

• Required: Practical experience with large language model evaluation methods, such as deterministic testing, model-based evaluation, human annotation workflows, and online evaluation.

• Required: Experience with machine learning evaluation, AI model documentation, or evaluation and observability platforms such as Arize, Datadog, LangSmith, or Braintrust.

• Required: Experience designing or managing responsible AI solutions in regulated or high-impact environments, including safety testing, hallucination risk management, bias evaluation, auditability, data lineage, or compliance.

• Required: Knowledge of modern AI systems and practices, including large language models, retrieval-augmented generation, AI agents, observability, evaluation pipelines, model governance, prompt design, explainability, traceability, and production AI operations.

• Required: Experience working with Agile or Scrum product development teams.

• Required: Ability to analyze complex problems, use qualitative and quantitative evidence, and develop scalable product solutions.

• Required: Clear written and verbal communication skills for working with customers, senior leaders, and cross-functional partners.

• Required: Experience testing product value in the market and using evidence to guide product vision and prioritization.

• Preferred: Knowledge of healthcare technology, electronic health records, or clinical workflows, along with experience using AI tools to draft requirements, synthesize user feedback, create specifications or prototypes, or analyze data with appropriate human review.

Expected Compensation

The base salary range shown reflects the full range for this role from minimum to maximum. At athenahealth, base pay depends on multiple factors, including job-related experience, relevant knowledge and skills, how your qualifications compare to others in similar roles, and geographical market rates. Base pay is only one part of our competitive Total Rewards package - depending on role eligibility, we offer both short and long-term incentives by way of an annual discretionary bonus plan, variable compensation plan, and equity plans.