The Hartford
The Hartford
The Hartford is an insurance and financial services company serving individuals, families, and small to midsize businesses. Founded in 1810, it provides auto, home, and business insurance alongside employee benefits and other insurance solutions. The company is also known for its AARP-endorsed auto and home insurance programs, which provide participating members with access to exclusive benefits and discounts.

Senior Analyst, Model Risk and Generative AI Validation

Validate generative and agentic AI models supporting The Hartford’s insurance operations. Build testing frameworks, assess model risk, and communicate validation findings.

Description

  • Validate generative AI and agentic AI use cases across business functions and lines of business
  • Confirm that model calculations, algorithms, and methodologies are accurate and fit for their intended purposes
  • Develop challenger solutions and testing methods for summarization, question answering, search, data synthesis, LLM-as-a-judge, and related applications
  • Evaluate quantitative and qualitative techniques for measuring model accuracy, robustness, and reliability
  • Review data inputs, assumptions, prompt engineering, and context engineering practices
  • Create and run tests for non-deterministic AI systems using variability analysis, confidence intervals, and statistical evaluation methods
  • Challenge model inputs, calculations, outputs, conceptual soundness, monitoring, controls, and documentation
  • Document findings and recommendations, analyze their impact, and prepare model validation reports
  • Handle governance responsibilities involving findings tracking, remediation testing, and validation activities
  • Advance the generative AI validation framework through standardized metrics and validation tools
  • Collaborate with Data Science teams to align model risk practices with evolving modeling capabilities and support proactive risk management
  • Monitor developments in AI/ML, generative AI, agentic systems, regulatory expectations, and department initiatives
  • Help evaluate and test tools including Vertex AI/Google ADK, LangChain/LangGraph, RAG frameworks, Hugging Face, and OpenAI APIs
  • Evaluate solutions against AI Governance standards, Model Risk Management policies, and emerging regulatory expectations

Requirements

  • Advanced degree, such as an M.S. or Ph.D., in Artificial Intelligence, Machine Learning, Computational Science, Engineering, Statistics, Applied Mathematics, Actuarial Science, Computer Science, Quantitative Economics, or a related field
  • At least 3 years of industry experience in machine learning or data science, including at least 1 year focused on generative AI or agentic AI
  • Experience with P&C, Group, Life, or related insurance products is a plus
  • Strong programming and technology skills with Python, SQL, and Git
  • Sound knowledge of generative AI concepts, including prompt and context engineering, retrieval-augmented generation, LLM internals, LLM evaluation, and multi-agent systems
  • Experience using modern cloud and AI platforms such as GCP/Vertex AI, Google uAgent Development Kit (ADK), AWS/SageMaker, LangChain/LangGraph, Hugging Face, and OpenAI APIs
  • Ability to work independently, take proactive ownership, meet deadlines, and adapt to changing priorities
  • Strong analytical, critical-thinking, and investigative abilities
  • Commitment to ongoing learning and development as modeling methods and AI technologies evolve
  • Creative, solution-focused approach with innovative thinking and a willingness to challenge established practices
  • Excellent communication and collaboration skills, including the ability to explain complex technical concepts to non-technical stakeholders

Benefits

  • Short-term or annual bonus opportunities
  • Long-term incentives
  • On-the-spot recognition
  • Perks and benefits; details were not specified

Related Jobs

Hewlett Packard Enterprise

Senior Channel Presales Technical Architect, Storage — HPE Canada Remote

Hewlett Packard Enterprise

Help HPE channel partners position, design, and sell storage and data protection solutions. Support solution architecture, demonstrations, proofs of concept, pipeline development, and partner technical advocacy.

Open