Capital One
Capital One
Capital One is a financial services and fintech company offering credit cards, auto loans, banking, and savings products. Its work combines financial expertise with technology and digital tools to improve how customers manage money. The company’s careers focus includes building customer-oriented solutions within a diverse and inclusive workforce.

AI Engineer 4, Generative AI Platform Services – Capital One (Onsite, San Francisco)

Build agentic AI platforms, guardrails, evaluation systems, and memory capabilities at Capital One. Improve the scalability, reliability, and responsible operation of AI infrastructure for banking products.

Description

  • Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
  • Create, test, deploy, and maintain AI components spanning foundation-model training, LLM inference, agent workflows, similarity search, guardrails, evaluation, experimentation, governance, and observability
  • Use open-source and SaaS AI technologies, including AWS Ultraclusters, Hugging Face, vector databases, and PyTorch
  • Develop foundation-model optimization methods that improve the scalability, cost efficiency, latency, and throughput of production AI systems
  • Help shape the technical direction and long-term roadmap for foundational AI systems
  • Take ownership of end-to-end architecture for complex AI systems, with emphasis on maintainability, observability, and ethical alignment
  • Establish and manage AI reliability SLOs covering latency, availability, and model-performance drift
  • Work with infrastructure engineers to improve GPU and TPU utilization and speed up model-inference pipelines
  • Lead deployment reviews for AI systems, verifying security, data-governance, and compliance requirements
  • Coach Principal and Senior Associates in scalable architecture, performance optimization, and moving research into production

Requirements

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field with at least 4 years of experience developing AI or ML algorithms and technologies, or a relevant master’s degree with at least 2 years of such experience
  • At least 4 years of programming experience using Python, Go, Scala, CUDA, or Java
  • Experience leading AI-system development while balancing cost, latency, throughput, and accuracy
  • Experience deploying scalable, responsible AI solutions on cloud platforms
  • Background designing, developing, delivering, and supporting AI services
  • Experience developing AI or ML algorithms and technologies with Python, C++, C#, Java, CUDA, or Golang
  • Experience optimizing training and inference software for hardware utilization, latency, throughput, and cost
  • Experience building agentic AI systems and workflows
  • Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale
  • Experience establishing AI model-governance processes covering producibility, lineage tracking, and automated retraining schedules
  • Ability to influence architecture across multiple AI product lines or platforms
  • Ability to work in the United States; Capital One may consider employment-authorization sponsorship for a new qualified applicant

Benefits

  • Performance-based incentive compensation may include cash bonuses and/or long-term incentives
  • Comprehensive and competitive health, financial, and other benefits designed to support overall well-being
  • Employment-authorization sponsorship may be considered for a new qualified applicant

Related Jobs

Advocate Aurora Health

Human Resources Internship

Advocate Aurora Health

Support recruiting, onboarding, employee engagement, and HR operations at Advocate Aurora Health. Build practical experience with HR systems, reporting, and process improvement in a remote internship.

Open