Capital One
Capital One
Capital One is a financial services and fintech company offering credit cards, auto loans, banking, and savings products. Its work combines financial expertise with technology and digital tools to improve how customers manage money. The company’s careers focus includes building customer-oriented solutions within a diverse and inclusive workforce.

AI Engineer 5, Agentic AI Platforms at Capital One

Build and optimize production services for agentic AI, large language models, and generative AI at Capital One. Work on model orchestration, governance, and infrastructure for banking applications.

Description

  • Collaborate with engineering, research, program, and product teams to deliver AI-powered products.
  • Build and support AI components spanning foundation model training, LLM inference, agent workflows, search, guardrails, evaluation, governance, and monitoring.
  • Apply open-source and SaaS tools such as AWS Ultraclusters, Hugging Face, vector databases, and PyTorch.
  • Develop foundation model optimizations that improve production system scale, cost, latency, and throughput.
  • Help set the technical direction and long-term roadmap for foundational AI systems.
  • Build and tune orchestration pipelines that combine LLMs, vector search, and domain-specific models.
  • Lead cost and performance reviews of GPU use, model throughput, and inference efficiency.
  • Guide design reviews to promote technical consistency and meet AI engineering standards.
  • Mentor Principal- and Manager-level AI engineers and encourage learning across domains.

Requirements

  • Bachelor’s degree in computer science, AI, electrical engineering, computer engineering, or a related field and at least 6 years developing AI or ML algorithms or technologies; alternatively, a relevant master’s degree and at least 4 years of that experience.
  • At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
  • Preferred: Experience leading AI system development and making tradeoffs among cost, latency, throughput, and accuracy.
  • Preferred: At least 7 years deploying scalable, responsible AI solutions on cloud platforms.
  • Preferred: Experience designing, building, delivering, and supporting complex AI systems.
  • Preferred: Experience with LLM inference, similarity search, vector databases, guardrails, and memory.
  • Preferred: Experience optimizing training and inference software for hardware use, latency, throughput, and cost.
  • Preferred: Experience building agentic AI systems and workflows.
  • Preferred: Experience architecting heterogeneous AI systems and unified production pipelines.
  • Preferred: Experience defining and enforcing standards for ethical AI deployment.
  • Preferred: Ability to balance model performance and operating costs with dynamic inference strategies and model compression.
  • Preferred: Experience selecting appropriate model sizes, instance counts, and hardware types.
  • Enthusiasm for AI research and putting novel techniques into production.
  • Strong grounding in engineering and mathematics.
  • Capital One will consider employment authorization sponsorship for a new qualified applicant.

Benefits

  • Performance-based incentive compensation, which may include cash bonuses and/or long-term incentives.
  • Comprehensive, competitive, inclusive health, financial, and other benefits to support overall well-being.
  • Consideration of employment authorization sponsorship for a new qualified applicant.
  • Reasonable accommodations for applicants who need them.
  • Drug-free workplace.

Related Jobs

Bank of America

Senior Cyber Threat Defense AI/ML Engineer

Bank of America

Build AI and machine learning defenses for Bank of America’s cybersecurity operations, using models, LLMs, and agentic systems. Develop threat hunting, anomaly detection, and automated incident response capabilities.

Open
Capital One

Capital One AI Engineer, Agentic AI and MLX Platform Services

Capital One

Build foundation models, agentic workflows, and generative AI platform services for Capital One products. Improve the scalability and production performance of AI systems serving banking customers.

Open