Capital One
Capital One
Capital One is a financial services and fintech company offering credit cards, auto loans, banking, and savings products. Its work combines financial expertise with technology and digital tools to improve how customers manage money. The company’s careers focus includes building customer-oriented solutions within a diverse and inclusive workforce.

Data Engineer - Capital One (New York, Onsite)

Lead cross-cloud migration work for Capital One’s Travel Data team. Build Python, Spark, and Databricks pipelines that support personalized travel experiences.

Description

  • Partner with Agile teams to design, develop, test, implement, and support technical solutions
  • Guide developers, data analysts, and data scientists across machine learning, distributed microservices, lakehouse architecture, and full-stack systems
  • Work with Python, Spark, relational and NoSQL databases, and cloud warehouses such as Databricks and Snowflake
  • Track data engineering trends, evaluate emerging technologies, contribute to technology communities, and mentor data professionals
  • Work with product managers and software engineers to deliver cloud-first data capabilities
  • Independently design, build, and deliver cloud data applications and solutions
  • Establish and apply engineering patterns that improve code quality, maintainability, and reuse
  • Explain technical concepts and data results to internal and external stakeholders
  • Build scalable, resilient, and operationally efficient data pipelines and platforms
  • Apply data security practices including encryption and fine-grained access controls
  • Own important components of a large-scale cross-cloud migration for the Travel Data team
  • Consolidate multi-cloud data in a central lake using Python, Spark, and Databricks
  • Support real-time personalized recommendations, targeted travel offers, and intelligent user benefits

Requirements

  • Bachelor’s degree or higher in computer science or a related quantitative discipline
  • At least four years of application development experience, excluding internships
  • At least two years of experience working with distributed data
  • At least two years of SQL experience
  • At least two years of experience with Python, Java, or Scala
  • At least two years of data pipeline design and development experience
  • At least one year of experience modeling data and designing end-to-end solutions with relational and non-relational databases
  • New applicants are not eligible for employer-sponsored immigration or work authorization support
  • Preferred: seven or more years of application development experience
  • Preferred: four or more years designing, deploying, and operating workloads in a public cloud
  • Preferred: four or more years building or supporting distributed data or compute workloads with EMR, Spark, Glue, or Databricks
  • Preferred: four or more years designing, implementing, and operating real-time or streaming data pipelines
  • Preferred: two or more years using data observability or orchestration tools such as Monte Carlo, Splunk, Airflow, or Dagster
  • Preferred: four or more years working with unstructured or semistructured data in NoSQL databases
  • Preferred: four or more years designing and supporting data warehouse solutions
  • Preferred: two or more years in an Agile development environment
  • Preferred: two or more years developing reusable, user-focused data products

Benefits

  • Performance-based incentive compensation may include cash bonuses and/or long-term incentives
  • Comprehensive, competitive health, financial, and other benefits designed to support overall well-being
  • Reasonable accommodations are available for applicants with disabilities

Related Jobs