Booz Allen Hamilton
Booz Allen Hamilton
Booz Allen Hamilton is a management and technology consulting company serving government and commercial clients with advanced technical and strategic expertise. Its work spans national security, defense, intelligence, civil government, and critical infrastructure, bringing together teams focused on artificial intelligence, cybersecurity, cloud computing, digital transformation, engineering, and mission and operations support. The company is particularly engaged in complex, high-assurance challenges for military, intelligence, and federal agencies, alongside selected commercial sectors.

Senior Lead Data Engineer, Databricks

Lead the development of scalable Databricks data pipelines and models on AWS for Booz Allen Hamilton government clients. Guide technical teams and support secure data processing through hands-on leadership and mentoring.

Description

  • Build and maintain reliable data pipelines in Databricks.
  • Develop and refine end-to-end data flows.
  • Manage extract, transform, and load (ETL) operations.
  • Create data models, schemas, and efficient data structures.
  • Protect data and support compliance requirements.
  • Work with teams across disciplines.
  • Improve data processing speed and scalability over time.
  • Lead and mentor analysts, data engineers, developers, and data consumers.
  • Direct the evaluation, design, development, and upkeep of scalable client platforms.
  • Explore and examine data to produce actionable insights.

Requirements

  • At least 8 years of experience designing, developing, deploying, and managing ETL processes and data pipelines with comprehensive logging and robust error handling.
  • At least 3 years of experience building, debugging, and optimizing data pipelines with Databricks notebooks, clusters, and job orchestration tools.
  • Experience with Delta Lake, Databricks Delta, and Unity Catalog.
  • At least 3 years of experience writing Python and PySpark for ETL scripts and custom transformations.
  • Experience creating dimensional and relational data models in a medallion architecture.
  • Experience with AWS Glue, Amazon S3, and Amazon RDS.
  • Knowledge of ETL performance optimization, including partitioning, bucketing, and caching.
  • Ability to design data models from schema definition through data structure optimization.
  • Public Trust.
  • Bachelor’s degree in Computer Science, Computer Engineering, Engineering, Mathematics, Physics, Information Systems, or Information Technology.
  • Selected applicants will undergo a government investigation and may need to satisfy eligibility requirements set by the U.S. government client.
  • A Public Trust determination is required.

Benefits

  • Health coverage.
  • Life insurance benefits.
  • Disability benefits.
  • Financial benefits.
  • Retirement benefits.
  • Paid leave.
  • Professional development opportunities.
  • Tuition assistance.
  • Work-life programs.
  • Dependent care benefits.
  • Recognition awards for exceptional performance and strong demonstration of company values.