Seneca Holdings
Seneca Holdings
Seneca Holdings este brațul investițional al Națiunii Seneca, dezvoltând și administrând afaceri profitabile care consolidează autosuficiența economică pe termen lung a Națiunii. Portofoliul său diversificat include contracte cu guvernul federal, soluții de mediu și servicii de sănătate, punând accent pe oportunități sustenabile care sprijină comunitatea Seneca și generațiile viitoare.

Senior Data Engineer - Databricks and AWS (Remote)

Build scalable Databricks and AWS data pipelines for federal government contracting. Deliver analytics-ready data while meeting FISMA High and multi-tenant compliance standards.

Descriere

  • Build and maintain scalable data pipelines in an AWS-hosted Databricks E2 environment
  • Source data from relational databases, APIs, external providers, and real-time streams
  • Create pipelines that cleanse, transform, and aggregate data for analytics and reporting
  • Develop and manage Bronze, Silver, and Gold layers in a Databricks medallion architecture
  • Prepare source-to-target mappings and perform unit testing
  • Write advanced SQL aggregations and investigate data anomalies, quality problems, and inconsistencies
  • Implement real-time and near-real-time ingestion with AWS DMS and other AWS-native services
  • Develop processing solutions with Python or R, Spark, PySpark, and Pandas
  • Manage code, version control, and deployments through GitLab and CI/CD pipelines
  • Work with cross-functional teams in an Agile delivery environment
  • Maintain compliance with FISMA High and multi-tenant security, governance, and regulatory requirements
  • Use AI automation tools to support pipeline development, testing, validation, and delivery

Cerințe

  • Demonstrated hands-on experience as a Data Engineer or Databricks Developer building production data pipelines
  • Strong knowledge of Databricks on AWS, including E2 architecture, cluster configuration, job orchestration, and workspace administration
  • Practical experience using Apache Spark, PySpark, and Pandas for distributed data processing at scale
  • Strong Python programming ability; R experience is advantageous
  • Experience using Databricks Auto Loader for scalable incremental file ingestion
  • Hands-on experience with AWS Database Migration Service for change data capture and real-time replication
  • Strong command of Delta Lake and Delta tables, including schema evolution, time travel, OPTIMIZE, Z-ORDER, and VACUUM
  • Experience working with Amazon RDS and other relational sources in extraction and integration workflows
  • Advanced SQL expertise covering complex joins, window functions, aggregations, and query performance tuning
  • Understanding of medallion architecture and modern data lakehouse principles
  • Experience using GitLab and CI/CD pipelines for automated testing, builds, and deployment of data engineering code
  • Experience contributing to Agile or Scrum projects

Beneficii

  • Competitive compensation
  • Medical, dental, vision, life, and disability coverage
  • Optional critical illness, hospital, and accident coverage
  • Health savings and flexible spending accounts
  • 401(k) retirement plan
  • Paid leave programs
  • Flexible work-life balance
  • Professional development opportunities
  • Performance and recognition programs
  • Collaborative workplace
  • Financial and non-financial benefits for Seneca Nation members

Locuri de muncă similare

NationsBenefits

Senior Data Analyst | United States (Remote)

NationsBenefits

NationsBenefits is hiring a Senior Data Analyst to use advanced SQL and Databricks for product, program, and member analytics. The role supports better decisions across healthcare benefits, payment platforms, and engagement solutions.

Deschide
Instituto de Pesquisas Eldorado

Senior Data Analyst, Machine Learning – Hybrid Brazil

Instituto de Pesquisas Eldorado

Senior Data Analyst developing Machine Learning models and optimization solutions for advanced analytics, process improvement, and decision-making at Eldorado’s R&D center.

Deschide
Sierra Space

Configuration Management Analyst / Data Librarian - Centennial, CO

Sierra Space

Sierra Space is seeking an onsite Configuration Management Analyst / Data Librarian in Centennial to manage engineering records, databases, catalogs, and document version control for space and defense technology systems.

Deschide