ClickBus
ClickBus
ClickBus este o platformă de călătorii care îi ajută pe oameni să caute și să cumpere bilete de autobuz interurban în Brazilia și America Latină. Site-ul și aplicația sa mobilă conectează călătorii cu peste 200 de companii de autobuze și mai mult de 4.800 de destinații, iar funcții precum ClickOferta și metodele multiple de plată răspund diferitelor nevoi de rezervare. Compania se concentrează pe simplificarea planificării și achiziționării călătoriilor lungi cu autobuzul prin intermediul unei platforme digitale.

Mid-Level Data Engineer at ClickBus

Build and optimize batch and streaming data pipelines for ClickBus’s bus-ticket marketplace. Work with AWS, Spark, Airflow, dbt, and data quality practices to improve performance, cost, and reliability.

Descriere

  • Build, maintain, and improve batch and streaming pipelines with Airflow on EKS, EMR/Spark, and dbt
  • Create ingestion processes for DMS, APIs, files, and events while organizing data across Data Lake layers
  • Diagnose and resolve pipeline incidents, including DAG failures, processing errors, inconsistent metrics, and schema problems
  • Perform root-cause analyses and recommend changes that prevent repeated failures
  • Maintain data quality through automated testing, validation checks, and reconciliation processes
  • Develop and tune Spark and dbt transformations for better performance and cost control
  • Optimize Athena queries and dbt models to lower processing costs and improve response times
  • Implement append, overwrite, and merge/upsert incremental loads with consistent, idempotent processing
  • Contribute technical improvements and standardization as the data architecture evolves
  • Review code and apply sound practices for version control and technical documentation
  • Partner with business teams to confirm that delivered data satisfies functional needs
  • Monitor pipeline runs and identify opportunities for ongoing improvement

Cerințe

  • Proven experience working as a Data Engineer in a cloud-based environment
  • Hands-on experience building and operating production data pipelines
  • Background troubleshooting and resolving data incidents
  • Experience designing analytical models with fact and dimension tables
  • Knowledge of incremental loading strategies and data partitioning
  • Working knowledge of AWS services including S3, Athena, IAM, and Glue Catalog; EMR is advantageous
  • Experience creating and maintaining Airflow DAGs
  • Practical PySpark expertise, including joins, partitioning, and basic performance tuning
  • Experience with dbt modeling, incremental models, and testing
  • Advanced SQL proficiency
  • Python programming skills
  • Git experience

Beneficii

  • BRL 1,100 monthly meal or food allowance provided through a Flash card
  • BRL 149 monthly home-office allowance provided through a Flash card
  • BRL 200 monthly flexible-benefits allowance provided through a Flash card
  • Busonauta Viajante benefit of BRL 2,000 per year for bus-ticket purchases through the app or website
  • Transportation allowance
  • Parking benefit
  • SulAmérica health insurance with no copayments or monthly premium
  • Bradesco dental insurance
  • Childcare assistance for mothers and fathers
  • Six months of maternity leave and 30 days of paternity leave
  • Life insurance
  • Wellhub and TotalPass access
  • Annual profit-sharing bonus
  • Birthday day off
  • Petlove partnership
  • Pharmacy assistance
  • Support for children with disabilities
  • Partnerships with educational and leisure institutions

Locuri de muncă similare

Whitespace

Software Engineer - Population Simulation | Remote, United States

Whitespace

Build population-simulation solutions for GeoDelphi’s Answers platform, developing Java and Python systems across backend engineering, databases, DevOps, and cloud technologies.

Deschide
Ellipsis Health

Senior Director of Marketing at Ellipsis Health — California Remote

Ellipsis Health

Lead Ellipsis Health’s marketing strategy for its AI-powered healthcare platform and enterprise growth. Oversee brand, demand generation, content, analytics, positioning, and pipeline development.

Deschide
Highmark Health

Business Systems Analyst at Highmark Health

Highmark Health

Support application lifecycle management, requirements analysis, testing, and Agile delivery for Highmark Health’s health insurance business, enGen. Partner with customers and technical teams to develop reliable business capabilities and solutions.

Deschide