Sigma Software Group
Sigma Software Group
Sigma Software Group este o companie multinațională de consultanță tehnologică, fondată în 2002. Echipele sale oferă servicii de dezvoltare software, design grafic, testare și asistență tehnică pentru clienți din sectoare precum industria auto, sănătatea, telecomunicațiile, aviația, sectorul bancar, jocurile, imobiliarele și publicitatea. Compania recrutează specialiști IT pentru a lucra la proiecte complexe de inginerie și sprijină dezvoltarea profesională prin mentorat și învățare continuă. Oportunitățile de lucru la distanță fac parte din modelul său de lucru, iar proiectele deservesc organizații precum AstraZeneca, Scania și SAS.

Senior Data Engineer, Databricks Migration

Migrate a large-scale retail analytics platform from BigQuery to Databricks, building Lakehouse architectures, Spark pipelines, and governed data solutions at Sigma Software Group.

Descriere

  • Help migrate a large-scale analytics platform from BigQuery to Databricks.
  • Design and build scalable Lakehouse architectures with Databricks and Delta Lake.
  • Assess existing ETL and ELT workloads and define migration plans.
  • Develop and tune pipelines for high volumes of retail and analytical data.
  • Create incremental processing strategies and scalable transformation frameworks.
  • Build and maintain Spark data processing solutions with PySpark.
  • Design and maintain Bronze, Silver, and Gold layers in the medallion architecture.
  • Apply data governance and security practices with Unity Catalog.
  • Work with Data Science, Analytics, Product, and Customer Engineering teams.
  • Contribute to architecture discussions and technical solution design.
  • Create reusable data platform components and engineering standards.
  • Review code and improve platform reliability and maintainability.
  • Diagnose and optimize complex SQL and Spark workloads.
  • Support production releases and platform modernization.

Cerințe

  • At least five years of professional data engineering experience.
  • Strong Python skills and advanced SQL proficiency.
  • Commercial, hands-on experience with Databricks.
  • Strong Apache Spark knowledge, especially PySpark.
  • Experience designing and building modern cloud data platforms.
  • Experience developing ETL or ELT pipelines and large-scale data processing solutions.
  • Hands-on experience with Delta Lake.
  • Experience with Spark Declarative Pipelines.
  • Experience monitoring clusters, analyzing metrics, and optimizing performance.
  • Strong understanding of distributed data processing architectures.
  • Sound knowledge of data warehousing and dimensional modeling.
  • Experience with Airflow or a similar orchestration tool.
  • Experience tuning complex analytical SQL workloads.
  • Experience implementing CI/CD practices for data engineering platforms.
  • Strong troubleshooting and performance optimization skills.
  • Ability to collaborate with cross-functional teams across international settings.
  • Upper-intermediate English or higher.

Beneficii

  • Ongoing opportunities to learn.
  • Opportunities to grow your technology expertise.
  • Meaningful impact through engineering work.
  • Work on complex international projects.

Locuri de muncă similare

Columbus

D365 CE / CRM Techno-Functional Consultant

Columbus

As a techno-functional consultant at Columbus, you’ll deliver customer engagement solutions using Microsoft Dynamics and Power Platform. The role covers solution design, implementation, and customer training.

Deschide
Columbus

D365 CE/CRM Techno-Functional Consultant

Columbus

Deliver Microsoft Dynamics 365 Customer Engagement and Power Platform solutions for Columbus, a global digital consultancy. Design and implement customer solutions, and provide tailored training.

Deschide
Columbus

Senior D365 CE/CRM Techno-Functional Consultant

Columbus

Deliver Microsoft Dynamics 365 Customer Engagement solutions at Columbus, a global digital consultancy. Shape technical designs, build plugins and support customer project delivery in a hybrid UK role.

Deschide