Sigma Software Group
Sigma Software Group
Sigma Software Group je večnacionalno tehnološko svetovalno podjetje, ustanovljeno leta 2002. Njegove ekipe zagotavljajo razvoj programske opreme, grafično oblikovanje, testiranje in tehnično podporo strankam v panogah, kot so avtomobilska industrija, zdravstvo, telekomunikacije, letalstvo, bančništvo, igre, nepremičnine in oglaševanje. Podjetje zaposluje strokovnjake za IT za delo na kompleksnih inženirskih projektih ter podpira poklicni razvoj z mentorstvom in nenehnim učenjem. Delo na daljavo je del njegovega delovnega modela, projekti pa služijo organizacijam, kot so AstraZeneca, Scania in SAS.

Senior Data Engineer, Databricks Migration

Migrate a large-scale retail analytics platform from BigQuery to Databricks, building Lakehouse architectures, Spark pipelines, and governed data solutions at Sigma Software Group.

Opis

  • Help migrate a large-scale analytics platform from BigQuery to Databricks.
  • Design and build scalable Lakehouse architectures with Databricks and Delta Lake.
  • Assess existing ETL and ELT workloads and define migration plans.
  • Develop and tune pipelines for high volumes of retail and analytical data.
  • Create incremental processing strategies and scalable transformation frameworks.
  • Build and maintain Spark data processing solutions with PySpark.
  • Design and maintain Bronze, Silver, and Gold layers in the medallion architecture.
  • Apply data governance and security practices with Unity Catalog.
  • Work with Data Science, Analytics, Product, and Customer Engineering teams.
  • Contribute to architecture discussions and technical solution design.
  • Create reusable data platform components and engineering standards.
  • Review code and improve platform reliability and maintainability.
  • Diagnose and optimize complex SQL and Spark workloads.
  • Support production releases and platform modernization.

Zahteve

  • At least five years of professional data engineering experience.
  • Strong Python skills and advanced SQL proficiency.
  • Commercial, hands-on experience with Databricks.
  • Strong Apache Spark knowledge, especially PySpark.
  • Experience designing and building modern cloud data platforms.
  • Experience developing ETL or ELT pipelines and large-scale data processing solutions.
  • Hands-on experience with Delta Lake.
  • Experience with Spark Declarative Pipelines.
  • Experience monitoring clusters, analyzing metrics, and optimizing performance.
  • Strong understanding of distributed data processing architectures.
  • Sound knowledge of data warehousing and dimensional modeling.
  • Experience with Airflow or a similar orchestration tool.
  • Experience tuning complex analytical SQL workloads.
  • Experience implementing CI/CD practices for data engineering platforms.
  • Strong troubleshooting and performance optimization skills.
  • Ability to collaborate with cross-functional teams across international settings.
  • Upper-intermediate English or higher.

Ugodnosti

  • Ongoing opportunities to learn.
  • Opportunities to grow your technology expertise.
  • Meaningful impact through engineering work.
  • Work on complex international projects.

Sorodna delovna mesta

R-Zero

Staff Analytics Engineer, Building Energy Systems

R-Zero
51 – 200 Zaposleni
LogistikaSvetovanjeTrženje

Staff Analytics Engineer validating building performance findings, energy savings, and HVAC controls for R-Zero’s smart-building platform. Develops measurement and verification methods and BACnet-based automation for commercial buildings.

Odpri
Alteryx

Finance Analytics Engineering Manager, Automation

Alteryx

Lead finance analytics engineering at Alteryx, building governed Snowflake data products and automated workflows. Partner with FP&A and Data Engineering to deliver reliable, controlled decision support.

Odpri
Airbnb

Analytics Infrastructure Software Engineer (Remote, Brazil) at Airbnb

Airbnb

Build Airbnb’s analytics infrastructure, including Apache Superset, notebooks, and AI-powered data tools. Connect analytics products to Airbnb’s data platform and contribute to the open-source ecosystem.

Odpri