Sigma Software Group
Sigma Software Group
Sigma Software Group ir 2002. gadā dibināts starptautisks tehnoloģiju konsultāciju uzņēmums. Tā komandas nodrošina programmatūras izstrādi, grafisko dizainu, testēšanu un tehnisko atbalstu klientiem, kas darbojas tādās nozarēs kā autobūve, veselības aprūpe, telekomunikācijas, aviācija, banku darbība, spēļu industrija, nekustamais īpašums un reklāma. Uzņēmums pieņem darbā IT speciālistus darbam pie sarežģītiem inženierijas projektiem un atbalsta profesionālo izaugsmi, izmantojot mentoringu un nepārtrauktu mācīšanos. Attālinātā darba iespējas ir daļa no uzņēmuma darba modeļa, un projekti tiek īstenoti tādām organizācijām kā AstraZeneca, Scania un SAS.

Senior Data Engineer, Databricks Migration

Migrate a large-scale retail analytics platform from BigQuery to Databricks, building Lakehouse architectures, Spark pipelines, and governed data solutions at Sigma Software Group.

Apraksts

  • Help migrate a large-scale analytics platform from BigQuery to Databricks.
  • Design and build scalable Lakehouse architectures with Databricks and Delta Lake.
  • Assess existing ETL and ELT workloads and define migration plans.
  • Develop and tune pipelines for high volumes of retail and analytical data.
  • Create incremental processing strategies and scalable transformation frameworks.
  • Build and maintain Spark data processing solutions with PySpark.
  • Design and maintain Bronze, Silver, and Gold layers in the medallion architecture.
  • Apply data governance and security practices with Unity Catalog.
  • Work with Data Science, Analytics, Product, and Customer Engineering teams.
  • Contribute to architecture discussions and technical solution design.
  • Create reusable data platform components and engineering standards.
  • Review code and improve platform reliability and maintainability.
  • Diagnose and optimize complex SQL and Spark workloads.
  • Support production releases and platform modernization.

Prasības

  • At least five years of professional data engineering experience.
  • Strong Python skills and advanced SQL proficiency.
  • Commercial, hands-on experience with Databricks.
  • Strong Apache Spark knowledge, especially PySpark.
  • Experience designing and building modern cloud data platforms.
  • Experience developing ETL or ELT pipelines and large-scale data processing solutions.
  • Hands-on experience with Delta Lake.
  • Experience with Spark Declarative Pipelines.
  • Experience monitoring clusters, analyzing metrics, and optimizing performance.
  • Strong understanding of distributed data processing architectures.
  • Sound knowledge of data warehousing and dimensional modeling.
  • Experience with Airflow or a similar orchestration tool.
  • Experience tuning complex analytical SQL workloads.
  • Experience implementing CI/CD practices for data engineering platforms.
  • Strong troubleshooting and performance optimization skills.
  • Ability to collaborate with cross-functional teams across international settings.
  • Upper-intermediate English or higher.

Priekšrocības

  • Ongoing opportunities to learn.
  • Opportunities to grow your technology expertise.
  • Meaningful impact through engineering work.
  • Work on complex international projects.

Saistītās vakances

Presidio

Director of Sales Compensation at Presidio (Remote, Ireland)

Presidio

Lead Presidio’s sales compensation programs, including incentive plan design, commission operations, analytics, and compliance. The role oversees a commissions team and partners with Sales, Finance, HR, and Sales Operations.

Atvērt
Biogen

Senior Associate, Sales Force Effectiveness — Biogen, Madrid (Hybrid)

Biogen

Support commercial excellence at Biogen by improving sales targets, incentives, CRM, analytics and omnichannel execution. The Madrid-based role focuses on field-force productivity and biotechnology medicines.

Atvērt