Sigma Software Group
Sigma Software Group
Sigma Software Group — 2002 жылы құрылған көпұлтты технологиялық консалтинг компаниясы. Оның командалары автомобиль жасау, денсаулық сақтау, телекоммуникациялар, авиация, банк ісі, ойын индустриясы, жылжымайтын мүлік және жарнама сияқты салалардағы клиенттерге бағдарламалық жасақтама әзірлеу, графикалық дизайн, тестілеу және техникалық қолдау қызметтерін көрсетеді. Компания күрделі инженерлік жобаларда жұмыс істеу үшін IT мамандарын жұмысқа қабылдайды және тәлімгерлік пен үздіксіз оқу арқылы кәсіби дамуды қолдайды. Қашықтан жұмыс істеу мүмкіндіктері компанияның жұмыс үлгісінің бір бөлігі болып табылады, ал жобалары AstraZeneca, Scania және SAS сияқты ұйымдарға қызмет көрсетеді.

Senior Data Engineer, Databricks Migration

Migrate enterprise retail analytics from BigQuery to Databricks Lakehouse, building scalable PySpark pipelines, medallion architecture, and governed cloud data platforms.

Сипаттама

  • Help migrate a large-scale analytics platform from BigQuery to Databricks.
  • Design and build scalable Lakehouse architectures with Databricks and Delta Lake.
  • Assess existing ETL and ELT workloads and define migration approaches.
  • Build and optimize pipelines for large volumes of retail and analytical data.
  • Implement incremental processing strategies and scalable transformation frameworks.
  • Develop and maintain Spark data processing solutions using PySpark.
  • Design and maintain Bronze, Silver, and Gold medallion layers.
  • Apply data governance and security practices using Unity Catalog.
  • Work with Data Science, Analytics, Product, and Customer Engineering teams.
  • Contribute to architecture discussions and technical solution design.
  • Create reusable data platform components and engineering standards.
  • Review code and improve platform reliability and maintainability.
  • Troubleshoot and optimize complex SQL and Spark workloads.
  • Support production deployments and platform modernization.

Талаптар

  • Bring at least five years of professional Data Engineer experience.
  • Have strong Python programming skills and advanced SQL proficiency.
  • Have commercial, hands-on experience with Databricks.
  • Know Apache Spark well, particularly PySpark.
  • Have experience designing and building modern cloud data platforms.
  • Have experience developing ETL and ELT pipelines and large-scale data processing solutions.
  • Have hands-on experience with Delta Lake.
  • Have experience with Spark Declarative Pipelines.
  • Have experience monitoring clusters, analyzing metrics, and optimizing performance.
  • Understand distributed data processing architectures.
  • Understand data warehousing concepts and dimensional modeling.
  • Have experience with Airflow or a comparable orchestration tool.
  • Have experience optimizing complex analytical SQL workloads.
  • Have experience applying CI/CD practices to data engineering platforms.
  • Be skilled at troubleshooting and performance optimization.
  • Work effectively with cross-functional, international teams.
  • Have Upper-Intermediate English proficiency or higher.

Артықшылықтар

  • Remote work is available to employees.
  • Continuous learning opportunities.
  • Opportunities to grow with technology.
  • Meaningful impact through engineering work.
  • Work on complex international projects.

Ұқсас жұмыс орындары

Intetics

Senior Data Architect (French-Speaking)

Intetics

Shape scalable data architecture and SQL Server platforms for Intetics. The role covers data governance, REST integrations, and delivery testing.

Ашу
Sedona Digital

Senior Data Engineer, Romania Remote | Sedona Digital

Sedona Digital

Build and support PySpark, SQL, and Databricks data platforms for Sedona Digital’s insurance-sector clients. Work on pipelines, reconciliation, data quality, and cloud data solutions.

Ашу
Intetics

ML Data Engineer, Romania Remote

Intetics

Build real-time, graph, and time-series data infrastructure for athlete performance. Support machine learning evaluation and AI systems for an Intetics customer in the United States.

Ашу
AllCloud

Hebrew-Speaking Data Engineer

AllCloud

Build AWS lakehouse platforms, data pipelines, and AI solutions for AllCloud’s cloud consulting clients. Design scalable architectures and help customers modernize their data systems.

Ашу
Globaldev Group

Remote Backend Data Engineer – Ukraine

Globaldev Group
201 – 500 Қызметкерлер
SaaSКонсалтингЛогистика

Build scalable data pipelines, models, and backend infrastructure for evolving data products. Work with dbt, Snowflake, Databricks, orchestration platforms, and GenAI engineering tools.

Ашу