Senior Data Engineer, Databricks Migration
Sigma Software GroupMigrate enterprise retail analytics from BigQuery to Databricks Lakehouse, building scalable PySpark pipelines, medallion architecture, and governed cloud data platforms.
Ашу
Sedona Digital — денсаулық сақтау және логистика сияқты салалардағы ұйымдарға қызмет көрсететін, үдерістерге негізделген технологиялық консалтинг компаниясы. Оның қызметтері технологиялық стратегияны, деректер архитектурасы мен инженериясын, жасанды интеллект пен болжамды талдауды, бағдарламалық өнім әзірлеуді, қолданбаларды жаңғыртуды, бұлтқа көшіруді, Azure басқарылатын қызметтерін, DevOps және CI/CD бағыттарын қамтиды. Компания сондай-ақ бұлттық қауіпсіздік, басқарылатын SOC операциялары және үздіксіз сәйкестік салаларында қолдау көрсетіп, кәсіпорындарға деректерге негізделген, бұлттық технологиялық орталарды құруға, басқаруға және қорғауға көмектеседі.
Senior Data Engineer, Romania Remote | Sedona Digital
Build and support PySpark, SQL, and Databricks data platforms for Sedona Digital’s insurance-sector clients. Work on pipelines, reconciliation, data quality, and cloud data solutions.
Сипаттама
- Evaluate and rebuild ingestion pipelines for operational and source-system data.
- Design data mappings, lineage, dependencies, and controlled migration and cutover plans.
- Create and maintain detailed data reconciliation processes.
- Improve PySpark data processing and hierarchy and roll-up capabilities.
- Add testing, versioning, metadata, observability, and deployment controls.
- Work with business and technical specialists to improve data coverage.
- Evaluate GCP data pipeline options and help implement them.
- Explore sourcing mappings and reference data directly from systems such as Microsoft Dynamics 365.
- Support changes to reporting hierarchies and filtering logic, including impact assessment, testing, and reconciliation.
- Create and maintain automated data-quality checks, monitoring, and operational controls.
- Help teams adopt centralised reporting and data capabilities.
- Prepare technical documentation, decision records, reconciliation evidence, variance explanations, and handover materials.
- Deliver work through a prioritised backlog and short iterative sprints with engineers and stakeholders.
Талаптар
- At least five years of professional experience in data engineering or a closely related data role, including substantial hands-on work building and supporting production data solutions.
- Strong practical experience with PySpark, SQL, and Databricks, including developing and supporting production-grade data pipelines.
- Hands-on experience with GCP data technologies and pipelines.
- Experience testing and optimising data pipelines and supporting their operation.
- Strong experience modelling dimensional, master/reference, or hierarchical data.
- Experience implementing complex entity matching, data mappings, and roll-up logic with appropriate traceability.
- Practical experience implementing automated data-quality checks and reconciliation processes.
- Experience with observability, audit history, version control, and CI/CD in data engineering solutions.
- Experience assessing source-system data and documenting data contracts, mappings, lineage, and dependencies.
- Experience managing controlled data pipeline or platform transitions.
- Ability to investigate data issues and explain differences in values, record counts, mappings, and hierarchy outcomes clearly.
- Ability to work directly with platform teams, analysts, and business specialists, turning ambiguous reporting and mapping needs into tested engineering solutions.
- Strong communication skills and the ability to prepare concise technical documentation, decision records, variance explanations, and handover materials.
- Self-directed and comfortable working in a collaborative, iterative delivery environment.
- Preferred: Experience in insurance, the London Market, reinsurance, brokerage, distribution, or policy-level data environments.
- Preferred: Experience integrating Microsoft Dynamics 365 or similar operational source systems.
- Preferred: Experience with Power BI, including semantic models and reporting dependencies.
- Preferred: Experience with Slowly Changing Dimensions (SCDs) and historical hierarchy management.
- Preferred: Experience supporting complex master/reference data, entity matching, and hierarchy solutions.
- Preferred: Experience investigating historical data and reporting discrepancies.
- Preferred: Experience supporting controlled data migrations, source-system transitions, or platform changes.
- Preferred: Experience in distributed Agile teams and collaborating with UK-based business and technical stakeholders.
Ұқсас жұмыс орындары
Senior Data Architect (French-Speaking)
Intetics
Бельгия
Франция
Люксембург
Польша
Португалия
РумынияҚашықтанТолық жұмыс күніАға маманҚажетті Тіл: ағылшын тіліҚажетті Тіл: француз тіліДеректер инженеріShape scalable data architecture and SQL Server platforms for Intetics. The role covers data governance, REST integrations, and delivery testing.
Ашу
ML Data Engineer, Romania Remote
Intetics
Болгария
ИспанияПольшаПортугалияРумыния
СловакияҚашықтанТолық жұмыс күніОрта деңгейАға маманҚажетті Тіл: ағылшын тіліДеректер инженеріBuild real-time, graph, and time-series data infrastructure for athlete performance. Support machine learning evaluation and AI systems for an Intetics customer in the United States.
Ашу
Data Platform SRE and Observability Engineer
Emerging Travel Group
АрменияПортугалия
Сербия
ВьетнамҚашықтанТолық жұмыс күніОрта деңгейАға маманҚажетті Тіл: ағылшын тіліДеректер инженеріBuild observability across Trino, Kubernetes, databases, Hadoop, and Apache Ozone. Improve DORA metrics, service dashboards, and proactive incident alerting.
Ашу
Remote Big Data Infrastructure Engineer
Emerging Travel Group
Грузия
ҚазақстанПольшаСербияҚашықтанТолық жұмыс күніОрта деңгейАға маманҚажетті Тіл: ағылшын тіліДеректер инженеріLead the big data infrastructure for an international platform, including HDFS, object storage, and Iceberg. Shape platform architecture, quotas, catalogs, monitoring, and operational reliability.
Ашу