Senior Data Engineer, Databricks Migration
Sigma Software GroupMigrate enterprise retail analytics from BigQuery to Databricks Lakehouse, building scalable PySpark pipelines, medallion architecture, and governed cloud data platforms.
खोलें
Sedona Digital एक प्रक्रिया-केंद्रित प्रौद्योगिकी परामर्श कंपनी है, जो स्वास्थ्य सेवा और लॉजिस्टिक्स सहित विभिन्न क्षेत्रों के संगठनों को सेवाएँ प्रदान करती है। इसका कार्य प्रौद्योगिकी रणनीति, डेटा आर्किटेक्चर और इंजीनियरिंग, AI और पूर्वानुमानात्मक विश्लेषण, सॉफ़्टवेयर उत्पाद विकास, एप्लिकेशन आधुनिकीकरण, क्लाउड माइग्रेशन, Azure प्रबंधित सेवाओं, DevOps और CI/CD तक फैला हुआ है। कंपनी क्लाउड सुरक्षा, प्रबंधित SOC संचालन और निरंतर अनुपालन में भी सहायता करती है, जिससे उद्यम डेटा-आधारित, क्लाउड-नेटिव प्रौद्योगिकी वातावरण तैयार, संचालित और सुरक्षित कर सकें।
Senior Data Engineer, Romania Remote | Sedona Digital
Build and support PySpark, SQL, and Databricks data platforms for Sedona Digital’s insurance-sector clients. Work on pipelines, reconciliation, data quality, and cloud data solutions.
विवरण
- Evaluate and rebuild ingestion pipelines for operational and source-system data.
- Design data mappings, lineage, dependencies, and controlled migration and cutover plans.
- Create and maintain detailed data reconciliation processes.
- Improve PySpark data processing and hierarchy and roll-up capabilities.
- Add testing, versioning, metadata, observability, and deployment controls.
- Work with business and technical specialists to improve data coverage.
- Evaluate GCP data pipeline options and help implement them.
- Explore sourcing mappings and reference data directly from systems such as Microsoft Dynamics 365.
- Support changes to reporting hierarchies and filtering logic, including impact assessment, testing, and reconciliation.
- Create and maintain automated data-quality checks, monitoring, and operational controls.
- Help teams adopt centralised reporting and data capabilities.
- Prepare technical documentation, decision records, reconciliation evidence, variance explanations, and handover materials.
- Deliver work through a prioritised backlog and short iterative sprints with engineers and stakeholders.
आवश्यकताएँ
- At least five years of professional experience in data engineering or a closely related data role, including substantial hands-on work building and supporting production data solutions.
- Strong practical experience with PySpark, SQL, and Databricks, including developing and supporting production-grade data pipelines.
- Hands-on experience with GCP data technologies and pipelines.
- Experience testing and optimising data pipelines and supporting their operation.
- Strong experience modelling dimensional, master/reference, or hierarchical data.
- Experience implementing complex entity matching, data mappings, and roll-up logic with appropriate traceability.
- Practical experience implementing automated data-quality checks and reconciliation processes.
- Experience with observability, audit history, version control, and CI/CD in data engineering solutions.
- Experience assessing source-system data and documenting data contracts, mappings, lineage, and dependencies.
- Experience managing controlled data pipeline or platform transitions.
- Ability to investigate data issues and explain differences in values, record counts, mappings, and hierarchy outcomes clearly.
- Ability to work directly with platform teams, analysts, and business specialists, turning ambiguous reporting and mapping needs into tested engineering solutions.
- Strong communication skills and the ability to prepare concise technical documentation, decision records, variance explanations, and handover materials.
- Self-directed and comfortable working in a collaborative, iterative delivery environment.
- Preferred: Experience in insurance, the London Market, reinsurance, brokerage, distribution, or policy-level data environments.
- Preferred: Experience integrating Microsoft Dynamics 365 or similar operational source systems.
- Preferred: Experience with Power BI, including semantic models and reporting dependencies.
- Preferred: Experience with Slowly Changing Dimensions (SCDs) and historical hierarchy management.
- Preferred: Experience supporting complex master/reference data, entity matching, and hierarchy solutions.
- Preferred: Experience investigating historical data and reporting discrepancies.
- Preferred: Experience supporting controlled data migrations, source-system transitions, or platform changes.
- Preferred: Experience in distributed Agile teams and collaborating with UK-based business and technical stakeholders.
संबंधित नौकरियाँ
Senior Data Architect (French-Speaking)
Intetics
बेल्जियम
फ़्रांस
लग्ज़मबर्ग
पोलैंड
पुर्तगाल
रोमानियारिमोटपूर्णकालिकवरिष्ठआवश्यक भाषा: अंग्रेज़ीआवश्यक भाषा: फ़्रेंचडेटा इंजीनियरShape scalable data architecture and SQL Server platforms for Intetics. The role covers data governance, REST integrations, and delivery testing.
खोलें
ML Data Engineer, Romania Remote
Intetics
बुल्गारिया
स्पेनपोलैंडपुर्तगालरोमानिया
स्लोवाकियारिमोटपूर्णकालिकमध्य स्तरवरिष्ठआवश्यक भाषा: अंग्रेज़ीडेटा इंजीनियरBuild real-time, graph, and time-series data infrastructure for athlete performance. Support machine learning evaluation and AI systems for an Intetics customer in the United States.
खोलें
Data Platform SRE and Observability Engineer
Emerging Travel Group
Build observability across Trino, Kubernetes, databases, Hadoop, and Apache Ozone. Improve DORA metrics, service dashboards, and proactive incident alerting.
खोलें
Remote Big Data Infrastructure Engineer
Emerging Travel Group
Lead the big data infrastructure for an international platform, including HDFS, object storage, and Iceberg. Shape platform architecture, quotas, catalogs, monitoring, and operational reliability.
खोलें