LogoFresh Jobs Ahead
The Codest
The Codest
51 – 200 Darbuotojai
KonsultavimasLogistikaSveikatos priežiūra
The Codest is an international software development company with its headquarters in the United Kingdom and technology hubs in Poland. It builds digital products and extends client engineering teams with experienced developers across backend and frontend development, cloud engineering, and data engineering. The company works with enterprises, scale-ups, and software vendors through project development and staff augmentation, including clients in fintech, e-commerce, and adtech.
LinkedIn
Darbai įmonėje

Senior Databricks Data Engineer

Build Databricks platforms and data pipelines remotely from Poland. Contribute to a customer-facing banking app for a major Japanese financial group.

PLLenkija
22 000 zl – 30 000 zl / mėnuo
NuotolinisVisas etatasVidutinis lygisVyresnysis specialistasPrivaloma Kalba: anglųDuomenų inžinierius
Amazon RedshiftApacheAWSDockerETLKubernetesPySparkPythonSparkSQLUnity

Aprašymas

  • Build and maintain scalable Databricks data platforms and pipelines.
  • Partner with cross-functional teams to support reliable, accessible data for analytics and business intelligence.
  • Use Bronze, Silver, and Gold lakehouse layers to implement Medallion Architecture.
  • Create data quality frameworks with automated tests and monitoring.
  • Use Delta Lake time travel, vacuum operations, and Z-ordering.
  • Develop and maintain complex ETL/ELT pipelines for large daily datasets.
  • Set up CI/CD workflows for data pipelines with Databricks Asset Bundles or comparable tools.
  • Build batch and real-time processing solutions with Structured Streaming and Delta Live Tables.
  • Improve Spark job performance and cost efficiency through cluster auto-scaling and resource management.
  • Integrate Databricks APIs with external systems.
  • Design scalable data architectures with Unity Catalog, Delta Lake, and Apache Spark.
  • Build data mesh architectures with governance and lineage tracking.
  • Contribute to a customer-facing banking application for a leading financial group in Japan.

Reikalavimai

  • Bring at least six years of data engineering experience.
  • Have a strong record of designing and deploying production-grade data pipelines and ETL/ELT workflows.
  • Be proficient in Python, PySpark, and SQL.
  • Have extensive hands-on experience with AWS Glue, Lambda, Redshift, and S3.
  • Know data governance and management tools, including Unity Catalog and AWS SageMaker Unified Studio.
  • Have experience with data migrations and modernizing legacy systems.
  • Communicate effectively in English.
  • Databricks Certified Professional Data Engineer certification or an equivalent is a plus.
  • Experience with containerization and orchestration tools such as Docker and Kubernetes is an advantage.

Privalumai

  • Work in a collaborative, engaging environment.
  • Access opportunities for professional growth.
  • Contribute to an international banking app project.
  • Work remotely.

Susiję darbai

Marsh McLennan

Contract Specialist, Compliance Analyst

Marsh McLennan
H1B vizos rėmėjasFinansaiRinkodaraTeisė
USJungtinės ValstijosFLFloridaNCŠiaurės KarolinaOHOhajasTXTeksasasWIViskonsinas
53 000 $ – 105 500 $ / metai
HibridinisVisas etatasJaunesnysis specialistasVidutinis lygisDiplomas nebūtinasPrivaloma Kalba: anglųAtitiktis

Manage contract workflows, compliance activities, and ContractHub templates for Marsh McLennan’s Health team. This hybrid role supports Health & Benefits stakeholders.

Atidaryti