The Codest
The Codest
The Codest este o companie internațională de dezvoltare software, cu sediul central în Regatul Unit și centre tehnologice în Polonia. Creează produse digitale și extinde echipele de inginerie ale clienților prin dezvoltatori cu experiență în dezvoltare backend și frontend, inginerie cloud și ingineria datelor. Compania colaborează cu întreprinderi, companii aflate în expansiune rapidă și furnizori de software prin dezvoltarea de proiecte și extinderea echipelor, inclusiv cu clienți din fintech, comerț electronic și adtech.

Senior Databricks Data Engineer

Build Databricks platforms and data pipelines remotely from Poland. Contribute to a customer-facing banking app for a major Japanese financial group.

Descriere

  • Build and maintain scalable Databricks data platforms and pipelines.
  • Partner with cross-functional teams to support reliable, accessible data for analytics and business intelligence.
  • Use Bronze, Silver, and Gold lakehouse layers to implement Medallion Architecture.
  • Create data quality frameworks with automated tests and monitoring.
  • Use Delta Lake time travel, vacuum operations, and Z-ordering.
  • Develop and maintain complex ETL/ELT pipelines for large daily datasets.
  • Set up CI/CD workflows for data pipelines with Databricks Asset Bundles or comparable tools.
  • Build batch and real-time processing solutions with Structured Streaming and Delta Live Tables.
  • Improve Spark job performance and cost efficiency through cluster auto-scaling and resource management.
  • Integrate Databricks APIs with external systems.
  • Design scalable data architectures with Unity Catalog, Delta Lake, and Apache Spark.
  • Build data mesh architectures with governance and lineage tracking.
  • Contribute to a customer-facing banking application for a leading financial group in Japan.

Cerințe

  • Bring at least six years of data engineering experience.
  • Have a strong record of designing and deploying production-grade data pipelines and ETL/ELT workflows.
  • Be proficient in Python, PySpark, and SQL.
  • Have extensive hands-on experience with AWS Glue, Lambda, Redshift, and S3.
  • Know data governance and management tools, including Unity Catalog and AWS SageMaker Unified Studio.
  • Have experience with data migrations and modernizing legacy systems.
  • Communicate effectively in English.
  • Databricks Certified Professional Data Engineer certification or an equivalent is a plus.
  • Experience with containerization and orchestration tools such as Docker and Kubernetes is an advantage.

Beneficii

  • Work in a collaborative, engaging environment.
  • Access opportunities for professional growth.
  • Contribute to an international banking app project.
  • Work remotely.

Locuri de muncă similare

ACI Worldwide

DevOps Engineer

ACI Worldwide

Build and maintain CI/CD tooling and infrastructure automation at ACI Worldwide, supporting its real-time payments platform. Help improve the scalability, security, and operational reliability of digital payments services.

Deschide
Valon

Engineering Manager, Developer Infrastructure

Valon

Lead Valon’s Developer Infrastructure team as it builds the platform and tools behind ValonOS, an AI-native operating system for regulated finance. Improve reliability, developer workflows, and engineering productivity.

Deschide
Verisys

Senior AWS Cloud Infrastructure Engineer

Verisys
201 – 500 Angajați

Secure and operate AWS infrastructure for Verisys’s healthcare credentialing platform. The role spans Linux and Windows systems, Nutanix, containers, certificates, and compliance.

Deschide
Walmart

Senior Manager, Systems and Infrastructure Engineering

Walmart

Lead infrastructure engineering for Walmart’s global retail technology, overseeing scalable systems, cloud migration, automation, and integrations. Build reliable, secure operations through infrastructure planning and technical team leadership.

Deschide