GFT Technologies
GFT Technologies
GFT Technologies is a technology and digital transformation company working across consulting, insurance, and cybersecurity. Its Cookiebot platform helps organizations collect and manage user consent while supporting compliance with privacy regulations including the GDPR and CCPA. The company’s solutions are designed to integrate with existing digital environments and are used by more than 600,000 customers worldwide to handle personal data with greater transparency and control.

Mid/Senior Azure Databricks Data Engineer – Colombia Remote

Design and optimize Azure and Databricks data pipelines and cloud architectures at GFT Technologies. Prepare trusted data for analytics, artificial intelligence, and machine learning.

Description

  • Design, build, and optimize Azure- and Databricks-based data architectures
  • Implement ETL and ELT processes to integrate multiple information sources
  • Design and manage Data Lake and Lakehouse architectures
  • Monitor data pipelines to ensure consistency, quality, traceability, and security
  • Prepare and optimize datasets for advanced analytics, reporting, and machine learning models
  • Work with BI, analytics, and data science teams to improve access to information
  • Define and implement data governance and quality controls
  • Implement continuous integration and continuous deployment processes for data solutions
  • Design scalable solutions for distributed processing and large data volumes
  • Identify improvements that optimize costs, performance, and processing times
  • Evaluate new technologies and best practices to advance the data platform

Requirements

  • Degree in Systems Engineering, Industrial Engineering, Electronic Engineering, Mechatronics Engineering, or a related field
  • Three to five years of experience as a Data Engineer
  • Advanced SQL proficiency
  • Experience with Python or Scala
  • Experience with distributed processing using PySpark
  • Experience with Azure Databricks
  • Experience with Azure Data Factory
  • Experience with Azure Data Lake Storage Gen2 (ADLS Gen2)
  • Knowledge of Delta Lake
  • Experience with Lakehouse architectures
  • Knowledge of the Medallion architecture
  • Experience with dimensional modeling
  • Experience with relational databases
  • Experience with NoSQL databases
  • Knowledge of data governance and quality
  • Experience with Unity Catalog
  • Experience with Delta Live Tables (DLT)
  • Knowledge of Great Expectations
  • Experience with streaming processing through Event Hubs
  • Experience with Azure DevOps and Git
  • Knowledge of Entra ID
  • Knowledge of RBAC
  • Proficiency with Power BI
  • Proficiency with Visual Studio Code
  • Experience with data integration and ETL/ELT processes
  • Experience in data analysis and modeling
  • Azure Data Engineering certifications are an advantage
  • Experience with artificial intelligence and machine learning projects is an advantage
  • Knowledge of DataOps and data platform automation is an advantage

Benefits

  • Flexible working hours
  • Remote work
  • Personalized career development plan
  • Training programs
  • Work in multidisciplinary teams
  • Diverse global team
  • High-impact projects with leading industry clients

Related Jobs