CI&T
CI&T
CI&T is a global technology transformation company founded in 1995, helping organizations modernize how they build, operate, and engage through digital products and services. Its work includes application modernization, cloud solutions, AI and data analytics, customer experience, product design, strategy consulting, and immersive experiences. With expertise serving industries such as consulting, healthcare, and marketing, CI&T brings together technology and business capabilities to support organizations pursuing growth and more efficient operations.

Senior Data Engineer, Data Governance and Data Lineage — CI&T, Hybrid Brazil

Develop Azure Databricks pipelines and Lakehouse solutions for CI&T’s global clients. Advance data capabilities supporting Analytics, BI, and AI.

Description

  • Design and optimize scalable pipelines with Azure Databricks and Azure Data Factory
  • Build ETL/ELT workflows from ingestion through transformation and delivery
  • Implement Medallion Architecture and Data Lakehouse solutions across Bronze, Silver, and Gold layers
  • Create data engineering solutions with PySpark, Spark SQL, SQL, and Python
  • Use Delta Lake to maintain data quality, consistency, performance, and reliability
  • Design and improve data models for BI and Analytics use cases
  • Connect data from varied systems, including relational databases and APIs
  • Collaborate with BI, Data Science, Engineering, and Business teams
  • Follow practices for quality, governance, version control, and CI/CD
  • Apply generative AI tools and coding assistants to improve development productivity and quality
  • Support global modernization and transformation initiatives involving Cloud, Data, and Artificial Intelligence

Requirements

  • Demonstrated experience working as a Data Engineer in production environments
  • Strong hands-on experience with Azure Databricks
  • Advanced PySpark and Apache Spark skills, including large-scale data processing and optimization
  • Advanced SQL proficiency
  • Practical Python experience in Data Engineering
  • Experience building and orchestrating pipelines with Azure Data Factory
  • Knowledge of ETL/ELT and Bronze, Silver, and Gold Medallion Architecture
  • Experience with Delta Lake and Data Lakehouse environments
  • Knowledge of dimensional and relational data modeling
  • Experience with Git and version-control workflows, preferably with Bitbucket
  • Knowledge of CI/CD, Azure Pipelines, Azure DevOps, or comparable tools
  • Experience with relational databases such as SQL Server or Oracle
  • Practical, analytical, and solution-focused approach
  • Ability to investigate issues independently and recommend improvements
  • Effective collaboration across teams and business functions
  • Kimball methodology and multidimensional modeling experience is a plus
  • Azure Purview or comparable Data Governance and Data Catalog experience is a plus
  • Experience applying Azure DevOps to data pipelines is a plus
  • Knowledge of Streaming, Spark Structured Streaming, or Azure Event Hubs is a plus
  • Experience with Erwin or similar data modeling tools is a plus
  • Experience with GitHub Copilot, Databricks Assistant, or other AI development tools is a plus
  • Azure DP-203 or Databricks certification is a plus

Benefits

  • Health and dental coverage
  • Meal and food allowances
  • Childcare assistance
  • Extended parental leave
  • Wellhub (Gympass), TotalPass, and other gym and wellness partnerships
  • Profit-Sharing and Results Program (PLR)
  • Life insurance
  • Access to the CI&T University continuous learning platform
  • Discount club membership
  • Free online resources focused on physical and mental health and well-being
  • Pregnancy and responsible parenting course
  • Partnerships with online learning platforms
  • Language learning platform
  • Support and workplace accommodations for people with disabilities
  • Health and Well-being team, inclusion specialists, and affinity groups
  • Global projects, ongoing learning, innovation, and professional development

Related Jobs

SPERTON - Where Great People Meet

Sales Executive, Elevators and Car Parking Systems

SPERTON - Where Great People Meet
51 – 200 Employees

Drive elevator and car parking system sales across Mumbai’s Western Region. Build client and dealer relationships, and manage deals from initial enquiry through project execution.

Open