CI&T
CI&T
CI&T este o companie globală de transformare tehnologică, fondată în 1995, care ajută organizațiile să își modernizeze modul în care dezvoltă, operează și oferă produse și servicii digitale. Activitatea sa include modernizarea aplicațiilor, soluții cloud, inteligență artificială și analiză de date, experiența clienților, design de produs, consultanță strategică și experiențe imersive. Cu experiență în domenii precum consultanța, sănătatea și marketingul, CI&T reunește competențe tehnologice și de business pentru a sprijini organizațiile care urmăresc creșterea și operațiuni mai eficiente.

Senior Data Engineer, Data Governance and Data Lineage — CI&T, Hybrid Brazil

Develop Azure Databricks pipelines and Lakehouse solutions for CI&T’s global clients. Advance data capabilities supporting Analytics, BI, and AI.

Descriere

  • Design and optimize scalable pipelines with Azure Databricks and Azure Data Factory
  • Build ETL/ELT workflows from ingestion through transformation and delivery
  • Implement Medallion Architecture and Data Lakehouse solutions across Bronze, Silver, and Gold layers
  • Create data engineering solutions with PySpark, Spark SQL, SQL, and Python
  • Use Delta Lake to maintain data quality, consistency, performance, and reliability
  • Design and improve data models for BI and Analytics use cases
  • Connect data from varied systems, including relational databases and APIs
  • Collaborate with BI, Data Science, Engineering, and Business teams
  • Follow practices for quality, governance, version control, and CI/CD
  • Apply generative AI tools and coding assistants to improve development productivity and quality
  • Support global modernization and transformation initiatives involving Cloud, Data, and Artificial Intelligence

Cerințe

  • Demonstrated experience working as a Data Engineer in production environments
  • Strong hands-on experience with Azure Databricks
  • Advanced PySpark and Apache Spark skills, including large-scale data processing and optimization
  • Advanced SQL proficiency
  • Practical Python experience in Data Engineering
  • Experience building and orchestrating pipelines with Azure Data Factory
  • Knowledge of ETL/ELT and Bronze, Silver, and Gold Medallion Architecture
  • Experience with Delta Lake and Data Lakehouse environments
  • Knowledge of dimensional and relational data modeling
  • Experience with Git and version-control workflows, preferably with Bitbucket
  • Knowledge of CI/CD, Azure Pipelines, Azure DevOps, or comparable tools
  • Experience with relational databases such as SQL Server or Oracle
  • Practical, analytical, and solution-focused approach
  • Ability to investigate issues independently and recommend improvements
  • Effective collaboration across teams and business functions
  • Kimball methodology and multidimensional modeling experience is a plus
  • Azure Purview or comparable Data Governance and Data Catalog experience is a plus
  • Experience applying Azure DevOps to data pipelines is a plus
  • Knowledge of Streaming, Spark Structured Streaming, or Azure Event Hubs is a plus
  • Experience with Erwin or similar data modeling tools is a plus
  • Experience with GitHub Copilot, Databricks Assistant, or other AI development tools is a plus
  • Azure DP-203 or Databricks certification is a plus

Beneficii

  • Health and dental coverage
  • Meal and food allowances
  • Childcare assistance
  • Extended parental leave
  • Wellhub (Gympass), TotalPass, and other gym and wellness partnerships
  • Profit-Sharing and Results Program (PLR)
  • Life insurance
  • Access to the CI&T University continuous learning platform
  • Discount club membership
  • Free online resources focused on physical and mental health and well-being
  • Pregnancy and responsible parenting course
  • Partnerships with online learning platforms
  • Language learning platform
  • Support and workplace accommodations for people with disabilities
  • Health and Well-being team, inclusion specialists, and affinity groups
  • Global projects, ongoing learning, innovation, and professional development

Locuri de muncă similare