AVANTTi
AVANTTi
AVANTTi ir Brazīlijas tehnoloģiju pakalpojumu uzņēmums, kas palīdz organizācijām tehnoloģiju un inovāciju iniciatīvas pārvērst izmērāmā biznesa vērtībā. Uzņēmuma pakalpojumi ietver IT personāla nodrošināšanu un talantu piesaisti, ātru komandu izveidi, programmatūras izstrādes rūpnīcas pakalpojumus, izmantojot tādas tehnoloģijas kā ABAP, Java un .NET, kā arī portfeļa un SAFe pārvaldību, izmantojot VMO (Value Management Office) metodoloģiju. AVANTTi atbalsta digitālo pārveidi un uzņēmumu IT risinājumu ieviešanu tādās nozarēs kā banku pakalpojumi, ražošana, loģistika, mazumtirdzniecība un izglītība. Uzņēmums darbojas Kuritibā, Sanpaulu un Riodežaneiro.

Senior Azure Databricks Data Engineer

Senior Data Engineer at AVANTTi, building Azure Databricks pipelines and ETL/ELT workflows. Supports scalable enterprise data systems for analytics and business needs.

Apraksts

  • Build and optimize data pipelines with Azure Databricks, PySpark, Azure Data Factory, Python, and Azure Data Lake.
  • Develop and maintain ETL/ELT workflows for enterprise integration and analytics.
  • Ingest, transform, validate, and reconcile data from multiple systems.
  • Profile and analyze data to identify quality issues and protect its consistency and reliability.
  • Write and tune complex SQL queries for efficient data processing.
  • Troubleshoot and improve performance across large-scale workloads.
  • Resolve Level 2 production incidents affecting Azure Data Factory pipelines, Databricks jobs, and data workflows.
  • Monitor and support production pipelines to maintain availability, scalability, and operational efficiency.
  • Assist with deployments and releases across development, staging, and production environments.
  • Coordinate priorities across projects, work independently, and meet deadlines.

Prasības

  • More than eight years of experience in data engineering.
  • Demonstrated experience in data engineering and ETL development.
  • Strong practical experience with Azure Databricks and Azure Data Factory (ADF).
  • Advanced ETL/ELT development and data transformation skills.
  • Advanced SQL skills, including writing, optimizing, and tuning complex queries.
  • Experience with Python and PySpark.
  • Experience with Azure Data Lake and enterprise data integration.
  • Experience in data analysis, validation, profiling, and quality assurance.
  • Experience supporting, monitoring, and troubleshooting production pipelines.
  • Able to work independently, stay organized, and manage priorities.
  • Strong spoken and written communication skills.
  • Advanced English proficiency.
  • Preferred: experience with CI/CD pipelines and DevOps practices.
  • Preferred: familiarity with Git, Azure DevOps, or comparable version control and deployment tools.
  • Preferred: familiarity with cloud monitoring, logging, and observability tools.

Priekšrocības

  • Employment under a CLT contract.
  • Fully remote work.

Saistītās vakances

Hitss Brasil

Mid-Level Cloud Architect – Kubernetes and OpenShift

Hitss Brasil
5001 – 10 000 Darbinieki
KonsultācijasLoģistikaMārketings

Support Hitss Brasil’s cloud and container environments, with a focus on Kubernetes and Red Hat OpenShift. Set platform architecture standards and automate configuration with Ansible to help maintain reliable operations.

Atvērt