AVANTTi
AVANTTi
51 – 200 Darbuotojai
GamybaKonsultavimasLogistika
AVANTTi yra Brazilijos technologinių paslaugų įmonė, padedanti organizacijoms technologijų ir inovacijų iniciatyvas paversti išmatuojama verslo verte. Įmonės paslaugos apima IT specialistų samdą ir talentų paiešką, greitą komandų formavimą, programinės įrangos gamyklos sprendimų teikimą naudojant tokias technologijas kaip ABAP, Java ir .NET, taip pat portfelio ir SAFe valdymą pagal VMO (Value Management Office) metodiką. AVANTTi padeda vykdyti skaitmeninę transformaciją ir įgyvendinti įmonių IT sprendimus bankininkystės, gamybos, logistikos, mažmeninės prekybos ir švietimo sektoriuose. Įmonė veikia Kuritiboje, San Paule ir Rio de Žaneire.

Senior Azure Databricks Data Engineer

Senior Data Engineer at AVANTTi, building Azure Databricks pipelines and ETL/ELT workflows. Supports scalable enterprise data systems for analytics and business needs.

Aprašymas

  • Build and optimize data pipelines with Azure Databricks, PySpark, Azure Data Factory, Python, and Azure Data Lake.
  • Develop and maintain ETL/ELT workflows for enterprise integration and analytics.
  • Ingest, transform, validate, and reconcile data from multiple systems.
  • Profile and analyze data to identify quality issues and protect its consistency and reliability.
  • Write and tune complex SQL queries for efficient data processing.
  • Troubleshoot and improve performance across large-scale workloads.
  • Resolve Level 2 production incidents affecting Azure Data Factory pipelines, Databricks jobs, and data workflows.
  • Monitor and support production pipelines to maintain availability, scalability, and operational efficiency.
  • Assist with deployments and releases across development, staging, and production environments.
  • Coordinate priorities across projects, work independently, and meet deadlines.

Reikalavimai

  • More than eight years of experience in data engineering.
  • Demonstrated experience in data engineering and ETL development.
  • Strong practical experience with Azure Databricks and Azure Data Factory (ADF).
  • Advanced ETL/ELT development and data transformation skills.
  • Advanced SQL skills, including writing, optimizing, and tuning complex queries.
  • Experience with Python and PySpark.
  • Experience with Azure Data Lake and enterprise data integration.
  • Experience in data analysis, validation, profiling, and quality assurance.
  • Experience supporting, monitoring, and troubleshooting production pipelines.
  • Able to work independently, stay organized, and manage priorities.
  • Strong spoken and written communication skills.
  • Advanced English proficiency.
  • Preferred: experience with CI/CD pipelines and DevOps practices.
  • Preferred: familiarity with Git, Azure DevOps, or comparable version control and deployment tools.
  • Preferred: familiarity with cloud monitoring, logging, and observability tools.

Privalumai

  • Employment under a CLT contract.
  • Fully remote work.

Susiję darbai

Hitss Brasil

Mid-Level Cloud Architect – Kubernetes and OpenShift

Hitss Brasil
5 001 – 10 000 Darbuotojai
KonsultavimasLogistikaRinkodara

Support Hitss Brasil’s cloud and container environments, with a focus on Kubernetes and Red Hat OpenShift. Set platform architecture standards and automate configuration with Ansible to help maintain reliable operations.

Atidaryti