AVANTTi
AVANTTi
51 – 200 Zaposleni
LogistikaProizvodnjaSvetovanje
AVANTTi je brazilsko podjetje za tehnološke storitve, ki se osredotoča na pomoč organizacijam pri pretvarjanju tehnoloških in inovacijskih pobud v merljivo poslovno vrednost. Njegove storitve vključujejo zaposlovanje na področju IT in iskanje talentov, hitro oblikovanje ekip, razvoj programske opreme v programski tovarni z uporabo tehnologij, kot so ABAP, Java in .NET, ter upravljanje portfelja in SAFe po metodologiji VMO (Value Management Office). AVANTTi podpira digitalno preobrazbo in zagotavljanje poslovnih IT-rešitev za organizacije v panogah, kot so bančništvo, proizvodnja, logistika, maloprodaja in izobraževanje, pri čemer deluje v Curitibi, São Paulu in Riu de Janeiru.

Senior Azure Databricks Data Engineer

Senior Data Engineer at AVANTTi, building Azure Databricks pipelines and ETL/ELT workflows. Supports scalable enterprise data systems for analytics and business needs.

Opis

  • Build and optimize data pipelines with Azure Databricks, PySpark, Azure Data Factory, Python, and Azure Data Lake.
  • Develop and maintain ETL/ELT workflows for enterprise integration and analytics.
  • Ingest, transform, validate, and reconcile data from multiple systems.
  • Profile and analyze data to identify quality issues and protect its consistency and reliability.
  • Write and tune complex SQL queries for efficient data processing.
  • Troubleshoot and improve performance across large-scale workloads.
  • Resolve Level 2 production incidents affecting Azure Data Factory pipelines, Databricks jobs, and data workflows.
  • Monitor and support production pipelines to maintain availability, scalability, and operational efficiency.
  • Assist with deployments and releases across development, staging, and production environments.
  • Coordinate priorities across projects, work independently, and meet deadlines.

Zahteve

  • More than eight years of experience in data engineering.
  • Demonstrated experience in data engineering and ETL development.
  • Strong practical experience with Azure Databricks and Azure Data Factory (ADF).
  • Advanced ETL/ELT development and data transformation skills.
  • Advanced SQL skills, including writing, optimizing, and tuning complex queries.
  • Experience with Python and PySpark.
  • Experience with Azure Data Lake and enterprise data integration.
  • Experience in data analysis, validation, profiling, and quality assurance.
  • Experience supporting, monitoring, and troubleshooting production pipelines.
  • Able to work independently, stay organized, and manage priorities.
  • Strong spoken and written communication skills.
  • Advanced English proficiency.
  • Preferred: experience with CI/CD pipelines and DevOps practices.
  • Preferred: familiarity with Git, Azure DevOps, or comparable version control and deployment tools.
  • Preferred: familiarity with cloud monitoring, logging, and observability tools.

Ugodnosti

  • Employment under a CLT contract.
  • Fully remote work.

Sorodna delovna mesta

Hitss Brasil

Mid-Level Cloud Architect – Kubernetes and OpenShift

Hitss Brasil
5001 – 10.000 Zaposleni
LogistikaSvetovanjeTrženje

Support Hitss Brasil’s cloud and container environments, with a focus on Kubernetes and Red Hat OpenShift. Set platform architecture standards and automate configuration with Ansible to help maintain reliable operations.

Odpri