
Applaudo yra artimosios rinkos programinės įrangos kūrimo įmonė, padedanti organizacijoms modernizuoti technologijas ir skatinti skaitmeninę transformaciją. 2013 m. įkurta įmonė sujungia programinės įrangos inžinerijos ir konsultavimo kompetencijas inovacijų ir naudotojų patirties kūrimo, programėlių kūrimo ir priežiūros, kokybės užtikrinimo, debesijos sprendimų, dirbtinio intelekto, kibernetinio saugumo, duomenų sprendimų ir programėlių modernizavimo srityse. Applaudo aptarnauja klientus sporto, žiniasklaidos ir pramogų, mažmeninės prekybos, vartojimo prekių bei finansinių paslaugų sektoriuose, remdama projektus, gerinančius skaitmeninius produktus, infrastruktūrą ir IT paslaugų teikimą. Įmonė, kurios pagrindinė būstinė yra Ostine, Teksase, o biuras – San Salvadore, suburia 501–1 000 darbuotojų komandą, aptarnaujančią technologijų ir skaitmeninių paslaugų sektoriaus įmones.
Senior Azure Databricks Data Engineer
Build Azure Databricks and Python pipelines for Applaudo’s AI-powered enterprise solutions. Connect business data to scalable, reliable data hubs and warehouses.
Aprašymas
- Build and maintain production-ready data pipelines with Azure Databricks and Python.
- Create scalable transformations using PySpark or Spark SQL.
- Ingest and process data from APIs, relational databases, cloud storage, and SFTP.
- Connect ticketing, CRM, marketing, retail, and other enterprise platforms to a centralized Data Hub.
- Develop and maintain warehouse structures, dimensional models, and data marts.
- Write, tune, and maintain SQL transformations.
- Add data quality validations and consistency checks.
- Build and maintain outbound feeds for third-party systems.
- Investigate data discrepancies and resolve pipeline issues.
- Document pipelines, transformation logic, dependencies, and technical processes.
- Work with colleagues and stakeholders to clarify requirements and identify risks.
- Share progress, blockers, and potential delays early, and propose steps to keep deliverables on track.
Reikalavimai
- At least five years of professional data engineering experience.
- Strong practical experience with Azure Databricks.
- Advanced Python skills for data processing, transformation, and pipeline development.
- Solid Apache Spark experience, including PySpark and/or Spark SQL.
- Advanced SQL skills, including complex transformations, data validation, and query performance tuning.
- Strong knowledge of data warehousing and dimensional modeling, including facts, dimensions, and data marts.
- Experience integrating data from REST APIs, relational databases, cloud storage, and SFTP.
- Practical experience with Microsoft Azure data services for ingestion, storage, processing, and integration.
- Experience implementing data quality checks and validating consistency between source systems and target data models.
- Ability to diagnose pipeline failures, investigate data discrepancies, and implement reliable fixes.
- Strong analytical, problem-solving, and organizational skills.
- Ability to work independently, take ownership, and follow engineering practices and documentation standards.
- Strong English communication skills and ability to work with a US-based team.
- Experience migrating SQL-based workloads to Azure Databricks is a plus.
Privalumai
- Option to work remotely.
- Opportunities to learn quickly and work with strong teams.
- Modern working practices.
- Contribute to AI-native transformation at scale.
Susiję darbai
Darbo pasiūlymų nerasta
Pabandykite pakeisti arba išvalyti filtrus, kad rastumėte daugiau galimybių.