Visa
Visa
„Visa“ yra pasaulinė mokėjimų technologijų bendrovė, teikianti paslaugas vartotojams, prekybininkams, finansų įstaigoms ir vyriausybėms per savo elektroninių mokėjimų tinklą. Jos platforma palaiko kredito, debeto ir išankstinio mokėjimo operacijas, taip pat mokėjimų apdorojimą, sukčiavimo prevenciją, saugumą, analitiką ir kitas vartotojams bei įmonėms skirtas paslaugas. „Visa“ taip pat kuria naujus mokėjimų sprendimus, įskaitant dirbtiniu intelektu grindžiamas prekybos iniciatyvas, ir per „Visa Foundation“ remia finansinę įtrauktį.

Senior Data Engineer, Data Lake (Brazil Remote)

Build and maintain Spark, Databricks, and Airflow pipelines for Visa’s corporate data lake. Improve data quality, orchestration, and dependable self-service access to data.

Aprašymas

  • Develop, test, and maintain Databricks ingestion, transformation, and data-quality pipelines with PySpark and SparkSQL.
  • Create and update MWAA Airflow DAGs to orchestrate data workflows.
  • Write and optimize SQL for transformation and validation tasks.
  • Implement and monitor data-quality checks with Great Expectations or an equivalent tool.
  • Contribute to peer code reviews.
  • Troubleshoot pipeline failures and data-quality issues with support from senior engineers.
  • Create and update documentation for datasets and pipelines.
  • Take part in sprint planning, estimation, and retrospectives.
  • Apply the team’s CI/CD, testing, and governance standards.
  • Help strengthen the reliability and quality of Visa’s corporate data lake.

Reikalavimai

  • Be based in Brazil.
  • Communicate in English at B2 level or higher (Upper-Intermediate).
  • Have at least 3 years of relevant experience with a Bachelor’s or Associate’s degree, or at least 5 years of relevant experience.
  • Use Python for automation and data processing.
  • Understand batch data pipelines and ETL/ELT patterns.
  • Know the fundamentals of Apache Spark, including PySpark or SparkSQL.
  • Work with Databricks jobs, workflows, cluster management, and performance tuning.
  • Use intermediate to advanced SQL, including joins, window functions, and CTEs.
  • Understand Amazon S3 data-lake design, including partitioning, layout, and lifecycle management.
  • Know core AWS concepts, including S3, IAM, and CloudWatch.
  • Understand dimensional or Kimball modeling and medallion-layer architectures.
  • Use Git/GitHub workflows and participate in code reviews.
  • Preferred: experience with Delta Lake, Apache Airflow/MWAA, CDC patterns, data-quality concepts, Terraform fundamentals, or BI integration such as Superset and dashboarding.

Privalumai

  • Remote work arrangement.
  • Opportunity to make an impact at scale.
  • Professional development and skill growth through meaningful work.
  • Remote employees may have scheduled, advance-notice opportunities to work from a Visa office.

Susiję darbai

Salonkee

Salonkee Sales Representative (Career Changer) – Hannover

Salonkee
51 – 200 Darbuotojai
GrožisPrekyvietėSaaS

Grow Salonkee’s salon software business in Hannover by building relationships with salon owners and guiding them through product demonstrations. Manage the sales process from prospecting to close while planning your week independently.

Atidaryti
Red Hat

Consulting Cloud Architect, OpenShift

Red Hat

Design and deliver Red Hat OpenShift, Kubernetes, and hybrid cloud solutions for enterprise customers. Lead customer engagements focused on infrastructure, automation, and application delivery.

Atidaryti
Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Atidaryti