Visa
Visa
Visa ir globāls maksājumu tehnoloģiju uzņēmums, kas, izmantojot savu elektronisko maksājumu tīklu, apkalpo patērētājus, tirgotājus, finanšu iestādes un valdības. Tā platforma nodrošina kredīta, debeta un priekšapmaksas darījumus, kā arī maksājumu apstrādi, krāpšanas novēršanu, drošību, analītiku un citus pakalpojumus patērētājiem un uzņēmumiem. Visa izstrādā arī jaunus maksājumu risinājumus, tostarp ar mākslīgo intelektu iespējotus tirdzniecības risinājumus, un ar Visa Foundation starpniecību veicina finansiālo iekļaušanu.

Senior Data Engineer, Data Lake (Brazil Remote)

Build and maintain Spark, Databricks, and Airflow pipelines for Visa’s corporate data lake. Improve data quality, orchestration, and dependable self-service access to data.

Apraksts

  • Develop, test, and maintain Databricks ingestion, transformation, and data-quality pipelines with PySpark and SparkSQL.
  • Create and update MWAA Airflow DAGs to orchestrate data workflows.
  • Write and optimize SQL for transformation and validation tasks.
  • Implement and monitor data-quality checks with Great Expectations or an equivalent tool.
  • Contribute to peer code reviews.
  • Troubleshoot pipeline failures and data-quality issues with support from senior engineers.
  • Create and update documentation for datasets and pipelines.
  • Take part in sprint planning, estimation, and retrospectives.
  • Apply the team’s CI/CD, testing, and governance standards.
  • Help strengthen the reliability and quality of Visa’s corporate data lake.

Prasības

  • Be based in Brazil.
  • Communicate in English at B2 level or higher (Upper-Intermediate).
  • Have at least 3 years of relevant experience with a Bachelor’s or Associate’s degree, or at least 5 years of relevant experience.
  • Use Python for automation and data processing.
  • Understand batch data pipelines and ETL/ELT patterns.
  • Know the fundamentals of Apache Spark, including PySpark or SparkSQL.
  • Work with Databricks jobs, workflows, cluster management, and performance tuning.
  • Use intermediate to advanced SQL, including joins, window functions, and CTEs.
  • Understand Amazon S3 data-lake design, including partitioning, layout, and lifecycle management.
  • Know core AWS concepts, including S3, IAM, and CloudWatch.
  • Understand dimensional or Kimball modeling and medallion-layer architectures.
  • Use Git/GitHub workflows and participate in code reviews.
  • Preferred: experience with Delta Lake, Apache Airflow/MWAA, CDC patterns, data-quality concepts, Terraform fundamentals, or BI integration such as Superset and dashboarding.

Priekšrocības

  • Remote work arrangement.
  • Opportunity to make an impact at scale.
  • Professional development and skill growth through meaningful work.
  • Remote employees may have scheduled, advance-notice opportunities to work from a Visa office.

Saistītās vakances

InTTrust S.A.

Data Analyst, SQL and Oracle Analytics Cloud

InTTrust S.A.

InTTrust is hiring a Data Analyst in Greece to work with SQL, Oracle Analytics Cloud, and machine learning. The role focuses on dashboards, semantic models, and turning data into practical business insights.

Atvērt
AtkinsRéalis

Senior Project Planning and Controls Engineer – AtkinsRéalis, Gurugram

AtkinsRéalis

Lead planning and project controls across AtkinsRéalis infrastructure and EPC projects, managing schedules, costs, risks, and performance reporting. Build Power BI insights and support delivery teams working across global projects.

Atvērt
ICT Digital Solutions GmbH
WEX

Software Development Engineer III, AI Agentic Systems

WEX

Build AI agent workflows, cloud infrastructure, and resilient services at WEX. Lead architecture, delivery pipelines, incident response, and engineering mentorship.

Atvērt