E
Experian
Experian works with recognized brands on digital experience, technology, and business transformation. Its work combines customer insight, product strategy, agile technology solutions, AI, cloud architecture, and project management to help organizations improve customer experiences and streamline operations. The company’s broad technology and consulting focus may appeal to professionals interested in roles spanning digital transformation, marketing, logistics, and related business services.

Senior Data Engineer at Experian — Brazil Remote

Join Experian’s senior data engineering team to evolve a petabyte-scale AWS platform. Build resilient pipelines and data-driven marketing capabilities with Spark, JVM languages, and Python.

Description

  • Design, build, and enhance Experian’s petabyte-scale AWS data platform
  • Develop and optimize scalable pipelines with JVM languages, Spark, Python, and cloud-native services
  • Deliver efficient, resilient, production-ready data processing for analytics and downstream products
  • Provide principal-level technical leadership through mentorship and rigorous code reviews
  • Champion engineering standards and help advance organizational engineering maturity
  • Shape architecture and technical designs with architects, product owners, and engineering leaders
  • Plan and deliver complex initiatives within agile value-stream teams
  • Establish operational readiness through coding standards, testing, monitoring, and release practices
  • Support production releases and help maintain platform reliability
  • Evaluate and adopt technologies including GraphQL integrations, vector databases, and AI/LLM techniques

Requirements

  • Expert-level experience in software and data engineering for large-scale platforms
  • Deep experience building petabyte-scale systems with Java-based languages such as Scala and Apache Spark
  • Advanced knowledge of AWS data services, including Glue, S3, Athena, Managed Airflow, and Iceberg
  • Strong understanding of distributed systems and highly parallel workloads
  • Proven ability to optimize queries, partition data, and design efficient storage patterns
  • Mastery of the AWS cloud ecosystem; Azure or GCP experience is advantageous
  • Experience shaping long-term architecture and platform strategy
  • Strong capabilities in code review, mentorship, and technical leadership
  • Hands-on experience in agile environments with collaboration across engineering teams
  • Proficiency with Git, GitHub, and Bitbucket in multi-repository development
  • Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience
  • Relevant professional experience
  • Advanced English proficiency
  • Availability to travel to São Carlos, São Paulo, when required
  • Experience with dbt or modern data transformation frameworks
  • Knowledge of concurrent and parallel programming
  • Familiarity with Python, Angular, and TypeScript
  • Experience with vector databases such as pgvector and Redis vector fields
  • Practical experience applying AI/LLM techniques to data platforms, data access, or software quality

Benefits

  • Remote work arrangement
  • Inclusive hiring and professional development programs
  • Affinity groups supporting underrepresented communities, including ExperianPride, Ubuntu, Women in Experian, Aspire, and Connecting Generations

Related Jobs