Expleo Group
Expleo Group
Expleo Group is a global engineering, technology, and consulting partner helping organizations transform operations, develop complex products, and improve manufacturing and quality processes. Its work spans consulting, defense, and logistics, with capabilities in artificial intelligence, digitalization, and cybersecurity. Founded in 1966, Expleo combines more than five decades of experience with a team of 18,000 experts working across 29 countries to support innovation and operational performance.

Data Engineer, PySpark and Databricks

Build PySpark and SQL pipelines on Databricks, creating reliable, governed datasets for analytics and machine learning teams in Chennai.

Description

  • Develop ETL and ELT pipelines with PySpark and SQL for large-scale data processing
  • Build and optimise Databricks workflows, including notebooks, jobs, and cluster configurations
  • Work with analytics and machine learning teams to deliver clean, documented datasets
  • Track pipeline performance, resolve failures, and maintain data quality and integrity
  • Establish data governance and platform best practices
  • Contribute to design reviews and architectural decisions

Requirements

  • Bring 4–6 years of practical experience in data engineering or a related field
  • Use PySpark confidently for distributed processing at scale
  • Apply advanced SQL, including query optimisation, window functions, CTEs, and complex joins
  • Have solid Databricks experience with Delta Lake and workflows; Unity Catalog is preferred
  • Have experience with AWS or Azure cloud platforms
  • Have core skills in PySpark, SQL, Databricks, AWS, Azure, Python, and Git
  • Experience with streaming tools such as Apache Kafka or Spark Streaming is an advantage
  • Exposure to machine learning pipelines and feature engineering workflows is an advantage

Related Jobs

Meazure Learning

Senior Customer Success Manager

Meazure Learning
1,001 – 5,000 Employees
ConsultingEducationLogistics

Lead relationships with Meazure Learning’s strategic and enterprise clients, supporting retention, satisfaction, product adoption, and account growth. The role manages a portfolio of 5–10 accounts and partners with internal teams to strengthen long-term customer outcomes.

Open