Expleo Group
Expleo Group
Expleo Group je globalni partner za inženiring, tehnologijo in svetovanje, ki organizacijam pomaga preoblikovati poslovanje, razvijati kompleksne izdelke ter izboljševati proizvodne in kakovostne procese. Njegovo delo zajema svetovanje, obrambo in logistiko, pri čemer ima strokovno znanje na področju umetne inteligence, digitalizacije in kibernetske varnosti. Podjetje, ustanovljeno leta 1966, združuje več kot pet desetletij izkušenj in ekipo 18.000 strokovnjakov, ki delujejo v 29 državah ter podpirajo inovacije in operativno uspešnost.

Data Engineer, PySpark and Databricks

Build PySpark and SQL pipelines on Databricks, creating reliable, governed datasets for analytics and machine learning teams in Chennai.

Opis

  • Develop ETL and ELT pipelines with PySpark and SQL for large-scale data processing
  • Build and optimise Databricks workflows, including notebooks, jobs, and cluster configurations
  • Work with analytics and machine learning teams to deliver clean, documented datasets
  • Track pipeline performance, resolve failures, and maintain data quality and integrity
  • Establish data governance and platform best practices
  • Contribute to design reviews and architectural decisions

Zahteve

  • Bring 4–6 years of practical experience in data engineering or a related field
  • Use PySpark confidently for distributed processing at scale
  • Apply advanced SQL, including query optimisation, window functions, CTEs, and complex joins
  • Have solid Databricks experience with Delta Lake and workflows; Unity Catalog is preferred
  • Have experience with AWS or Azure cloud platforms
  • Have core skills in PySpark, SQL, Databricks, AWS, Azure, Python, and Git
  • Experience with streaming tools such as Apache Kafka or Spark Streaming is an advantage
  • Exposure to machine learning pipelines and feature engineering workflows is an advantage

Sorodna delovna mesta

Ohio State University Physicians

Remote Financial Clearance Representative L3 (Financial Counselor)

Ohio State University Physicians

Verify patient coverage, eligibility, and financial responsibility as a financial counselor with Ohio State University Physicians. Help uninsured patients access financial assistance and coordinate clearance for scheduling.

Odpri
Vinfen

Senior Lead Residential Counselor, Mental Health Services

Vinfen

Lead residential support for adults with mental health conditions in Vinfen’s community-based program. Coordinate treatment, medication support, crisis response, daily living assistance, and residential operations.

Odpri