Citi
Citi
Citi is a global banking and financial services company serving consumers, corporations, governments, and institutions. Its offerings span consumer banking, credit cards, wealth management, corporate banking, and investment banking, supported by operations in more than 100 countries. As a large international finance organization, Citi brings together teams working across banking, financial services, and fintech.

Big Data Engineer – Python, PySpark and Databricks | Citi | Pune Hybrid

Build and support large-scale data pipelines with Python, PySpark, and Databricks for Citi’s global financial data infrastructure. Work across Hadoop, Tableau, Linux, and enterprise analytics delivery.

Description

  • Develop and maintain scalable Python and PySpark pipelines that process structured and unstructured data across distributed platforms
  • Design and improve Hadoop-based workflows, including HDFS and Hive, to provide dependable data for reporting and analytics
  • Prepare feasibility assessments, delivery estimates, and technical plans for data engineering initiatives across business areas
  • Oversee the data application lifecycle from analysis and design through testing, deployment, and production support
  • Partner with analytics and reporting teams to develop Tableau dashboards and turn source data into useful business insights
  • Administer and troubleshoot Linux-based data processes to maintain system stability, performance, and operational continuity
  • Evaluate delivery risks and align data engineering solutions with security, governance, and compliance requirements

Requirements

  • Bring 5–8 years of experience in data engineering, big data development, or software application development focused on large-scale data platforms
  • Demonstrate hands-on Python and PySpark development experience for large-scale ingestion, transformation, and pipeline orchestration
  • Have expert-level knowledge of ETL, Oracle Database, and SQL
  • Have working knowledge of Databricks
  • Understand Hadoop ecosystem technologies such as HDFS, Hive, and cluster operations, including familiarity with Ozone storage
  • Work effectively in Linux environments using scripting, job scheduling, and process management
  • Have experience creating or supporting Tableau dashboards and reports
  • Be familiar with RStudio for statistical analysis or data exploration in data engineering contexts
  • Bring deep expertise in large language models, including OpenAI, Gemini, Claude, Llama, and local or open-source models
  • Hold a bachelor’s degree or equivalent experience in a relevant technical field
  • Have experience managing and delivering successful projects
  • Understand consulting and project management techniques and methods
  • Be able to work under pressure while meeting deadlines and adapting to unexpected changes in requirements or expectations
  • Have experience with cloud-native data platforms or migrating workloads from on-premises Hadoop environments to modern data platforms
  • Understand data governance, metadata management, or data quality frameworks used in large-scale environments
  • Be familiar with consulting or project management methods used in technology delivery

Benefits

  • Hybrid schedule with two days in the office and three days working remotely
  • Ongoing learning and professional development resources
  • Autonomy to make technical decisions with limited direct supervision, including opportunities to serve as a subject matter expert for senior stakeholders
  • Defined career progression opportunities within Citi’s global technology organization
  • Financial wellbeing support and benefits aligned with location and level

Related Jobs

Jerry

Associate Business Operations & Analytics Analyst

Jerry

Join Jerry’s Business Operations & Analytics team, working with growth, product, AI and automation, or strategic partnerships. Use analysis to guide decisions for its AI-powered physical asset management app.

Open
Jerry

Senior Associate, Business Operations Analytics (Remote, US)

Jerry

Join Jerry.ai’s growth, product, AI and automation, or partnerships team to lead business analytics. Design experiments, uncover insights, and guide decisions for an AI-powered physical asset platform.

Open
Creative information Technology

Senior Java Developer, Onsite in Virginia

Creative information Technology
11 – 50 Employees
B2BHardwareSecurity

Build scalable Java microservices for CITI, an IT services provider serving government and commercial clients. Develop secure applications for identity, credentials, and access management.

Open