EXL
EXL
EXL ir biznesa konsultāciju un pakalpojumu uzņēmums, kas palīdz organizācijām izmantot datus, analītiku un tehnoloģijas, lai uzlabotu darbību un pieņemtu labākus lēmumus. Uzņēmuma darbība ietver operāciju pārvaldību, lēmumu analītiku un digitālo transformāciju, kā arī pieredzi darbā ar klientiem veselības aprūpes, apdrošināšanas, finanšu un loģistikas nozarēs. EXL apvieno datu zinātni ar praktisku uzņēmējdarbības kompetenci, lai izstrādātu risinājumus, kas pielāgoti katras organizācijas mērķiem, darbības modelim un nozares kontekstam.

Databricks Tech Lead at EXL — Chennai, Hybrid

Lead Databricks lakehouse engineering for financial crime platforms. Build Delta Lake pipelines and manage Unity Catalog across development, test, and production.

Apraksts

  • Build and maintain Databricks workspaces, clusters, and compute pools across development, test, and production.
  • Set up Unity Catalog governance, access controls, fine-grained permissions, and data lineage.
  • Tune cluster types, autoscaling, and spot or preemptible nodes to balance cost and performance.
  • Establish workspace structures, access controls, and secret management using Databricks Secrets, Azure Key Vault, or AWS Secrets Manager.
  • Manage Databricks jobs, workflows, and multi-task orchestration, including dependencies.
  • Design Delta Lake tables with partitioning and Z-ordering, and compact files with OPTIMIZE and VACUUM.
  • Organize structured data lakes into Bronze, Silver, and Gold layers using the Medallion Architecture.
  • Develop Delta Live Tables pipelines with declarative ETL/ELT and built-in data quality expectations.
  • Handle schema changes, table versions, time travel, and Change Data Feed for incremental processing.
  • Create lakehouse patterns that connect Delta Lake with Kafka, ADLS, S3, and GCS.
  • Build Databricks pipelines for financial crime platforms covering AML, KYC, CRA, sanctions screening, transaction monitoring, fraud detection, and regulatory reporting.

Prasības

  • Bachelor’s or master’s degree in computer science, information technology, data engineering, or a related discipline.
  • At least 8 years of experience in data engineering or software engineering.
  • At least 3 years of hands-on Databricks experience in production.
  • Strong grounding in big data engineering, cloud data platforms, and distributed computing.
  • In-depth experience with Databricks Workspaces, Clusters, Jobs, Workflows, and Repos.
  • Proficiency in Unity Catalog, including metastore setup, catalog, schema and table management, access controls, and data lineage.
  • Practical experience developing, monitoring, and setting expectations for Delta Live Tables pipelines.
  • Strong understanding of Delta Lake internals, including its transaction log, ACID guarantees, file layout, and optimization methods.
  • Experience with Databricks SQL Warehouses, SQL Analytics, and dashboard development.
  • Knowledge of the Databricks Photon engine, serverless compute, and cost optimization.

Saistītās vakances

Neuron

Senior Frontend Engineer, Angular

Neuron

Lead frontend architecture and build Angular experiences for web and mobile on Neuron’s AI service-resolution platform. Own reusable UI components, integrations, performance, and engineer mentoring.

Atvērt
Weekday

Senior Full-Stack Java Engineering Manager

Weekday

Lead engineering teams building scalable Java and Spring Boot services with modern frontend applications. Guide architecture, reliability, mentorship, and delivery for a software development client.

Atvērt
Nokia

Senior Software Engineer, Cloud-Native Platforms

Nokia

Build Nokia’s MantaRay NM cloud-native network observability platform, working across distributed systems, Kubernetes, and CI/CD automation. Apply AI-assisted engineering tools and automation to improve software development.

Atvērt
Nokia

Senior Software Engineer, Cloud-Native Platforms

Nokia

Build Nokia’s MantaRay network management platform for telecommunications providers. Lead cloud-native distributed systems, Kubernetes, CI/CD automation, and AI-assisted engineering.

Atvērt