LogoFresh Jobs Ahead
State Street
State Street
H1B Visa SponsorBankingFinanceFintech
State Street is a global financial services company serving institutional investors through investment management and investment servicing solutions. Its offerings include asset management, custodial services, and investment research, supported by expertise across finance, fintech, and banking. The company focuses on helping clients manage complex investment activities with data, insights, and operational capabilities designed to improve efficiency and support financial decision-making.
LinkedIn
Company Jobs

Senior Databricks Data Engineer

Build Azure and Databricks data pipelines for State Street’s financial services platform. Develop ETL processes, data lakes, and scalable frameworks as part of an agile team.

USUnited StatesMAMassachusettsNJNew Jersey
$120,000 – $202,500 / year
HybridFull-timeSeniorEnglish RequiredData Engineer
ApacheAzureCloudDockerETLKubernetesScalaShell ScriptingSparkSQLUnix

Description

  • Build and test end-to-end streaming, event-driven, and batch data pipelines on Azure and Cosmos DB.
  • Create ETL processes that ingest, transform, and load data into data lakes.
  • Apply Databricks and data warehousing concepts to engineering work.
  • Design and develop configurable frameworks and libraries for high-throughput data processing.
  • Advance change through collaboration, influence, and proof-of-concept demonstrations.
  • Carry out software development lifecycle work, including design, coding, integration testing, deployment, and documentation.
  • Work collaboratively within an agile project team.
  • Apply established engineering practices and coding standards.
  • Monitor data pipelines and investigate issues.
  • Add data quality checks and validation.
  • Help develop, enhance, and maintain the platform as part of an agile scrum team.
  • Build and expand professional skills.

Requirements

  • Hold a bachelor's degree or equivalent qualification in computer science, IT, or a related field.
  • Bring at least 10 years of experience with big data pipelines.
  • Have at least 5 years of hands-on Databricks experience.
  • Have at least 5 years of cloud development experience, including Azure services, Azure DevOps, Kubernetes, and Docker.
  • Understand microservices architecture and cloud computing; Azure experience is preferred.
  • Be proficient with Databricks, Delta Lake, and Apache Spark.
  • Have hands-on development experience with Databricks SQL and Scala.
  • Understand Databricks resources, including clusters and jobs.
  • Have experience troubleshooting DevOps pipelines with ADO and Harness.
  • Use version control tools such as Git.
  • Have experience working with semi-structured formats such as Avro, JSON, and XML.
  • Have basic knowledge of shell scripting, UNIX, TOAD, and SQL Developer.
  • Have experience with data analysis and exploration.
  • Have experience working in the financial industry.
  • Have experience with agile development methods.
  • Communicate effectively in writing and in professional conversations.
  • Be able to multitask and bring energy, adaptability, and problem-solving skills.

Benefits

  • 401(k) retirement plan with company matching contributions.
  • Insurance options include basic life, medical, dental, vision, long-term disability, and additional optional coverage.
  • Paid time off includes vacation, sick leave, short-term disability, and leave for family care responsibilities.
  • Access to an Employee Assistance Program.
  • May qualify for annual performance-based incentive awards.
  • May qualify for certain tax-advantaged savings plans.
  • Opportunities for inclusive professional development.
  • Support for a flexible work-life balance.
  • Paid days to volunteer.
  • Employee networks.

Related Jobs

State Street

Senior Databricks Data Engineer, Vice President — State Street (Quincy, Hybrid)

State Street
H1B Visa SponsorBankingFinanceFintech
USUnited StatesMAMassachusettsNJNew Jersey
$120,000 – $202,500 / year
HybridFull-timeSeniorEnglish RequiredData Engineer
ApacheAzureCloudDockerETLKubernetesScalaShell ScriptingSparkSQLUnix

Build Azure and Databricks data pipelines for State Street’s financial services platform. Develop ETL, data quality, and high-throughput frameworks as part of an agile team.

Open