State Street
State Street
State Street is a global financial services company serving institutional investors through investment management and investment servicing solutions. Its offerings include asset management, custodial services, and investment research, supported by expertise across finance, fintech, and banking. The company focuses on helping clients manage complex investment activities with data, insights, and operational capabilities designed to improve efficiency and support financial decision-making.

Senior Databricks Data Engineer, Vice President — State Street (Quincy, Hybrid)

Build Azure and Databricks data pipelines for State Street’s financial services platform. Develop ETL, data quality, and high-throughput frameworks as part of an agile team.

Description

  • Build and test end-to-end cloud data pipelines for streaming, event-driven, and batch ingestion using Azure and Cosmos DB.
  • Create ETL processes to ingest, transform, and load data into data lakes.
  • Apply Databricks and data warehousing concepts in engineering work.
  • Create configurable frameworks and libraries designed for high throughput.
  • Advance change by collaborating, influencing stakeholders, and demonstrating proofs of concept.
  • Contribute across the software development lifecycle, from design and coding through integration testing, deployment, and documentation.
  • Collaborate with colleagues on an agile project team.
  • Apply established engineering practices and coding standards.
  • Monitor data pipelines and troubleshoot problems to resolve them.
  • Add data quality checks and validations to maintain accuracy.
  • Analyze data and explore datasets.
  • Continue developing professional skills.

Requirements

  • Bachelor’s degree in computer science, information technology, or a related field.
  • At least 10 years of experience with big data pipelines.
  • At least 5 years of hands-on Databricks experience.
  • At least 5 years developing on cloud platforms, including Azure services, Azure DevOps, Kubernetes, and Docker.
  • Experience with microservices architecture and cloud computing; Azure is preferred.
  • Working proficiency with Databricks, Delta Lake, and Apache Spark.
  • Hands-on Databricks SQL and Scala development experience.
  • Strong understanding of Databricks resources, including clusters and jobs.
  • Substantial hands-on experience troubleshooting DevOps pipelines, including ADO and Harness.
  • Experience with version control tools such as Git.
  • Experience working with semi-structured formats such as Avro, JSON, and XML.
  • Basic familiarity with shell scripting, UNIX, TOAD, and SQL Developer.
  • Strong professional communication skills, written and verbal.
  • Experience in the financial services industry.
  • Experience with agile development methods.
  • Snowflake experience is a plus.

Benefits

  • 401(k) retirement savings plan with company matching.
  • Insurance options including basic life, medical, dental, vision, long-term disability, and other optional coverage.
  • Paid leave covering vacation, sick time, short-term disability, and family care responsibilities.
  • Employee Assistance Program.
  • Eligibility for annual performance-based incentive awards.
  • Eligibility for certain tax-advantaged savings plans.
  • Inclusive opportunities for professional development.
  • Support for work-life flexibility.
  • Paid days for volunteering.
  • Employee networks.

Related Jobs