State Street
State Street
State Street je globalno podjetje za finančne storitve, ki institucionalnim vlagateljem zagotavlja rešitve za upravljanje naložb in investicijske storitve. Njegova ponudba vključuje upravljanje premoženja, skrbniške storitve in investicijske raziskave, pri čemer jo podpirajo strokovna znanja s področij financ, finančne tehnologije in bančništva. Podjetje se osredotoča na pomoč strankam pri upravljanju zapletenih investicijskih dejavnosti s podatki, vpogledi in operativnimi zmogljivostmi, zasnovanimi za izboljšanje učinkovitosti in podporo finančnemu odločanju.

Senior Databricks Data Engineer, Vice President — State Street (Quincy, Hybrid)

Build Azure and Databricks data pipelines for State Street’s financial services platform. Develop ETL, data quality, and high-throughput frameworks as part of an agile team.

Opis

  • Build and test end-to-end cloud data pipelines for streaming, event-driven, and batch ingestion using Azure and Cosmos DB.
  • Create ETL processes to ingest, transform, and load data into data lakes.
  • Apply Databricks and data warehousing concepts in engineering work.
  • Create configurable frameworks and libraries designed for high throughput.
  • Advance change by collaborating, influencing stakeholders, and demonstrating proofs of concept.
  • Contribute across the software development lifecycle, from design and coding through integration testing, deployment, and documentation.
  • Collaborate with colleagues on an agile project team.
  • Apply established engineering practices and coding standards.
  • Monitor data pipelines and troubleshoot problems to resolve them.
  • Add data quality checks and validations to maintain accuracy.
  • Analyze data and explore datasets.
  • Continue developing professional skills.

Zahteve

  • Bachelor’s degree in computer science, information technology, or a related field.
  • At least 10 years of experience with big data pipelines.
  • At least 5 years of hands-on Databricks experience.
  • At least 5 years developing on cloud platforms, including Azure services, Azure DevOps, Kubernetes, and Docker.
  • Experience with microservices architecture and cloud computing; Azure is preferred.
  • Working proficiency with Databricks, Delta Lake, and Apache Spark.
  • Hands-on Databricks SQL and Scala development experience.
  • Strong understanding of Databricks resources, including clusters and jobs.
  • Substantial hands-on experience troubleshooting DevOps pipelines, including ADO and Harness.
  • Experience with version control tools such as Git.
  • Experience working with semi-structured formats such as Avro, JSON, and XML.
  • Basic familiarity with shell scripting, UNIX, TOAD, and SQL Developer.
  • Strong professional communication skills, written and verbal.
  • Experience in the financial services industry.
  • Experience with agile development methods.
  • Snowflake experience is a plus.

Ugodnosti

  • 401(k) retirement savings plan with company matching.
  • Insurance options including basic life, medical, dental, vision, long-term disability, and other optional coverage.
  • Paid leave covering vacation, sick time, short-term disability, and family care responsibilities.
  • Employee Assistance Program.
  • Eligibility for annual performance-based incentive awards.
  • Eligibility for certain tax-advantaged savings plans.
  • Inclusive opportunities for professional development.
  • Support for work-life flexibility.
  • Paid days for volunteering.
  • Employee networks.

Sorodna delovna mesta

State Street

Senior Databricks Data Engineer

State Street

Build Azure and Databricks data pipelines for State Street’s financial services platform. Develop ETL processes, data lakes, and scalable frameworks as part of an agile team.

Odpri
MSD

MSD Associate Director of Data Engineering and Analytics

MSD

Lead scalable data engineering and analytics for biopharmaceutical manufacturing operations, improving data access and analytics adoption. Support better decisions across regulated science and production teams.

Odpri