Allstate
Allstate
Allstate provides insurance and protection products across home, auto, device, and identity coverage. Its work centers on helping customers manage risk, protect their finances, and navigate unexpected events with greater confidence. The company also highlights community involvement and sustainability as part of its broader approach to serving customers and contributing to positive social impact.

Remote Data Engineer – Risk Data (Illinois)

Build governed risk data pipelines and analytics products for Allstate. Turn fragmented risk data into reliable datasets, dashboards, and AI-ready capabilities.

Description

  • Design and maintain trusted risk data products and scalable batch and streaming pipelines with cloud-native technologies.
  • Integrate risk, control, vendor, operational, and external data into governed datasets ready for analytics.
  • Create and improve ETL/ELT workflows for automated ingestion, transformation, validation, reconciliation, and delivery.
  • Manage data processing workloads across modern data lake and lakehouse environments, including Microsoft Fabric and OneLake.
  • Establish data quality, monitoring, lineage, and reconciliation practices.
  • Produce curated datasets and analytical outputs for reporting, leadership dashboards, trend analysis, risk detection, and decision support.
  • Refine data architectures, schemas, and processing patterns to improve scalability, performance, resilience, and cost efficiency.
  • Build reusable frameworks, engineering standards, CI/CD pipelines, automated tests, and operational monitoring.
  • Collaborate with analytics, product, risk, governance, security, and compliance teams on definitions, metrics, quality standards, and secure access.
  • Contribute to Agile delivery through sprint planning, backlog refinement, design reviews, and continuous improvement.

Requirements

  • At least four years of experience as a Data Engineer or in a comparable role supporting production-grade pipelines and data products.
  • Practical experience using Apache Spark for large-scale data processing and transformation.
  • Strong command of Python, SQL, and modern data engineering practices.
  • Experience developing ETL/ELT solutions on cloud data lake, lakehouse, or analytics platforms.
  • Experience designing and optimizing analytical models for reporting, dashboards, operational insights, and advanced analytics.
  • Solid knowledge of data quality, validation, monitoring, reconciliation, and production support.
  • Experience with CI/CD, version control, automated testing, and infrastructure-as-code concepts.
  • Ability to investigate complex data quality, performance, and integration problems across multiple sources.
  • Strong written and verbal communication skills.
  • Microsoft Fabric, OneLake, or comparable modern analytics platform experience is preferred.
  • Experience with risk, controls, compliance, audit, governance, or regulatory data.
  • Experience developing real-time, near-real-time, or event-driven processing solutions.
  • Familiarity with data governance, metadata management, lineage, access controls, and enterprise data quality frameworks.
  • Experience using orchestration and workflow management tools for data pipelines.
  • Experience supporting operational reporting, executive dashboards, trend analysis, advanced analytics, or machine learning initiatives.
  • Successful completion of a background investigation is required.
  • Reliable internet service with minimum speeds of 50 MB download and 5 MB upload.
  • A dedicated private workspace with suitable desk and seating, free from distractions.
  • Allstate generally does not sponsor employment-based visas for this position.

Benefits

  • Technology equipment package including a laptop, monitors, headset, keyboard, and mouse.
  • Monthly connectivity reimbursement for employees eligible to work from home.

Related Jobs

The Clorox Company

Shopper Insights & Analytics Manager - Amazon, Hybrid

The Clorox Company

Lead shopper and category analytics that support The Clorox Company’s Amazon growth. Turn behavior, research, and retail data into decisions on assortment, pricing, content, conversion, and repeat purchasing.

Open