Acuity
Acuity
Acuity is an Atlanta-based industrial technology company specializing in lighting and building management solutions. Through Acuity Brands Lighting and Acuity Intelligent Spaces, its approximately 13,000 associates develop smart lighting products and intelligent space management tools that help customers improve experiences, productivity, and sustainability. The company combines data interoperability with advanced technology platforms to address evolving needs in construction, consulting, and energy-related environments.

Senior Data Engineer at Acuity — Cork, Ireland (On-site)

Build Databricks and Azure lakehouse pipelines for Acuity’s industrial technology business. Create reliable data products for reporting, analytics, AI, and downstream applications.

Description

  • Build and optimize scalable ETL/ELT pipelines with Databricks, Python/PySpark, SQL, Delta Lake, and Azure.
  • Ingest data from databases, APIs, files, SaaS applications, and event sources through batch and streaming workflows.
  • Develop reusable bronze, silver, and gold datasets with metadata-driven and configuration-driven methods.
  • Implement incremental processing, schema evolution, error handling, recovery, reconciliation, and audit controls.
  • Apply data-quality rules, testing, lineage, and monitoring to produce trusted data products.
  • Work with architects, analysts, and business teams to define source-to-target mappings, business rules, and acceptance criteria.
  • Prepare high-performing datasets for Power BI, enterprise reporting, analytics, data science, AI, and downstream applications.
  • Improve the reliability, performance, and cost of pipelines, SQL, Spark workloads, storage, and table designs.
  • Use Git and Azure DevOps to manage backlogs, user stories, branches, pull requests, CI/CD, releases, and traceability.
  • Write unit, integration, and reconciliation tests, and take part in design and code reviews.
  • Monitor production pipelines, handle incidents, investigate root causes, and document operational procedures.
  • Develop reusable components and engineering standards, mentor colleagues, and support continuous improvement across the DCoE data team.

Requirements

  • At least 5–6 years of hands-on data engineering experience building production pipelines and data products.
  • Strong knowledge of Databricks, Azure Data Lake, Delta Lake, Python/PySpark, and SQL.
  • In-depth understanding of ETL/ELT, data integration, lakehouse architecture, and bronze, silver, and gold design patterns.
  • Experience with data quality, reconciliation, schema management, orchestration, performance tuning, and production support.
  • Understanding of reporting and analytics, including how Power BI or similar BI tools consume curated data.
  • Practical experience with Agile delivery, Git, CI/CD, DevOps practices, and Azure DevOps.
  • Bachelor’s degree in computer science, information systems, engineering, or a related field, or equivalent practical experience.
  • Databricks or Microsoft Azure certification.
  • Experience working with supply chain, manufacturing, ERP, operations, or industrial data.
  • Experience with streaming, Unity Catalog, metadata-driven frameworks, data governance, or AI/ML data preparation.
  • Strong analytical and structured problem-solving abilities.
  • Clear communication with technical and business audiences.
  • Collaborative approach and a strong sense of ownership.
  • Ability to balance quality, speed, maintainability, and operational needs.
  • Ability to mentor engineers and improve standards through design and code reviews and reusable engineering practices.

Benefits

  • Health care coverage
  • Dental coverage
  • Vision plans
  • 401(k) benefits
  • Commissions or incentive compensation, depending on the role

Related Jobs