Acuity
Acuity
Acuity este o companie de tehnologie industrială cu sediul în Atlanta, specializată în soluții de iluminat și de gestionare a clădirilor. Prin Acuity Brands Lighting și Acuity Intelligent Spaces, aproximativ 13.000 de angajați dezvoltă produse de iluminat inteligente și instrumente pentru gestionarea inteligentă a spațiilor, care îi ajută pe clienți să îmbunătățească experiențele, productivitatea și sustenabilitatea. Compania combină interoperabilitatea datelor cu platforme tehnologice avansate pentru a răspunde nevoilor în schimbare din mediile de construcții, consultanță și energie.

Senior Data Engineer at Acuity — Cork, Ireland (On-site)

Build Databricks and Azure lakehouse pipelines for Acuity’s industrial technology business. Create reliable data products for reporting, analytics, AI, and downstream applications.

Descriere

  • Build and optimize scalable ETL/ELT pipelines with Databricks, Python/PySpark, SQL, Delta Lake, and Azure.
  • Ingest data from databases, APIs, files, SaaS applications, and event sources through batch and streaming workflows.
  • Develop reusable bronze, silver, and gold datasets with metadata-driven and configuration-driven methods.
  • Implement incremental processing, schema evolution, error handling, recovery, reconciliation, and audit controls.
  • Apply data-quality rules, testing, lineage, and monitoring to produce trusted data products.
  • Work with architects, analysts, and business teams to define source-to-target mappings, business rules, and acceptance criteria.
  • Prepare high-performing datasets for Power BI, enterprise reporting, analytics, data science, AI, and downstream applications.
  • Improve the reliability, performance, and cost of pipelines, SQL, Spark workloads, storage, and table designs.
  • Use Git and Azure DevOps to manage backlogs, user stories, branches, pull requests, CI/CD, releases, and traceability.
  • Write unit, integration, and reconciliation tests, and take part in design and code reviews.
  • Monitor production pipelines, handle incidents, investigate root causes, and document operational procedures.
  • Develop reusable components and engineering standards, mentor colleagues, and support continuous improvement across the DCoE data team.

Cerințe

  • At least 5–6 years of hands-on data engineering experience building production pipelines and data products.
  • Strong knowledge of Databricks, Azure Data Lake, Delta Lake, Python/PySpark, and SQL.
  • In-depth understanding of ETL/ELT, data integration, lakehouse architecture, and bronze, silver, and gold design patterns.
  • Experience with data quality, reconciliation, schema management, orchestration, performance tuning, and production support.
  • Understanding of reporting and analytics, including how Power BI or similar BI tools consume curated data.
  • Practical experience with Agile delivery, Git, CI/CD, DevOps practices, and Azure DevOps.
  • Bachelor’s degree in computer science, information systems, engineering, or a related field, or equivalent practical experience.
  • Databricks or Microsoft Azure certification.
  • Experience working with supply chain, manufacturing, ERP, operations, or industrial data.
  • Experience with streaming, Unity Catalog, metadata-driven frameworks, data governance, or AI/ML data preparation.
  • Strong analytical and structured problem-solving abilities.
  • Clear communication with technical and business audiences.
  • Collaborative approach and a strong sense of ownership.
  • Ability to balance quality, speed, maintainability, and operational needs.
  • Ability to mentor engineers and improve standards through design and code reviews and reusable engineering practices.

Beneficii

  • Health care coverage
  • Dental coverage
  • Vision plans
  • 401(k) benefits
  • Commissions or incentive compensation, depending on the role

Locuri de muncă similare