Derevo
Derevo
51 – 200 Zaposleni
LogistikaSvetovanjeTrženje
Derevo is a data analytics and digital transformation company that helps organizations turn data into business intelligence. Its work spans the full analytics lifecycle, from data creation and integration to analysis and sharing, alongside efforts to build data-driven cultures. The company applies AI and machine learning in analytics solutions across industries and uses a nearshore delivery model with global teams, particularly serving clients in the United States and Canada. With more than a decade of experience, Derevo works with technology providers to support organizations through data-led change. Its teams work across consulting, logistics, and marketing, and the company hires across its organization.

Senior Data Engineer, Microsoft Fabric

Build Microsoft Fabric architectures, lakehouses, and data pipelines for Derevo’s data and AI solutions. Turn large-scale data into insights that support business decisions.

Opis

  • Build and implement high-quality modern data architectures
  • Develop analytical solutions using Big Data technologies
  • Design, maintain, and optimize parallel processing systems
  • Apply best practices for storing and managing data warehouses, data lakes, and lakehouses
  • Collect, process, clean, and orchestrate large volumes of data
  • Integrate and transform data from multiple structured and semi-structured sources
  • Define technical strategies aligned with business objectives
  • Join the project and its sprints, carrying out development work
  • Identify requirements and define scope
  • Take part in sprint planning, engineering sessions, workshops, and meetings with internal teams and clients
  • Classify and estimate tasks using agile methodologies
  • Track sprint progress daily
  • Meet delivery dates and manage risks by communicating delays promptly

Zahteve

  • Advanced English proficiency
  • Strong command of T-SQL and Spark SQL, including DDL, DML, subqueries, CTEs, multiple joins, aggregations, window functions, stored procedures, index optimization, statistics, and execution plans
  • Strong Python (PySpark) skills, including object-oriented programming, data structures, control flow, data ingestion, DataFrames, UDFs, time windows, partitioning, PEP 8, and modularity
  • Experience using JSON and REST APIs for pipeline orchestration, CI/CD deployments, dynamic parameterization, and artifact management
  • Knowledge of Microsoft Fabric, Lakehouse, OneLake, Delta Lake, and ACID-compliant Delta tables
  • Knowledge of partitioning, OPTIMIZE, Z-ORDER, and time travel
  • Knowledge of warehouses (Synapse Analytics), provisioned and serverless SQL clusters, star and snowflake schemas, transactional T-SQL, isolation, and autoscaling
  • Experience with CI/CD and lifecycle management using Azure DevOps or GitHub Actions
  • Knowledge of dataset unit testing, schema validation, and automated artifact deployment
  • Knowledge of Monitor Hub and Activator, metrics dashboards, proactive alerts, and automated runbooks
  • Knowledge of Eventstreams and Eventhouse for real-time event ingestion, processing windows, and incremental aggregations
  • Knowledge of data security and governance, roles and permissions, row-level and column-level security, dynamic data masking, and auditing
  • General knowledge of Azure Data Factory is a plus
  • Strong communication, Squad-based teamwork, proactivity, collaboration, continuous learning, accountability, organization, data consulting, requirements management, client-aligned strategy, and client presentation skills

Ugodnosti

  • Statutory and additional benefits
  • Opportunities to develop expertise across different areas and technologies
  • Cross-disciplinary development and new challenges
  • An environment that offers space, trust, and freedom to create
  • Required training
  • Work on leading-edge technology projects for multinational clients
  • Flexible remote work
  • Equipment needed for work
  • Internal communication tools

Sorodna delovna mesta

Spyrosoft

Business Analyst and Product Owner, Financial Experience

Spyrosoft

Shape accounting and finance workflows into roadmaps for HR and ERP platforms. Work with client experts and cross-functional teams to guide delivery at Spyrosoft.

Odpri