
Leega je latinskoameriško tehnološko svetovalno podjetje, osredotočeno na podatkovno analitiko, rešitve v oblaku in digitalno preobrazbo. Njegove storitve vključujejo razvoj aplikacij, strojno učenje, analitiko upravljanja tveganj ter podporo organizacijam pri posodabljanju njihovih podatkovnih okolij. Leega sodeluje s platformami Google Cloud, AWS in Microsoft Azure ter podjetjem pomaga izboljšati upravljanje podatkov in uvajati tehnologije v oblaku. Podjetje se opredeljuje tudi kot prva organizacija v regiji, ki jo je Google Cloud certificiral za podatkovno analitiko.
Senior GCP Data Engineer
Build a centralized Google Cloud data hub for a building materials company, creating pipelines, applying the Medallion Architecture, and modeling analytical data.
Opis
- Create and maintain data ingestion pipelines from ERP, quality and production systems, portals, spreadsheets, and other sources.
- Orchestrate data extraction, scheduling, and failure handling with Apache Airflow.
- Apply the Bronze, Silver, and Gold layers of the Medallion Architecture, storing raw data in Cloud Storage and modeling it in BigQuery.
- Model business entities and shared master data, including customers, products, and third parties.
- Support the semantic layer used by dashboards.
- Reconcile data in the hub against source systems to maintain quality and consistency.
- Prepare Gold-layer entities for use by AI and machine learning models.
- Version code and manage deployments across development, staging, and production environments.
- Monitor pipeline runs and resolve failures, aiming for operations that require no manual intervention.
- Document pipelines, data models, and technical decisions.
- Help train the client team during final delivery.
- Join weekly reviews and validate deliverables with business teams.
- Work with architecture and data science colleagues in a multidisciplinary squad to build a centralized Google Cloud data hub for a major building materials company.
Zahteve
- At least 5 years of experience as a data engineer on cloud data projects.
- At least 3 years of experience with Google Cloud, especially BigQuery and Cloud Storage.
- At least 3 years of experience orchestrating pipelines with Apache Airflow.
- Strong SQL skills and analytical data modeling expertise, with at least 5 years of experience.
- At least 4 years of experience using Python to build data pipelines.
- Knowledge of the Medallion Architecture and its Bronze, Silver, and Gold layers.
- Experience integrating data from multiple sources, including ERPs, APIs, files, and spreadsheets.
- Experience with version control and deploying code across environments.
- Google Cloud certifications are a plus.
- Experience extracting data from enterprise ERP systems is a plus.
- Knowledge of tax, financial, or industrial data is a plus.
- Experience preparing data for machine learning models is a plus.
- Consulting project experience is a plus.
- Hands-on experience with Google Cloud (BigQuery and Cloud Storage), Apache Airflow, SQL, and Python is essential.
Ugodnosti
- Continued professional development.
- Remote work.
- Commitment to disability inclusion; candidates with disabilities are also encouraged to apply.
Sorodna delovna mesta
Ni najdenih delovnih mest
Poskusite prilagoditi ali počistiti filtre, da najdete več priložnosti.