DysrupIT je podjetje za storitve v oblaku in IT-rešitve, ki organizacijam pomaga posodobiti tehnologijo in preiti na operativne modele tipa as-a-Service. Njegovo delo vključuje poslovni oblak, upravljane storitve, razvoj aplikacij, kibernetsko varnost ter podatkovno analitiko in upravljanje informacij, pri čemer podpira tako mala in srednja podjetja kot večnacionalne korporacije. Podjetje sodeluje z Microsoftom in drugimi oblačnimi platformami ter združuje tehnično izvedbo z razvojem talentov, vplivom na skupnost in dolgoročnimi partnerstvi, da bi ustvarilo varna in razširljiva tehnološka okolja, usklajena s poslovnimi potrebami.
Senior Data Engineer, GCP Financial Pipelines
Build auditable Google Cloud data pipelines for financial billing and invoicing. Use BigQuery, Python, SQL, and data quality controls to support accurate reconciliation.
Opis
- Build and maintain GCP ingestion pipelines for financial and billing data.
- Develop BigQuery models with nested ARRAY/STRUCT tables, partitioning, and clustering.
- Add reconciliation checks across source, staging, and output layers.
- Validate incoming files and quarantine invalid or incomplete data.
- Create idempotent pipelines that can be rerun without duplication or corruption.
- Use append-only tables and views as checks to support auditability.
- Process monetary values with BigQuery NUMERIC types and appropriate rounding.
- Manage reference data with effective dates, including rates, mappings, and customer attributes.
- Track data lineage from outputs back to source data.
- Write typed, maintainable, well-tested Python using pydantic and pytest.
- Develop and tune advanced SQL for transformation, reconciliation, and reporting.
- Work with engineering, analytics, and finance stakeholders to turn business rules into dependable data logic.
- Mentor colleagues and help establish data engineering standards and practices.
Zahteve
- At least six years of data engineering experience.
- Demonstrated experience building financial or billing pipelines that require every amount to reconcile.
- Strong Python skills, including pydantic, typed code, and pytest.
- Advanced SQL skills, including complex joins, window functions, and performance tuning.
- In-depth Google BigQuery experience, including nested ARRAY/STRUCT tables, partitioning, and clustering.
- Experience handling monetary values accurately with NUMERIC data types.
- Experience designing append-only tables and using views as data checks.
- Strong knowledge of data quality practices, including reconciliation checks, file validation, and quarantine.
- Experience building idempotent pipelines that can be rerun safely.
- Experience implementing data lineage and managing reference data with effective dates.
- Invoicing experience covering credit notes, rebills, foreign exchange conversion, and month-end close.
- Experience working with finance or billing teams in a regulated or audited environment.
- Experience with other GCP services such as Cloud Storage, Cloud Run, or Firestore.
Ugodnosti
- Competitive compensation based on experience.
- Government-mandated benefits.
- Supplemental HMO coverage.
- Collaborative, professional work environment.
- Career growth opportunities in a growing organization.
- Hybrid or remote work arrangement, where applicable.
- Training to support employee development and career advancement.