DysrupIT ir mākoņpakalpojumu un IT risinājumu uzņēmums, kas palīdz organizācijām modernizēt tehnoloģijas un pāriet uz pakalpojuma principā balstītiem darbības modeļiem. Uzņēmuma darbība aptver uzņēmumu mākoņrisinājumus, pārvaldītos pakalpojumus, lietojumprogrammu izstrādi, kiberdrošību, kā arī datu analītiku un informācijas pārvaldību. Tas atbalsta gan mazas un vidējas organizācijas, gan starptautiskus uzņēmumus. Sadarbojoties ar Microsoft un citām mākoņplatformām, DysrupIT apvieno tehnisko izpildi ar talantu attīstīšanu, ieguldījumu kopienā un ilgtermiņa partnerībām, lai veidotu drošas un mērogojamas tehnoloģiju vides, kas atbilst uzņēmējdarbības vajadzībām.
Senior Data Engineer, GCP Financial Pipelines
Build auditable Google Cloud data pipelines for financial billing and invoicing. Use BigQuery, Python, SQL, and data quality controls to support accurate reconciliation.
Apraksts
- Build and maintain GCP ingestion pipelines for financial and billing data.
- Develop BigQuery models with nested ARRAY/STRUCT tables, partitioning, and clustering.
- Add reconciliation checks across source, staging, and output layers.
- Validate incoming files and quarantine invalid or incomplete data.
- Create idempotent pipelines that can be rerun without duplication or corruption.
- Use append-only tables and views as checks to support auditability.
- Process monetary values with BigQuery NUMERIC types and appropriate rounding.
- Manage reference data with effective dates, including rates, mappings, and customer attributes.
- Track data lineage from outputs back to source data.
- Write typed, maintainable, well-tested Python using pydantic and pytest.
- Develop and tune advanced SQL for transformation, reconciliation, and reporting.
- Work with engineering, analytics, and finance stakeholders to turn business rules into dependable data logic.
- Mentor colleagues and help establish data engineering standards and practices.
Prasības
- At least six years of data engineering experience.
- Demonstrated experience building financial or billing pipelines that require every amount to reconcile.
- Strong Python skills, including pydantic, typed code, and pytest.
- Advanced SQL skills, including complex joins, window functions, and performance tuning.
- In-depth Google BigQuery experience, including nested ARRAY/STRUCT tables, partitioning, and clustering.
- Experience handling monetary values accurately with NUMERIC data types.
- Experience designing append-only tables and using views as data checks.
- Strong knowledge of data quality practices, including reconciliation checks, file validation, and quarantine.
- Experience building idempotent pipelines that can be rerun safely.
- Experience implementing data lineage and managing reference data with effective dates.
- Invoicing experience covering credit notes, rebills, foreign exchange conversion, and month-end close.
- Experience working with finance or billing teams in a regulated or audited environment.
- Experience with other GCP services such as Cloud Storage, Cloud Run, or Firestore.
Priekšrocības
- Competitive compensation based on experience.
- Government-mandated benefits.
- Supplemental HMO coverage.
- Collaborative, professional work environment.
- Career growth opportunities in a growing organization.
- Hybrid or remote work arrangement, where applicable.
- Training to support employee development and career advancement.