Instituto de Pesquisas Eldorado 1999-yilda tashkil etilgan Braziliya tadqiqot va ishlanmalar instituti bo‘lib, tashkilotlarga texnologik tashabbuslarni sinovdan o‘tgan mahsulotlar va amaliy innovatsiyalarga aylantirishda yordam beradi. Uning faoliyatiga telekommunikatsiya mahsulotlarini sertifikatlash, laboratoriya sinovlari hamda avtomobilsozlik, sog‘liqni saqlash, logistika, qishloq xo‘jaligi, energetika va neft-gaz kabi sohalar uchun innovatsion konsalting kiradi. Institut, shuningdek, ta’lim va malaka oshirish dasturlarini ishlab chiqadi hamda texnologik salohiyatni kengaytirish uchun sanoat va tadqiqot hamkorlari bilan hamkorlik qiladi.
Data Analyst – PySpark, SQL and Power BI
Build data pipelines, models and dashboards for Instituto de Pesquisas Eldorado’s Brazilian R&D center. Work with PySpark, SQL, Databricks and Power BI.
Tavsif
- Create and deploy ingestion pipelines using REST APIs, web scraping, legacy SQL procedures and files
- Help implement read-only replication for systems without direct database access, accounting for performance impact
- Transform data with PySpark and SQL
- Assist with processing cost and performance benchmarks and efficient resource sizing
- Help build Bronze, Silver and Gold data layers using the medallion architecture
- Build resilient scraping pipelines with layout-change detection and blocking mitigation
- Deduplicate and normalize data, and test its quality
- Help implement data contracts and schema-drift alerts for third-party integrations
- Create Power BI dashboards and reports
- Turn business needs into data models and clear visualizations
- Apply Row-Level Security to reports in line with RBAC policies
- Create data quality tests and declarative transformations with dbt
- Help configure self-service analytics features, including Fabric Copilot
- Work with data governance teams to maintain lineage and classification
- Find and fix performance issues in pipelines and queries
- Run user acceptance tests and improve dashboards based on feedback
Talablar
- Bachelor’s degree in Computer Science, Computer Engineering, Systems Analysis or a related field
- Mid-level experience in data engineering, Python or PySpark, and SQL
- Familiarity with Databricks or Spark
- Familiarity with orchestration tools such as Azure Data Factory
- Familiarity with analytical data formats such as Parquet and Delta Lake
- dbt knowledge is an advantage
- Familiarity with Git and CI/CD for data pipelines
- Experience integrating data through REST APIs
- Knowledge of data visualization practices and data storytelling
- Experience working with varied data sources, including SQL, APIs, files, Lakehouse and Warehouse
- Experience implementing Row-Level Security
- Willingness to travel to São Paulo is an advantage
- Advanced English is an advantage
Imtiyozlar
- Equal opportunity for all candidates
- A diverse and inclusive workplace
- Open to candidates with disabilities
- Hybrid work arrangement
- Opportunities to build experience and contribute to relevant projects
- Access to the organization’s laboratory infrastructure and R&D projects