Instituto de Pesquisas Eldorado
Instituto de Pesquisas Eldorado
Instituto de Pesquisas Eldorado este un institut brazilian de cercetare și dezvoltare înființat în 1999, care ajută organizațiile să transforme inițiativele tehnologice în produse testate și inovație practică. Activitatea sa include certificarea produselor de telecomunicații, testarea în laborator și consultanță în domeniul inovării pentru sectoare precum industria auto, sănătatea, logistica, agricultura, energia și industria petrolului și gazelor. Institutul dezvoltă, de asemenea, programe de formare și educație și colaborează cu parteneri din industrie și cercetare pentru a extinde capacitățile tehnologice.

Data Analyst – PySpark, SQL and Power BI

Build data pipelines, models and dashboards for Instituto de Pesquisas Eldorado’s Brazilian R&D center. Work with PySpark, SQL, Databricks and Power BI.

Descriere

  • Create and deploy ingestion pipelines using REST APIs, web scraping, legacy SQL procedures and files
  • Help implement read-only replication for systems without direct database access, accounting for performance impact
  • Transform data with PySpark and SQL
  • Assist with processing cost and performance benchmarks and efficient resource sizing
  • Help build Bronze, Silver and Gold data layers using the medallion architecture
  • Build resilient scraping pipelines with layout-change detection and blocking mitigation
  • Deduplicate and normalize data, and test its quality
  • Help implement data contracts and schema-drift alerts for third-party integrations
  • Create Power BI dashboards and reports
  • Turn business needs into data models and clear visualizations
  • Apply Row-Level Security to reports in line with RBAC policies
  • Create data quality tests and declarative transformations with dbt
  • Help configure self-service analytics features, including Fabric Copilot
  • Work with data governance teams to maintain lineage and classification
  • Find and fix performance issues in pipelines and queries
  • Run user acceptance tests and improve dashboards based on feedback

Cerințe

  • Bachelor’s degree in Computer Science, Computer Engineering, Systems Analysis or a related field
  • Mid-level experience in data engineering, Python or PySpark, and SQL
  • Familiarity with Databricks or Spark
  • Familiarity with orchestration tools such as Azure Data Factory
  • Familiarity with analytical data formats such as Parquet and Delta Lake
  • dbt knowledge is an advantage
  • Familiarity with Git and CI/CD for data pipelines
  • Experience integrating data through REST APIs
  • Knowledge of data visualization practices and data storytelling
  • Experience working with varied data sources, including SQL, APIs, files, Lakehouse and Warehouse
  • Experience implementing Row-Level Security
  • Willingness to travel to São Paulo is an advantage
  • Advanced English is an advantage

Beneficii

  • Equal opportunity for all candidates
  • A diverse and inclusive workplace
  • Open to candidates with disabilities
  • Hybrid work arrangement
  • Opportunities to build experience and contribute to relevant projects
  • Access to the organization’s laboratory infrastructure and R&D projects

Locuri de muncă similare

Spyrosoft

Business Analyst and Product Owner, Financial Experience

Spyrosoft

Shape accounting and finance workflows into roadmaps for HR and ERP platforms. Work with client experts and cross-functional teams to guide delivery at Spyrosoft.

Deschide