Itix
Itix
Itix este o companie braziliană de tehnologie și consultanță care ajută organizațiile să își modernizeze operațiunile prin platforme software personalizate, echipe de dezvoltare dedicate și servicii de consultanță tehnologică. Serviciile sale includ, de asemenea, asistență și analiză sau inteligență de afaceri, permițând clienților corporate să își îmbunătățească procesele și să utilizeze datele mai eficient. Itix colaborează cu organizații din domenii precum industria, finanțele, sănătatea, logistica, asigurările, energia, industria chimică și mineritul, cu sprijinul unor echipe distribuite în întreaga Brazilie.

Mid-Level Data Engineer at Itix (Remote, Brazil)

Join Itix as a Data Engineer building Lakehouse pipelines and RAG solutions. Work with Databricks, Delta Lake, embeddings, data quality, and governance.

Descriere

  • Build ETL/ELT pipelines in Databricks or open-source frameworks within a Delta Lake medallion architecture
  • Process and standardize PDF and image data with associated metadata
  • Curate and anonymize data under Brazil’s LGPD for RAG, few-shot learning, and test datasets
  • Develop and maintain vector indexes with chunking, embeddings, incremental updates, and version control
  • Create versioned golden datasets for accuracy measurement and benchmarking
  • Design feedback-loop persistence and supply data to the Quality and SLA Dashboard
  • Connect databases with inference services and external APIs while managing performance, cost, monitoring, and alerts
  • Automate workflows through Jobs, CI/CD pipelines, and data quality testing

Cerințe

  • Advanced proficiency in Python and SQL
  • Experience with data modeling and medallion or Lakehouse architectures
  • Experience building unstructured data pipelines for PDFs, images, and text, including preparation for RAG
  • Familiarity with vector databases and embeddings such as Databricks Vector Search or pgvector
  • Experience with data quality, testing, and version control
  • Practical Databricks experience with Delta Lake, Workflows or Jobs, notebooks, PySpark, and Spark SQL
  • Experience with Git and CI/CD
  • Experience working in Azure, AWS, or GCP
  • Knowledge of LGPD and sensitive-data handling
  • Unity Catalog experience in a governed environment
  • Experience with MLflow, Databricks Model Serving, or Mosaic AI
  • Experience with Delta Live Tables or Lakeflow and Auto Loader
  • Experience in insurance or financial services
  • Experience with Terraform or Databricks Asset Bundles
  • Databricks Data Engineer Associate or Professional certification

Beneficii

  • Geographic flexibility to work from the location that best fits the project
  • Discount partnerships
  • Rewarded employee referral program
  • Birthday day off
  • TotalPass or Gympass access
  • Health and wellness initiatives
  • Access to office relaxation spaces with beanbags, a pool table, video games, a lounge, a fully equipped kitchen, and coffee

Locuri de muncă similare

Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Deschide