Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer — Remote in the Philippines

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI projects. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Descriere

  • Manage complete data extraction processes across complex websites
  • Produce structured datasets that are thorough, accurate, and dependable
  • Apply tools and tailored workflows to speed up collection, validation, and task delivery
  • Collect information from dynamic and interactive sources, including JavaScript-rendered pages
  • Adjust scraping methods as website behavior and structures evolve
  • Protect data quality through validation, cross-source checks, formatting rules, and systematic review
  • Scale large-volume scraping with efficient batching and parallel processing
  • Track extraction failures and preserve workflow stability through minor website changes

Cerințe

  • Bring at least five years of relevant experience in data engineering, web scraping, automation, or software development
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical discipline is preferred
  • Demonstrate strong Python scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic content, and proxied APIs
  • Extract information from complex sources such as hierarchies, archived pages, and inconsistent HTML
  • Clean, normalize, and validate data for delivery in CSV, JSON, or Google Sheets formats
  • Handle anti-bot protections and changing website structures in large-scale scraping projects
  • Use AWS or comparable cloud infrastructure and Docker-based containerization
  • Apply LLM frameworks such as LangChain, OpenRouter, or similar tools to automation workflows
  • Work with exceptional attention to detail and a consistent focus on data accuracy
  • Work independently while diagnosing and resolving technical issues
  • Communicate in English at upper-intermediate level (B2) or higher

Beneficii

  • Freelance project engagement
  • Part-time remote arrangement
  • Approximately 10–20 hours per week during active project periods
  • Compensation of up to $30 per hour equivalent, based on experience level and contribution pace

Locuri de muncă similare

CyberCube

Lead Actuary, Cyber Risk Analytics - CyberCube (Hybrid, New York)

CyberCube

Lead actuarial analysis and develop statistical models and tools for CyberCube’s cyber-risk analytics platform serving global insurers. Stress-test and validate models and data, then communicate findings to internal teams and customers.

Deschide
Porto a Porto

Senior Automotive Software Developer

Porto a Porto

Lead the modernization of Porto’s Auto Fleet insurance sales platform through the Fleet 4.0 project. Drive architecture, engineering, DevOps, and AI adoption across the initiative.

Deschide
Baseten

Software Engineer, LLM Inference Platform - Baseten Hybrid

Baseten

Build Baseten’s distributed LLM inference platform for AI companies. Work across Kubernetes orchestration, model APIs, routing, autoscaling, and production observability.

Deschide
Baseten

Inference Performance Software Engineer at Baseten (Hybrid)

Baseten

Baseten is hiring an inference performance engineer to optimize LLM runtimes, GPU kernels, and model-serving systems. The role focuses on improving production inference speed, hardware utilization, and cost efficiency.

Deschide
Porto a Porto

Mid-Level Java Developer, Generative AI and Agents

Porto a Porto

Java developer helping modernize Porto’s Auto Fleet insurance platform through technical leadership in microservices, DevOps, legacy-system migration, and AI accelerators.

Deschide
Globalweb Corp

Java Developer Analyst - Remote in Brazil

Globalweb Corp

Java developer building robust, scalable financial systems for Globalweb with microservices, integrations, testing, and continuous delivery.

Deschide