Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer (Freelance, Remote in Argentina)

Build dependable Python scraping systems for Mindrift’s AI projects. Extract, validate, and scale structured data from complex, dynamic websites.

Description

  • Lead complete data extraction workflows across complex websites
  • Deliver comprehensive, accurate, and dependable structured datasets
  • Combine available tools with custom workflows to improve collection, validation, and task execution
  • Collect data from dynamic and interactive sources while adapting to JavaScript-rendered content and evolving site behavior
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic review
  • Scale large-volume scraping through efficient batching and parallel processing
  • Track extraction failures and preserve workflow reliability as site structures change
  • Use Apify, OpenRouter, and related technologies alongside strong technical judgment

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • Advanced Python scraping experience with BeautifulSoup, Selenium or comparable tools, JavaScript and AJAX content, infinite scroll, and proxy-based APIs
  • Ability to extract information from hierarchical data, archived pages, and irregular HTML structures
  • Experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets
  • Practical experience overcoming anti-bot protections and changing website structures at scale
  • Experience with AWS or comparable cloud infrastructure and Docker-based containerization
  • Hands-on familiarity with LangChain, OpenRouter, or similar LLM frameworks for automation
  • High attention to detail and a strong focus on data accuracy
  • Ability to work independently, investigate issues, and resolve problems without close supervision
  • Upper-intermediate English proficiency (B2) or higher
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical discipline is a plus
  • A GitHub profile or link is a plus

Benefits

  • Freelance engagement
  • Part-time workload of approximately 10–20 hours per week during active project phases
  • Remote work from Argentina
  • Opportunity to contribute to innovative technology projects through the Mindrift platform

Related Jobs