Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer — Remote in Romania

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Description

  • Manage complete data-extraction workflows across complex websites, maintaining broad coverage, accuracy, and dependable delivery of structured datasets.
  • Use available tools and tailored workflows to speed up collection, validation, and task execution in line with project requirements.
  • Extract data reliably from dynamic and interactive websites by adapting to JavaScript-rendered content and evolving site behavior.
  • Maintain data-quality standards through validation, cross-source consistency checks, formatting controls, and systematic pre-delivery verification.
  • Scale large-volume scraping with efficient batching or parallel processing, investigate failures, and preserve stability through minor site-structure changes.
  • Apply web-scraping, data-extraction, and data-processing expertise to the Tendem project.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Advanced Python scraping experience with BeautifulSoup, Selenium, or comparable tools, including JavaScript, AJAX, infinite scroll, and proxy-based APIs.
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Strong experience cleaning, normalizing, and validating data for structured outputs including CSV, JSON, and Google Sheets.
  • Practical experience managing anti-bot protections and changing website structures at scale.
  • Experience using AWS or equivalent cloud infrastructure and Docker containerization in production workflows.
  • Hands-on experience applying LLM frameworks such as LangChain or OpenRouter to automation tasks.
  • Exceptional attention to detail and a consistent focus on data accuracy.
  • Ability to work independently, troubleshoot issues, and drive tasks to resolution.
  • Upper-intermediate English proficiency at B2 level or higher.
  • A GitHub profile is an advantage.

Benefits

  • Freelance engagement.
  • Part-time schedule.
  • Remote work from Romania.
  • Approximately 10–20 hours per week during active project phases.
  • Compensation of up to $40 per hour equivalent.

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open