Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer — Freelance Remote

Build and maintain accurate, scalable web-scraping workflows for Mindrift’s Tendem AI project. Use Python and automation tools to extract, validate, and process complex web data.

Description

  • Own data extraction from start to finish across complex websites
  • Deliver structured datasets with thorough coverage, high accuracy, and dependable turnaround
  • Combine available tools with custom workflows to speed up collection, validation, and task completion
  • Collect data from dynamic, interactive websites while adapting to JavaScript-rendered content and changing site behavior
  • Protect dataset quality with validation routines, cross-source checks, formatting standards, and systematic review
  • Expand scraping capacity for large datasets through efficient batching or parallel execution
  • Track extraction failures and preserve stability when site structures undergo minor changes
  • Apply tools including Apify and OpenRouter together with strong technical judgment

Requirements

  • Bring at least five years of relevant experience in data engineering, web scraping, automation, or software development
  • Demonstrate strong Python scraping skills with BeautifulSoup, Selenium or comparable tools, JavaScript and AJAX content, infinite scroll, and proxy-based APIs
  • Show that you can retrieve data from complex sources such as hierarchies, archived pages, and inconsistent HTML
  • Know how to clean, normalize, and validate data for structured delivery in CSV, JSON, and Google Sheets
  • Have practical experience dealing with anti-bot protections and changing website structures at scale
  • Have used AWS or comparable cloud infrastructure and Docker containerization in real projects
  • Have applied LLM frameworks such as LangChain or OpenRouter to automation work
  • Work with careful attention to detail and a strong focus on data accuracy
  • Work independently, take initiative, and troubleshoot issues without close supervision
  • Communicate in English at Upper-intermediate (B2) level or higher
  • A Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical discipline is a plus
  • A GitHub profile link is a plus

Benefits

  • Part-time freelance engagement performed remotely
  • Approximately 10–20 hours per week during active project phases
  • Compensation of up to $25 per hour equivalent, based on experience level and contribution pace

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Open
Akamai Technologies

Senior Software Engineer, Security Services (Israel Remote)

Akamai Technologies

Build browser security, data loss prevention, and AI capabilities at Akamai. Lead cloud-native microservices that protect millions of enterprise workspaces.

Open
Mindrift

Senior Python Data Scraping Engineer (Freelance, Remote in Sweden)

Mindrift

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI projects. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Open