Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Web Scraping Engineer (Freelance, Remote)

Build and scale dependable Python web-scraping workflows for Mindrift’s AI projects. Extract, validate, and deliver accurate structured data from complex, dynamic websites.

Description

  • Perform technically precise web-scraping and data-processing assignments
  • Manage complete extraction workflows across complex websites, delivering comprehensive, accurate, and reliable structured datasets
  • Use available tools and tailored workflows to speed up collection, validation, and task completion against defined requirements
  • Adapt extraction methods for JavaScript-rendered pages, interactive sources, and evolving website behavior
  • Apply data-quality controls including validation, cross-source checks, formatting standards, and systematic pre-delivery verification
  • Scale large-volume scraping through efficient batching or parallel processing
  • Track extraction failures and preserve operational stability through minor changes in site structure
  • Use Apify, OpenRouter, and other relevant technologies to support scraping operations

Requirements

  • Bring at least 5 years of relevant experience in data engineering, web scraping, automation, or software development
  • Demonstrate strong Python scraping skills with BeautifulSoup, Selenium or comparable tools, dynamic content, and proxy-based APIs
  • Extract information from complex structures including hierarchies, archived pages, and irregular HTML
  • Clean, normalize, and validate data for delivery in CSV, JSON, or Google Sheets
  • Handle anti-bot protections and changing site structures at scale
  • Work with AWS or comparable cloud infrastructure and Docker-based containerization
  • Apply LLM frameworks such as LangChain, OpenRouter, or similar tools to automation workflows
  • Maintain exceptional attention to detail and data accuracy
  • Work independently with a self-directed approach to troubleshooting
  • Communicate in English at upper-intermediate level (B2) or higher
  • A Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical discipline is a plus
  • A GitHub profile link is a plus

Benefits

  • Freelance engagement
  • Part-time remote schedule
  • Approximately 10–20 hours per week during active project phases
  • Opportunity to contribute to innovative technology projects through the Mindrift platform

Related Jobs

Talkdesk

Senior Solution Consultant, CXA and CCaaS - United States

Talkdesk

Lead strategic implementations of Talkdesk CXA and CCaaS solutions, helping customers integrate the technology and achieve lasting adoption. Partner with customers, executives, and internal teams to guide implementation strategy and long-term success.

Open
Naveera Technology LLC

Senior .NET Core Engineer – React and Claude AI

Naveera Technology LLC
201 – 500 Employees
ConsultingHealthcareLogistics

Lead full-stack engineering work across insurance and payments platforms using .NET, React, AWS, and Claude AI. Drive architecture, batch processing, and distributed-systems initiatives.

Open