Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer — Remote in the Philippines

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI projects. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Description

  • Manage complete data extraction processes across complex websites
  • Produce structured datasets that are thorough, accurate, and dependable
  • Apply tools and tailored workflows to speed up collection, validation, and task delivery
  • Collect information from dynamic and interactive sources, including JavaScript-rendered pages
  • Adjust scraping methods as website behavior and structures evolve
  • Protect data quality through validation, cross-source checks, formatting rules, and systematic review
  • Scale large-volume scraping with efficient batching and parallel processing
  • Track extraction failures and preserve workflow stability through minor website changes

Requirements

  • Bring at least five years of relevant experience in data engineering, web scraping, automation, or software development
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical discipline is preferred
  • Demonstrate strong Python scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic content, and proxied APIs
  • Extract information from complex sources such as hierarchies, archived pages, and inconsistent HTML
  • Clean, normalize, and validate data for delivery in CSV, JSON, or Google Sheets formats
  • Handle anti-bot protections and changing website structures in large-scale scraping projects
  • Use AWS or comparable cloud infrastructure and Docker-based containerization
  • Apply LLM frameworks such as LangChain, OpenRouter, or similar tools to automation workflows
  • Work with exceptional attention to detail and a consistent focus on data accuracy
  • Work independently while diagnosing and resolving technical issues
  • Communicate in English at upper-intermediate level (B2) or higher

Benefits

  • Freelance project engagement
  • Part-time remote arrangement
  • Approximately 10–20 hours per week during active project periods
  • Compensation of up to $30 per hour equivalent, based on experience level and contribution pace

Related Jobs

Talkdesk

Senior Solution Consultant, CXA and CCaaS - United States

Talkdesk

Lead strategic implementations of Talkdesk CXA and CCaaS solutions, helping customers integrate the technology and achieve lasting adoption. Partner with customers, executives, and internal teams to guide implementation strategy and long-term success.

Open
Naveera Technology LLC

Senior .NET Core Engineer – React and Claude AI

Naveera Technology LLC
201 – 500 Employees
ConsultingHealthcareLogistics

Lead full-stack engineering work across insurance and payments platforms using .NET, React, AWS, and Claude AI. Drive architecture, batch processing, and distributed-systems initiatives.

Open