LogoFresh Jobs Ahead
Mindrift
Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.
LinkedIn
Company Jobs

Senior Python Web Scraping Engineer – Freelance Remote

Build dependable Python-based web scraping and data processing workflows for Mindrift’s AI projects. Extract, validate, and scale structured datasets from complex, dynamic websites.

ARArgentinaBRBrazilCLChileCOColombiaMXMexicoPEPeru
$25 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Description

  • Manage end-to-end extraction workflows across complex websites, delivering complete, accurate, structured datasets
  • Use available tools and custom workflows to accelerate data collection, validation, and task execution against defined requirements
  • Adapt extraction methods for JavaScript-rendered content, interactive sources, and changing website behavior
  • Apply validation, cross-source checks, formatting controls, and systematic verification to maintain data quality
  • Scale large-dataset scraping through efficient batching or parallel processing
  • Monitor extraction failures and preserve stability through minor changes in site structure
  • Use web scraping, data extraction, and data processing expertise with tools including Apify, OpenRouter, and related technologies

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • A Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus
  • Strong technical foundation with practical experience in scripting, automation, and data extraction workflows
  • Extensive Python scraping experience with BeautifulSoup, Selenium, or similar tools, including JavaScript, AJAX, infinite scroll, and proxy-based APIs
  • Ability to extract data from complex hierarchies, archived pages, and inconsistent HTML structures
  • Experience cleaning, normalizing, and validating structured datasets in CSV, JSON, or Google Sheets
  • Experience handling anti-bot mechanisms and changing site structures at scale
  • Practical experience with AWS or equivalent cloud infrastructure and Docker containerization
  • Hands-on experience applying LangChain, OpenRouter, or similar LLM frameworks to automation tasks
  • High attention to detail and a strong commitment to data accuracy
  • Self-directed approach with the ability to troubleshoot independently
  • Upper-intermediate English proficiency (B2) or above
  • A GitHub link is a plus

Benefits

  • Freelance engagement
  • Part-time remote work
  • Approximately 10–20 hours per week during active project phases

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
BRBrazil
$25 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
RORomania
$40 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Open