LogoFresh Jobs Ahead
Mindrift
Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.
LinkedIn
Company Jobs

Senior Python Data Scraping Engineer Freelance Remote

Build and operate scalable Python scraping workflows for Mindrift’s AI projects. Extract, validate, and process structured data from complex, dynamic websites.

BABosnia & HerzegovinaCYCyprusLTLithuaniaLVLatviaMTMaltaRSSerbia
$45 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Description

  • Lead specialized scraping workflows for the Tendem project and real-world applications
  • Manage end-to-end extraction across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Apply available tools and custom workflows to speed collection, validation, and task execution
  • Scrape dynamic and interactive sources while adapting to JavaScript-rendered content and changing site behavior
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic review
  • Scale large-volume scraping with efficient batching or parallel processing
  • Monitor failures and preserve stability through minor changes in site structure
  • Use Apify, OpenRouter, and related technologies alongside technical expertise and tailored solutions

Requirements

  • At least five years of relevant experience in data engineering, web scraping, automation, or software development is required
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical field is advantageous
  • Strong practical foundation in scripting, automation, and data extraction workflows
  • Extensive Python scraping experience with BeautifulSoup, Selenium or comparable tools, JavaScript and AJAX content, infinite scroll, and proxied APIs
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for structured CSV, JSON, or Google Sheets delivery
  • Proven experience managing anti-bot measures and changing website structures at scale
  • Hands-on experience with AWS or equivalent cloud infrastructure and Docker-based containerization
  • Experience applying LangChain, OpenRouter, or similar LLM frameworks to automation tasks
  • High attention to detail and a strong focus on data accuracy
  • Able to work independently and troubleshoot effectively
  • A GitHub profile is advantageous
  • Upper-intermediate English proficiency at B2 level or higher is required

Benefits

  • Freelance engagement
  • Part-time remote schedule
  • Approximately 10–20 hours per week during active project periods
  • Opportunity to work on innovative technology projects through the Mindrift platform

Related Jobs