Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer - Part-Time Remote

Lead reliable web scraping and structured data delivery for Mindrift’s AI technology projects. Automate extraction, validation, and scalable processing across complex, dynamic websites.

Description

  • Lead end-to-end data extraction across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Use tools and custom workflows to speed up collection, validation, and task execution
  • Extract data from dynamic web sources while adapting to JavaScript content and changing site behavior
  • Maintain data quality through validation, consistency checks, formatting controls, and systematic verification
  • Scale large-volume scraping with efficient batching and parallel processing
  • Monitor failures and preserve stability through minor website structure changes
  • Apply Apify, OpenRouter, and related technologies to web extraction and data processing

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • A Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is advantageous
  • Strong technical skills with practical experience in scripting, automation, and data extraction workflows
  • Advanced Python scraping experience with BeautifulSoup, Selenium or similar tools, dynamic JavaScript/AJAX content, infinite scroll, and proxied APIs
  • Ability to extract information from complex hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets
  • Experience managing anti-bot mechanisms and changing website structures at scale
  • Experience with AWS or equivalent cloud infrastructure and Docker containerization
  • Hands-on experience applying LangChain, OpenRouter, or similar LLM frameworks to automation
  • Meticulous approach to data accuracy and quality
  • Ability to work independently and troubleshoot effectively
  • Upper-intermediate English proficiency (B2) or higher
  • GitHub profile link is advantageous

Benefits

  • Freelance engagement
  • Part-time remote work
  • Approximately 10–20 hours per week during active phases
  • Up to $25 per hour equivalent, depending on experience level and contribution pace
  • Opportunity to work on innovative technology projects through the Mindrift platform

Related Jobs

Concept Reply GmbH

AIoT Full-Stack Developer (Hybrid, Germany)

Concept Reply GmbH

Join Concept Reply GmbH to build AIoT solutions across frontend, backend, and machine learning. The role supports applications for automotive, manufacturing, and intelligent infrastructure.

Open
Nortal

Nortal IAM Developer Latin America Remote

Nortal
1,001 – 5,000 Employees
ConsultingHealthcare

Build and operate identity and access management solutions for Nortal’s digital transformation and AI-enabled enterprise initiatives. Automate provisioning, authentication, and governance workflows for clients worldwide.

Open
NEOCOSMO GmbH

Frontend Developer (Vue.js/React/TypeScript) – NEOCOSMO GmbH, Hybrid in Saarbrücken

NEOCOSMO GmbH
11 – 50 Employees
ConsultingMarketingSaaS

Build Vue.js, React, and TypeScript components for NEOCOSMO’s Drupal-based PIIPE digital workplace platform. Help deliver secure, scalable intranet capabilities for organizations and public institutions.

Open