Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer (Freelance, Remote in Greece)

Build and scale reliable Python scraping workflows for Mindrift’s AI technology projects. Extract, validate, and deliver structured datasets from complex, dynamic websites.

Description

  • Manage end-to-end data extraction workflows across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Apply tools and custom workflows to speed up data collection, validation, and task execution
  • Collect data from dynamic and interactive sources, including JavaScript-rendered pages
  • Adjust scraping methods as website behavior changes
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic verification
  • Scale large-dataset scraping with efficient batching or parallel processing
  • Monitor extraction failures and preserve stability through minor site structure changes

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • Advanced Python web scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic content, and proxy-based APIs
  • Ability to extract information from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for structured delivery in CSV, JSON, and Google Sheets
  • Experience addressing anti-bot systems and changing website structures at scale
  • Experience with AWS or equivalent cloud infrastructure and Docker containerization
  • Practical experience applying LLM frameworks such as LangChain or OpenRouter to automation tasks
  • Meticulous approach to data accuracy
  • Independent, self-directed troubleshooting skills
  • Upper-intermediate English proficiency (B2) or higher
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus
  • GitHub profile is a plus

Benefits

  • Work remotely
  • Part-time schedule of approximately 10–20 hours per week during active project phases
  • Freelance engagement
  • Work on innovative technology projects through the Mindrift platform

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Open
Akamai Technologies

Senior Software Engineer, Security Services (Israel Remote)

Akamai Technologies

Build browser security, data loss prevention, and AI capabilities at Akamai. Lead cloud-native microservices that protect millions of enterprise workspaces.

Open
Mindrift

Senior Python Data Scraping Engineer (Freelance, Remote in Sweden)

Mindrift

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI projects. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Open