Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer (Part-Time, Remote in Georgia)

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI technology projects. The role focuses on extracting, validating, and scaling structured datasets from complex, dynamic websites.

Description

  • Manage end-to-end data extraction workflows across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Apply available tools and custom workflows to speed up data collection, validation, and task execution
  • Extract data from dynamic and interactive web sources, including JavaScript-rendered pages
  • Adjust scraping methods as website behavior changes
  • Maintain data quality through validation checks, cross-source consistency controls, formatting requirements, and systematic verification
  • Scale large-dataset scraping with efficient batching or parallel processing
  • Monitor failures and preserve stability through minor website structure changes
  • Combine tools such as Apify and OpenRouter with relevant technical expertise

Requirements

  • At least 5 years of relevant experience in data engineering, web scraping, automation, or software development
  • A bachelor's or master's degree in engineering, applied mathematics, computer science, or a related technical field is preferred
  • Strong Python web-scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic content, and APIs accessed through proxies
  • Demonstrated ability to extract information from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Solid experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets
  • Practical experience managing anti-bot mechanisms and dynamic website structures at scale
  • Experience with AWS or comparable cloud infrastructure and Docker-based containerization
  • Hands-on experience applying LLM frameworks such as LangChain or OpenRouter to automation tasks
  • High attention to detail and a strong commitment to data accuracy
  • Ability to work independently and troubleshoot issues without close supervision
  • Upper-intermediate English proficiency (B2) or higher
  • A GitHub profile link is an advantage

Benefits

  • Part-time remote freelance engagement
  • Approximately 10–20 hours per week during active project phases
  • Work on technology and AI development projects

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Open
Akamai Technologies

Senior Software Engineer, Security Services (Israel Remote)

Akamai Technologies

Build browser security, data loss prevention, and AI capabilities at Akamai. Lead cloud-native microservices that protect millions of enterprise workspaces.

Open
Mindrift

Senior Python Data Scraping Engineer (Freelance, Remote in Sweden)

Mindrift

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI projects. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Open