Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Web Scraping Engineer — Serbia, Remote, Part-Time

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex, dynamic websites.

Description

  • Manage end-to-end extraction workflows across complex websites, delivering complete, accurate, and reliable structured datasets.
  • Use available tools and tailored workflows to speed up collection, validation, and task completion against defined requirements.
  • Extract data reliably from dynamic and interactive sources, adapting to JavaScript-rendered content and evolving site behavior.
  • Maintain data quality through validation checks, cross-source comparisons, formatting controls, and systematic pre-delivery verification.
  • Scale large-volume scraping with efficient batching or parallel processing, monitor failures, and preserve stability through minor site changes.
  • Apply web-scraping, data-extraction, and data-processing expertise to the Tendem project.
  • Work with Apify, OpenRouter, and other relevant technologies.

Requirements

  • Five or more years of relevant experience in data engineering, web scraping, automation, or software development.
  • A Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical discipline is advantageous.
  • Strong Python web-scraping experience with BeautifulSoup, Selenium, or similar tools, including JavaScript, AJAX, infinite scroll, and proxy-based API access.
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid experience cleaning, normalizing, and validating data for delivery in structured formats including CSV, JSON, and Google Sheets.
  • Practical experience managing anti-bot protections and changing website structures at scale.
  • Experience using AWS or equivalent cloud infrastructure and Docker in production or project workflows.
  • Hands-on experience applying LLM frameworks such as LangChain, OpenRouter, or similar tools to automation tasks.
  • High attention to detail and a strong commitment to data accuracy.
  • Self-directed approach with the ability to troubleshoot issues independently.
  • Upper-intermediate English proficiency at B2 level or above is required.
  • A GitHub profile is an advantage.

Benefits

  • Freelance engagement.
  • Part-time remote work.
  • An estimated 10–20 hours per week during active project phases.

Related Jobs

Talkdesk

Senior Solution Consultant, CXA and CCaaS - United States

Talkdesk

Lead strategic implementations of Talkdesk CXA and CCaaS solutions, helping customers integrate the technology and achieve lasting adoption. Partner with customers, executives, and internal teams to guide implementation strategy and long-term success.

Open
Naveera Technology LLC

Senior .NET Core Engineer – React and Claude AI

Naveera Technology LLC
201 – 500 Employees
ConsultingHealthcareLogistics

Lead full-stack engineering work across insurance and payments platforms using .NET, React, AWS, and Claude AI. Drive architecture, batch processing, and distributed-systems initiatives.

Open