Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Web Scraping Engineer — Saudi Arabia Remote

Senior Python engineer developing dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Description

  • Lead complete data-extraction workflows across complex websites
  • Maintain comprehensive coverage, accurate results, and dependable delivery of structured datasets
  • Use available tools and tailored workflows to speed up data collection, validation, and task execution
  • Retrieve data consistently from dynamic and interactive web sources
  • Adjust extraction methods for JavaScript-rendered content and evolving website behavior
  • Protect data quality with validation checks, cross-source comparisons, formatting rules, and systematic verification
  • Scale large-volume scraping through efficient batching or parallel processing
  • Track failures and preserve workflow stability through minor changes in site structure
  • Use Apify, OpenRouter, and related technologies in web-extraction and data-processing workflows

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical discipline is preferred
  • Advanced Python web-scraping experience, including BeautifulSoup, Selenium or comparable tools, dynamic content, and proxy-based APIs
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets
  • Practical experience addressing anti-bot systems and changing site structures at scale
  • Experience with AWS or comparable cloud infrastructure
  • Experience packaging applications with Docker
  • Hands-on use of LangChain, OpenRouter, or similar LLM frameworks for automation tasks
  • Strong attention to detail and a consistent focus on data accuracy
  • Ability to work independently, self-direct tasks, and troubleshoot issues
  • Upper-intermediate English proficiency (B2) or higher
  • A GitHub profile is an advantage

Benefits

  • Part-time freelance engagement
  • Approximately 10–20 hours per week during active project phases
  • Up to $37 per hour equivalent, based on contribution level and pace
  • Flexible project-based workload, with compensation varying by scope, complexity, and required expertise
  • Chance to support technology and AI development projects

Related Jobs

Nortal

Nortal IAM Developer Latin America Remote

Nortal
1,001 – 5,000 Employees
ConsultingHealthcare

Build and operate identity and access management solutions for Nortal’s digital transformation and AI-enabled enterprise initiatives. Automate provisioning, authentication, and governance workflows for clients worldwide.

Open
NEOCOSMO GmbH

Frontend Developer (Vue.js/React/TypeScript) – NEOCOSMO GmbH, Hybrid in Saarbrücken

NEOCOSMO GmbH
11 – 50 Employees
ConsultingMarketingSaaS

Build Vue.js, React, and TypeScript components for NEOCOSMO’s Drupal-based PIIPE digital workplace platform. Help deliver secure, scalable intranet capabilities for organizations and public institutions.

Open
Vontier

Senior .NET Software Developer — Hybrid, United States

Vontier
5,001 – 10,000 Employees
AutomotiveEnergyHardware

Lead the development and maintenance of web applications for Matco Tools, a professional automotive tools and technology distributor. Own architecture, technical reviews, delivery, and developer mentoring.

Open
QAVION GROUP

Senior Full-Stack Engineer (Remote)

QAVION GROUP

Senior Full-Stack Engineer role focused on microservices, web applications, responsive frontends, databases, and automated testing within QAVION’s IT consulting group. The position uses modern JavaScript and Java frameworks across backend and frontend development.

Open