Mindrift
Mindrift
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.

Senior Python Data Scraping Engineer in Italy (Remote)

Join Mindrift’s Tendem AI project to build dependable web-scraping and structured-data pipelines. The role focuses on dynamic websites, data validation, scalable extraction, and automation.

Description

  • Lead complete extraction processes across complex websites, delivering comprehensive, accurate, and dependable structured datasets
  • Use available platforms and tailored workflows to speed up collection, validation, and task completion against defined specifications
  • Adapt extraction methods for JavaScript-rendered pages, interactive sources, and evolving website behavior
  • Maintain data quality through validation, cross-source checks, formatting controls, and structured pre-delivery review
  • Expand scraping capacity for large datasets through efficient batching and parallel processing
  • Track extraction failures and preserve operational reliability as site structures change
  • Apply web-scraping, extraction, and processing expertise to the Tendem project
  • Combine technical judgment with Apify, OpenRouter, and other tools to develop effective custom solutions

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development is required
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical discipline is advantageous
  • Advanced Python scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic content, and proxied APIs
  • Ability to retrieve data from complex sources such as hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets
  • Practical experience managing anti-bot protections and changing website structures at scale
  • Familiarity with AWS or comparable cloud infrastructure and Docker-based containerization
  • Hands-on use of LangChain, OpenRouter, or similar LLM frameworks for automation
  • Exceptional attention to detail and a strong focus on data accuracy
  • Ability to work independently, investigate issues, and resolve problems without close supervision
  • Upper-intermediate English proficiency (B2) or higher is required
  • A GitHub profile link is an advantage

Benefits

  • Freelance engagement
  • Part-time remote arrangement
  • Expected workload of 10–20 hours weekly during active project periods

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Open
Akamai Technologies

Senior Software Engineer, Security Services (Israel Remote)

Akamai Technologies

Build browser security, data loss prevention, and AI capabilities at Akamai. Lead cloud-native microservices that protect millions of enterprise workspaces.

Open
Mindrift

Senior Python Data Scraping Engineer (Freelance, Remote in Sweden)

Mindrift

Mindrift is seeking a senior Python engineer to build dependable scraping workflows for AI projects. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Open