LogoFresh Jobs Ahead
Mindrift
Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
Mindrift is an artificial intelligence talent marketplace and SaaS platform that connects professional contributors and domain experts with AI training and evaluation projects from technology companies. As part of Toloka, it works with writers, editors, QA specialists, scientists, and other subject-matter experts who help generate training data, assess model safety and reasoning, evaluate media quality, and create real-world scenarios for improving AI performance and reliability. Mindrift recruits and vets contributors through assessments and identity verification, then offers flexible paid project opportunities across AI training and evaluation work.
LinkedIn
Company Jobs

Senior Python Data Scraping Engineer — Remote India

Senior Python engineer responsible for building dependable scraping workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

INIndia
$30 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Description

  • Manage complete data extraction workflows across complex websites, maintaining broad coverage, accuracy, and dependable delivery of structured datasets.
  • Use available tools and tailored workflows to improve data collection, validation, and task execution while satisfying defined requirements.
  • Extract data reliably from dynamic and interactive sources by adapting to JavaScript-rendered content and evolving website behavior.
  • Maintain data quality through validation checks, cross-source comparisons, formatting controls, and systematic verification before delivery.
  • Scale large-volume scraping through efficient batching and parallel processing techniques.
  • Track extraction failures and preserve workflow stability when minor website structure changes occur.
  • Apply web scraping, data extraction, and data processing expertise to real-world use cases within the Tendem project.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong Python scraping experience with BeautifulSoup, Selenium, or comparable tools, including JavaScript, AJAX, infinite scroll, and proxy-based API access.
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Practical experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets formats.
  • Experience managing anti-bot measures and changing site structures across large-scale scraping workflows.
  • Hands-on experience with AWS or comparable cloud infrastructure and Docker-based containerization in production workflows.
  • Experience applying LLM frameworks such as LangChain, OpenRouter, or similar tools to automation tasks.
  • Strong attention to detail with a consistent focus on data accuracy.
  • Ability to work independently, investigate issues, and troubleshoot effectively.
  • Upper-intermediate English proficiency at B2 level or above.

Benefits

  • Freelance engagement.
  • Part-time remote work from India.
  • Approximately 10–20 hours per week during active project phases.

Related Jobs

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
BRBrazil
$25 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Open
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift
501 – 1,000 Employees
Artificial IntelligenceMarketplaceSaaS
RORomania
$40 / hour
RemotePart-timeSeniorEnglish RequiredBackend EngineerSoftware Engineer
AWSCloudDockerJavaScriptPythonSelenium

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Open