Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer — Remote India

Senior Python engineer responsible for building dependable scraping workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured data from complex, dynamic websites.

Descriere

  • Manage complete data extraction workflows across complex websites, maintaining broad coverage, accuracy, and dependable delivery of structured datasets.
  • Use available tools and tailored workflows to improve data collection, validation, and task execution while satisfying defined requirements.
  • Extract data reliably from dynamic and interactive sources by adapting to JavaScript-rendered content and evolving website behavior.
  • Maintain data quality through validation checks, cross-source comparisons, formatting controls, and systematic verification before delivery.
  • Scale large-volume scraping through efficient batching and parallel processing techniques.
  • Track extraction failures and preserve workflow stability when minor website structure changes occur.
  • Apply web scraping, data extraction, and data processing expertise to real-world use cases within the Tendem project.

Cerințe

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong Python scraping experience with BeautifulSoup, Selenium, or comparable tools, including JavaScript, AJAX, infinite scroll, and proxy-based API access.
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Practical experience cleaning, normalizing, and validating data for delivery in CSV, JSON, or Google Sheets formats.
  • Experience managing anti-bot measures and changing site structures across large-scale scraping workflows.
  • Hands-on experience with AWS or comparable cloud infrastructure and Docker-based containerization in production workflows.
  • Experience applying LLM frameworks such as LangChain, OpenRouter, or similar tools to automation tasks.
  • Strong attention to detail with a consistent focus on data accuracy.
  • Ability to work independently, investigate issues, and troubleshoot effectively.
  • Upper-intermediate English proficiency at B2 level or above.

Beneficii

  • Freelance engagement.
  • Part-time remote work from India.
  • Approximately 10–20 hours per week during active project phases.

Locuri de muncă similare

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Deschide
Mindrift

Senior Python Data Scraping Engineer — Freelance, Poland Remote

Mindrift

Mindrift is seeking a senior Python engineer to build dependable web-scraping workflows for AI projects. The role focuses on extracting, validating, and processing structured data from complex, dynamic websites.

Deschide
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Deschide