Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer (Freelance, Remote in Saudi Arabia)

Senior Python engineer developing scalable scraping workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and structuring complex web data with Python and automation tools.

Descriere

  • Lead specialized data-scraping workflows for Mindrift’s Tendem project and its real-world applications
  • Manage end-to-end extraction pipelines across complex websites
  • Produce complete, accurate, dependable, and well-structured datasets
  • Apply Apify, OpenRouter, and custom workflows to streamline collection, validation, and task execution
  • Capture data from dynamic, interactive sources while adapting to JavaScript-rendered content and changing site behavior
  • Protect data quality with validation checks, cross-source comparisons, formatting controls, and systematic verification
  • Scale large-volume scraping through efficient batching and parallel processing
  • Investigate failures and preserve pipeline stability through minor website structure changes
  • Independently solve complex scripting, automation, extraction, data-structuring, and validation challenges

Cerințe

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • Upper-intermediate English proficiency (B2) or higher
  • Advanced Python scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic JavaScript/AJAX content, infinite scrolling, and proxy-based APIs
  • Ability to extract information from complex hierarchies, archived pages, and inconsistent HTML
  • Strong knowledge of data cleaning, normalization, and validation
  • Practical experience managing anti-bot protections and changing site structures at scale
  • Experience with AWS or comparable cloud infrastructure
  • Experience packaging applications with Docker
  • Hands-on use of LangChain, OpenRouter, or similar LLM frameworks for automation
  • High attention to detail with a strong focus on data accuracy
  • Self-motivated approach and confidence troubleshooting independently
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical discipline is advantageous
  • GitHub profile link is advantageous

Beneficii

  • Flexible part-time freelance engagement
  • Expected workload of 10–20 hours weekly during active project periods
  • Compensation of up to $37 per hour equivalent, based on experience level and contribution pace
  • Chance to contribute to innovative AI and technology development projects
  • Fully remote work

Locuri de muncă similare

Mindrift

Senior Python Web Scraping Engineer - Brazil Remote

Mindrift

Senior Python engineer responsible for dependable web scraping, data validation, and structured dataset delivery for Mindrift’s AI technology projects. The role covers dynamic websites, anti-bot systems, cloud infrastructure, and LLM-based automation tools.

Deschide
Mindrift

Senior Python Data Scraping Engineer — Freelance, Poland Remote

Mindrift

Mindrift is seeking a senior Python engineer to build dependable web-scraping workflows for AI projects. The role focuses on extracting, validating, and processing structured data from complex, dynamic websites.

Deschide
Mindrift

Senior Python Data Scraping Engineer — Remote in Romania

Mindrift

Senior Python engineer responsible for building dependable web-scraping and data-processing workflows for Mindrift’s Tendem AI project. The role focuses on extracting, validating, and scaling structured datasets from complex websites.

Deschide