Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer (Freelance, Remote in Egypt)

Build dependable Python scraping systems for Mindrift’s AI projects. Extract, validate, and scale structured data from complex, dynamic websites.

Descriere

  • Manage complete data extraction workflows across complex websites
  • Deliver comprehensive, accurate, and dependable structured datasets
  • Use tools and tailored workflows to speed up data collection, validation, and task completion
  • Extract data reliably from dynamic, interactive, and JavaScript-rendered sources
  • Adjust scraping methods as website behavior and structures evolve
  • Protect data quality through validation, cross-source checks, formatting standards, and systematic review
  • Scale large-dataset scraping with efficient batching or parallel processing
  • Track extraction failures and preserve stability through minor website changes
  • Apply web scraping, data extraction, and data processing expertise to the Tendem project

Cerințe

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical discipline is preferred
  • Advanced Python scraping experience with BeautifulSoup, Selenium or comparable tools, JavaScript/AJAX content, infinite scrolling, APIs, and proxies
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML
  • Strong data cleaning, normalization, and validation skills, with experience producing CSV, JSON, or Google Sheets datasets
  • Practical experience managing anti-bot protections and changing website structures at scale
  • Experience with AWS or comparable cloud infrastructure and Docker-based containerization
  • Hands-on use of LLM frameworks such as LangChain, OpenRouter, or similar tools for automation
  • Exceptional attention to detail and a consistent focus on data accuracy
  • Ability to work independently, troubleshoot issues, and manage tasks with minimal supervision
  • Upper-intermediate English proficiency (B2) or higher
  • GitHub profile or portfolio link is an advantage

Beneficii

  • Freelance project engagement
  • Part-time workload of approximately 10–20 hours per week during active project phases
  • Work remotely
  • Flexible workload aligned with project needs

Locuri de muncă similare

Salesforce

Senior Brand Designer, Brand Creative — Salesforce Chicago Onsite

Salesforce

Lead brand design for Salesforce’s AI CRM across campaigns, identity, digital, social, events, and experiential work. Build design systems and present creative strategy to cross-functional partners and leadership.

Deschide