Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer — Freelance, India Remote

Mindrift is seeking a senior Python engineer to extract, validate, and scale structured web data workflows for the Tendem AI project. The role involves Python, cloud infrastructure, Docker, and LLM-based automation frameworks.

Descriere

  • Manage complete data extraction workflows across complex websites
  • Deliver structured datasets with comprehensive coverage, high accuracy, and dependable turnaround
  • Use specialized tools and tailored workflows to speed up collection, validation, and task execution
  • Retrieve information from dynamic and interactive sources, including JavaScript-rendered pages
  • Adjust scraping methods as website behavior and page structures change
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic review
  • Scale large-volume scraping through efficient batching and parallel processing
  • Track failures and support reliable, stable scraping operations
  • Apply expertise in Python, web scraping, data extraction, and data processing to the Tendem project

Cerințe

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical field is a plus
  • Strong practical foundation in scripting, automation, and data extraction workflows
  • Advanced Python scraping experience with BeautifulSoup, Selenium or comparable tools, dynamic content, and proxy-based APIs
  • Ability to extract information from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Strong experience with data cleaning, normalization, and validation
  • Practical experience managing anti-bot protections and dynamic website structures at scale
  • Experience with AWS or comparable cloud infrastructure and Docker containerization
  • Hands-on use of LangChain, OpenRouter, or similar LLM frameworks for automation
  • Meticulous approach to data accuracy and quality
  • Able to work independently, troubleshoot issues, and manage tasks proactively
  • Upper-intermediate English proficiency (B2) or higher
  • A GitHub link is a plus

Beneficii

  • Freelance engagement
  • Part-time remote work from India
  • Approximately 10–20 hours per week during active project phases
  • Opportunities to work on technology projects through the Mindrift platform
  • Compensation of up to $30 per hour equivalent, depending on experience level and contribution pace

Locuri de muncă similare

Terumo Medical Corporation

Territory Manager, Interventional Systems — Philadelphia

Terumo Medical Corporation

Lead sales of Terumo Interventional Systems devices to hospitals and outpatient facilities in the Philadelphia area. Build accounts, support procedures, educate clinicians, and meet territory sales goals.

Deschide