Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer Freelance Remote

Build and operate scalable Python scraping workflows for Mindrift’s AI projects. Extract, validate, and process structured data from complex, dynamic websites.

Descriere

  • Lead specialized scraping workflows for the Tendem project and real-world applications
  • Manage end-to-end extraction across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Apply available tools and custom workflows to speed collection, validation, and task execution
  • Scrape dynamic and interactive sources while adapting to JavaScript-rendered content and changing site behavior
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic review
  • Scale large-volume scraping with efficient batching or parallel processing
  • Monitor failures and preserve stability through minor changes in site structure
  • Use Apify, OpenRouter, and related technologies alongside technical expertise and tailored solutions

Cerințe

  • At least five years of relevant experience in data engineering, web scraping, automation, or software development is required
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical field is advantageous
  • Strong practical foundation in scripting, automation, and data extraction workflows
  • Extensive Python scraping experience with BeautifulSoup, Selenium or comparable tools, JavaScript and AJAX content, infinite scroll, and proxied APIs
  • Ability to extract information from complex structures such as hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for structured CSV, JSON, or Google Sheets delivery
  • Proven experience managing anti-bot measures and changing website structures at scale
  • Hands-on experience with AWS or equivalent cloud infrastructure and Docker-based containerization
  • Experience applying LangChain, OpenRouter, or similar LLM frameworks to automation tasks
  • High attention to detail and a strong focus on data accuracy
  • Able to work independently and troubleshoot effectively
  • A GitHub profile is advantageous
  • Upper-intermediate English proficiency at B2 level or higher is required

Beneficii

  • Freelance engagement
  • Part-time remote schedule
  • Approximately 10–20 hours per week during active project periods
  • Opportunity to work on innovative technology projects through the Mindrift platform

Locuri de muncă similare

Airis Labs

Full Stack Engineer (React/Python) - Hybrid in Israel

Airis Labs

Build React and Python applications for Airis Labs’ AI-powered field intelligence platform. Help scale distributed systems and deliver tools used by government analysts.

Deschide
SimplePractice

Senior Ruby on Rails Engineer - Mexico Remote

SimplePractice

Join SimplePractice as a Senior Ruby on Rails Engineer developing its practice-management platform for health and wellness clinicians. Build scalable, backend-focused features with Rails and JavaScript frameworks.

Deschide
MAPFRE

Senior Python AI Backend Engineer at MAPFRE — Hybrid Madrid

MAPFRE

Backend engineer building AI agents and Python services that automate the software development lifecycle at MAPFRE. The role covers cloud infrastructure on AWS and Azure for an international platform.

Deschide
Mirego

Back-End and DevOps Software Developer — Hybrid in Quebec City

Mirego

Build back-end services and cloud-native infrastructure at Mirego. Lead DevOps delivery across CI/CD, infrastructure as code, observability, security, and reliable client solutions.

Deschide
EY

EY Senior Backend Engineer - Onsite

EY

Build secure Java services, APIs, and integrations for EY’s financial services clients. Support enterprise solutions across design, delivery, testing, and production operations.

Deschide