Mindrift
Mindrift
Mindrift este o piață de talente în domeniul inteligenței artificiale și o platformă software ca serviciu care conectează colaboratori profesioniști și experți în diverse domenii cu proiecte de instruire și evaluare a inteligenței artificiale derulate de companii de tehnologie. Ca parte a Toloka, colaborează cu scriitori, editori, specialiști în asigurarea calității, oameni de știință și alți experți în domeniu, care contribuie la generarea datelor de instruire, evaluarea siguranței și capacității de raționament ale modelelor, evaluarea calității conținutului media și crearea unor scenarii din lumea reală pentru îmbunătățirea performanței și fiabilității inteligenței artificiale. Mindrift recrutează și verifică colaboratorii prin evaluări și verificarea identității, apoi oferă oportunități flexibile și plătite de participare la proiecte de instruire și evaluare a inteligenței artificiale.

Senior Python Data Scraping Engineer — Freelance, Poland Remote

Mindrift is seeking a senior Python engineer to build dependable web-scraping workflows for AI projects. The role focuses on extracting, validating, and processing structured data from complex, dynamic websites.

Descriere

  • Manage complete extraction workflows across complex websites
  • Deliver comprehensive, accurate, and dependable structured datasets
  • Apply tools and tailored workflows to speed up collection, validation, and task execution
  • Extract data reliably from interactive and dynamic web sources
  • Adjust scraping methods for JavaScript-rendered content and evolving site behavior
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic review
  • Handle large-scale scraping with efficient batching and parallel processing
  • Track extraction failures and preserve stability through minor website structure changes
  • Apply Apify, OpenRouter, and related technologies to web extraction and data processing

Cerințe

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development
  • A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical discipline is a plus
  • Strong practical foundation in scripting, automation, and data extraction workflows
  • Advanced Python scraping experience with BeautifulSoup, Selenium or comparable tools, JavaScript and AJAX content, infinite scrolling, and proxy-based APIs
  • Ability to extract information from complex hierarchies, archived pages, and inconsistent HTML
  • Experience cleaning, normalizing, and validating data for delivery in CSV, JSON, and Google Sheets
  • Experience working with anti-bot systems and changing website structures at scale
  • Practical experience using AWS or equivalent cloud infrastructure and Docker in production workflows
  • Hands-on use of LangChain, OpenRouter, or similar LLM frameworks for automation
  • High attention to detail and a strong focus on data accuracy
  • Independent working style with the ability to investigate and resolve issues without close supervision
  • Upper-intermediate English proficiency (B2) or higher
  • A GitHub profile is a plus

Beneficii

  • Freelance project engagement
  • Part-time workload of approximately 10–20 hours per week during active project phases
  • Remote work from Poland
  • Compensation of up to $40 per hour equivalent, depending on experience level and contribution pace

Locuri de muncă similare

Talkdesk

Senior Solution Consultant, CXA and CCaaS - United States

Talkdesk

Lead strategic implementations of Talkdesk CXA and CCaaS solutions, helping customers integrate the technology and achieve lasting adoption. Partner with customers, executives, and internal teams to guide implementation strategy and long-term success.

Deschide
Linedata

Associate Partner, Investment Management Consulting, New York Hybrid

Linedata
1.001 – 5.000 Angajați
B2BFintechSaaS

Lead executive advisory, client delivery, and business development for Linedata’s investment management consulting practice. Apply buy-side expertise across technology, operations, data, and transformation.

Deschide
HudHud Maps

Senior Frontend Engineer at HudHud Maps (Remote, Saudi Arabia)

HudHud Maps

Build scalable React.js interfaces for HudHud Maps, a Data and AI company. Partner with backend, product, and design teams on Node.js APIs, usability, performance, accessibility, and CI/CD delivery.

Deschide
memodio

Flutter and Node.js Full-Stack Engineer - Worldwide Remote

memodio

Join memodio in advancing a prescribed digital health app with Flutter and Node.js. Build accessible, regulated medical software designed for older users worldwide.

Deschide
Naveera Technology LLC

Senior .NET Core Engineer – React and Claude AI

Naveera Technology LLC

Lead full-stack engineering work across insurance and payments platforms using .NET, React, AWS, and Claude AI. Drive architecture, batch processing, and distributed-systems initiatives.

Deschide