Mindrift
Mindrift
Mindrift — технологиялық компаниялардың жасанды интеллектіні оқыту және бағалау жобаларына кәсіби үлес қосушылар мен салалық сарапшыларды біріктіретін жасанды интеллект мамандарының нарығы және SaaS платформасы. Toloka құрамында жұмыс істей отырып, ол жазушылармен, редакторлармен, сапаны бақылау мамандарымен, ғалымдармен және басқа да пәндік сарапшылармен ынтымақтасады. Бұл мамандар оқыту деректерін жасайды, модельдердің қауіпсіздігі мен пайымдау қабілетін бағалайды, медиа сапасын тексереді және жасанды интеллектінің өнімділігі мен сенімділігін арттыру үшін шынайы өмірдегі сценарийлерді әзірлейді. Mindrift үлес қосушыларды бағалау және жеке басын растау рәсімдері арқылы іріктеп, тексереді, содан кейін жасанды интеллектіні оқыту және бағалау бағыттарында икемді, ақылы жобалар ұсынады.

Senior Python Data Scraping Engineer — Remote in Japan

Build reliable Python web-scraping workflows for Mindrift’s Tendem AI project. Extract, validate, and scale structured datasets from complex, dynamic websites.

Сипаттама

  • Lead end-to-end data extraction across complex websites
  • Deliver complete, accurate, and reliable structured datasets
  • Use available tools and custom workflows to accelerate collection, validation, and task execution
  • Extract data from dynamic and interactive sources, including JavaScript-rendered content
  • Adjust scraping methods as website behavior changes
  • Maintain data quality through validation, cross-source checks, formatting standards, and systematic verification
  • Scale large-volume scraping with efficient batching or parallel processing
  • Monitor failures and preserve stability through minor site structure changes
  • Apply Apify, OpenRouter, and other technologies to web extraction and processing

Талаптар

  • At least 5 years of relevant experience in data engineering, web scraping, automation, or software development
  • A Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus
  • Strong Python scraping experience with BeautifulSoup, Selenium or similar tools, dynamic content such as JavaScript, AJAX, and infinite scroll, and APIs accessed through proxies
  • Ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML
  • Strong background in data cleaning, normalization, and validation, with experience delivering CSV, JSON, or Google Sheets datasets
  • Experience managing anti-bot mechanisms and dynamic site structures at scale
  • Experience with AWS or equivalent cloud infrastructure
  • Experience using Docker for containerization
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools for automation
  • Strong attention to detail and commitment to data accuracy
  • Self-directed approach with the ability to troubleshoot independently
  • Upper-intermediate English proficiency (B2) or higher
  • A GitHub link is a plus

Артықшылықтар

  • Freelance opportunity
  • Part-time work estimated at approximately 10–20 hours per week during active phases
  • Remote work
  • Opportunity to contribute to innovative technology and AI development projects

Ұқсас жұмыс орындары

Cisco

Senior Staff Software Engineer, Splunk Security Core AI at Cisco

Cisco

Lead the design and delivery of AI-powered Agentic SOC capabilities for Cisco and Splunk. Build trusted agents, orchestration, evaluation, and security systems for large-scale deployments.

Ашу
Innosphere

Senior Full-Stack Developer at Innosphere — Canada Remote

Innosphere

Join Innosphere as a senior full-stack developer building and modernizing cloud applications across frontend and backend systems. Work with AWS infrastructure, APIs, scalable services, and automated testing for client projects.

Ашу
Typeface

Engagement Manager, Enterprise Generative AI (United States Remote)

Typeface

Lead enterprise marketing transformation programs for Typeface’s generative AI platform. Shape strategy, deployment, integrations, adoption, and campaign performance for major brands.

Ашу
L3Harris Technologies

Senior Specialist Software Engineer - L3Harris, Palm Bay, FL

L3Harris Technologies

Develop and test mission-critical space systems software for L3Harris in an onsite Palm Bay role. Work across hardware integration, verification, and operational readiness on Windows and Linux.

Ашу
Swoop

Senior Full-Stack Engineer (Hybrid, Canada)

Swoop

Senior Full-Stack Engineer developing scalable APIs and web products for NimbleRx’s patient and pharmacy platform. The role covers end-to-end feature ownership, system performance, testing, and technical delivery.

Ашу
CyberCube

Lead Actuary, Cyber Risk Analytics - CyberCube (Hybrid, New York)

CyberCube

Lead actuarial analysis and develop statistical models and tools for CyberCube’s cyber-risk analytics platform serving global insurers. Stress-test and validate models and data, then communicate findings to internal teams and customers.

Ашу
Invillia

Senior Go Backend Developer – Remote in Brazil

Invillia
5 001 – 10 000 Қызметкерлер
КонсалтингЛогистикаМаркетинг

Senior Go developer responsible for building APIs, Kafka pipelines, and distributed services for Invillia platforms, with emphasis on scalability, observability, resilience, and security.

Ашу
Porto a Porto

Senior Automotive Software Developer

Porto a Porto

Lead the modernization of Porto’s Auto Fleet insurance sales platform through the Fleet 4.0 project. Drive architecture, engineering, DevOps, and AI adoption across the initiative.

Ашу
Baseten

Software Engineer, LLM Inference Platform - Baseten Hybrid

Baseten

Build Baseten’s distributed LLM inference platform for AI companies. Work across Kubernetes orchestration, model APIs, routing, autoscaling, and production observability.

Ашу