AWISEE
AWISEE
AWISEE este o agenție europeană de marketing digital și SEO, specializată în crearea de linkuri la nivel internațional, relații publice digitale și marketing prin influenceri și lideri-cheie de opinie (KOL). Echipa, care lucrează integral de la distanță, oferă servicii de contactare manuală a editorilor și creare de linkuri white-label pentru companii și agenții, bazându-se pe o rețea de publicații din Europa, America Latină, regiunea Asia-Pacific, America de Nord și alte zone. Serviciile SEO personalizate se adresează clienților din sectoare precum SaaS, comerț electronic, iGaming, criptomonede și tehnologie financiară.

Senior Data Infrastructure Engineer, Web Scraping

Build anti-bot scraping clusters and high-throughput ingestion pipelines for a social media data lab. Develop scalable storage and data systems that support AI modeling.

Descriere

  • Develop and maintain the ingestion engine for the social media data lab.
  • Build and operate stealth scraping clusters with residential proxies, TLS fingerprinting, browser farms, and session rotation.
  • Create resilient, scalable scraping pipelines for Instagram, TikTok, YouTube, X, and other web sources.
  • Design distributed queues and workflow engines to handle millions of asynchronous scraping tasks each day.
  • Architect structured and unstructured storage for downstream AI modeling.
  • Set up automated alerts for platform interface and API changes, blocking patterns, and proxy failures.
  • Deliver millions of profile, post, and video records daily while maintaining near-continuous availability.

Cerințe

  • At least four years of experience in high-volume web scraping, data engineering, or reverse engineering.
  • Strong experience bypassing advanced anti-bot services such as Cloudflare, Akamai, and PerimeterX using TLS impersonation, browser automation, and proxy management.
  • Proficiency in Python or Go.
  • In-depth knowledge of Playwright, Puppeteer, Scrapy, or Selenium.
  • Experience with distributed systems and task queues such as Temporal, Ray, Kafka, and Redis.
  • Strong SQL skills.
  • Experience with modern analytical data lakes or data warehouses.
  • Preferred: Experience extracting short-form video content and user metadata from TikTok, Instagram, and YouTube.
  • Preferred: Experience sending scraping outputs directly to vector databases and real-time AI processing queues.

Beneficii

  • Remote work arrangement.

Locuri de muncă similare

Kreato Global | BPO and Language Solutions

Remote English-Spanish OPI/VRI Interpreter

Kreato Global | BPO and Language Solutions

Interpret remotely between English- and Spanish-speaking people in medical, financial, social service, and customer care settings. Provide language support for Kreato Global across Latin America.

Deschide
RecruitGo

Remote Executive Assistant, Outreach and Marketing — Philippines

RecruitGo

Handle administrative support, CRM, outreach, and marketing for RecruitGo, an Employer of Record serving global clients with talent from emerging markets. Support two UK-facing clients with day-to-day administration and creative campaigns.

Deschide