AWISEE
AWISEE
11 – 50 Zaposleni
E-trgovinaSaaSTrženje
AWISEE is a European digital marketing and SEO agency focused on international link building, digital PR, and influencer and KOL marketing. The fully remote team delivers manual outreach and white-label link building for businesses and agencies, drawing on a publisher network spanning Europe, Latin America, APAC, North America, and other regions. Its tailored SEO work serves clients in sectors including SaaS, eCommerce, iGaming, crypto, and fintech.

Senior Data Infrastructure Engineer, Web Scraping

Build anti-bot scraping clusters and high-throughput ingestion pipelines for a social media data lab. Develop scalable storage and data systems that support AI modeling.

Opis

  • Develop and maintain the ingestion engine for the social media data lab.
  • Build and operate stealth scraping clusters with residential proxies, TLS fingerprinting, browser farms, and session rotation.
  • Create resilient, scalable scraping pipelines for Instagram, TikTok, YouTube, X, and other web sources.
  • Design distributed queues and workflow engines to handle millions of asynchronous scraping tasks each day.
  • Architect structured and unstructured storage for downstream AI modeling.
  • Set up automated alerts for platform interface and API changes, blocking patterns, and proxy failures.
  • Deliver millions of profile, post, and video records daily while maintaining near-continuous availability.

Zahteve

  • At least four years of experience in high-volume web scraping, data engineering, or reverse engineering.
  • Strong experience bypassing advanced anti-bot services such as Cloudflare, Akamai, and PerimeterX using TLS impersonation, browser automation, and proxy management.
  • Proficiency in Python or Go.
  • In-depth knowledge of Playwright, Puppeteer, Scrapy, or Selenium.
  • Experience with distributed systems and task queues such as Temporal, Ray, Kafka, and Redis.
  • Strong SQL skills.
  • Experience with modern analytical data lakes or data warehouses.
  • Preferred: Experience extracting short-form video content and user metadata from TikTok, Instagram, and YouTube.
  • Preferred: Experience sending scraping outputs directly to vector databases and real-time AI processing queues.

Ugodnosti

  • Remote work arrangement.

Sorodna delovna mesta

Terumo Medical Corporation

Region Manager, Terumo Interventional Systems Sales

Terumo Medical Corporation

Lead medical device sales across a North Central New Jersey region, managing field teams and hospital relationships. Drive regional revenue, sales performance, and compliant promotion of Terumo Interventional Systems products.

Odpri