Pinterest
Pinterest
1.001 – 5.000 Angajați
Sponsor pentru viza H1BB2CMedia
Pinterest este o platformă de descoperire vizuală unde oamenii găsesc inspirație, salvează idei și le organizează în jurul intereselor, proiectelor și achizițiilor lor. Experiența combină recomandări personalizate și căutare vizuală pentru subiecte precum designul interior, moda, rețetele și evenimentele, ajutând totodată creatorii și comercianții să ajungă la public prin instrumente de comerț și publicitate.

Senior Staff Software Engineer, AI Platform - Palo Alto Hybrid

Lead the strategy, architecture, and adoption of Pinterest’s AI and machine learning evaluation platform. Help establish reliable evaluation practices for GenAI experiences across the company.

Descriere

  • Identify modernization opportunities and expand the roadmap for a company-wide evaluation system with technical leadership
  • Set cross-functional technical direction, align partner teams, and increase adoption of shared evaluation capabilities
  • Make long-term architectural decisions that strengthen the user experience and reliability of Pinterest’s AI and ML evaluation platform
  • Develop evaluation methods and standards that combine automated metrics, expert review, human feedback, safety, and business outcomes
  • Lead complex initiatives across teams, manage technical tradeoffs and risks, and deliver measurable impact
  • Evolve Pinterest’s AI and ML evaluation platform into a unified, dependable system used across the company
  • Work with engineering, research, product, and safety teams to improve quality, launch decisions, and confidence in AI-powered experiences

Cerințe

  • At least 3 years of hands-on experience designing and operating evaluation systems for GenAI and complex machine learning systems
  • Experience creating benchmarks and golden datasets, applying automated metrics and human evaluation, using model-based grading, and analyzing failures
  • Strong proficiency in Python
  • Working knowledge of distributed systems principles
  • Ability to iterate effectively with AI tools during coding and system design
  • Extensive knowledge of GenAI and recommendation-system evaluation libraries and frameworks, including AutoEvals, OpenEvals, and Ragas
  • At least 5 years of experience developing scalable platforms for distributed experimentation, data and model versioning, orchestration, observability, release management, and production monitoring
  • Sound judgment regarding GenAI risks such as robustness, bias, privacy, security, and the limits of automated evaluation signals
  • Bachelor’s degree in computer science, engineering, or a related discipline, or equivalent experience

Beneficii

  • Eligibility for equity
  • Flexible PinFlex work model
  • In-person collaboration once or twice per quarter
  • Equal opportunity workplace
  • Medical or religious accommodation support during the application process

Locuri de muncă similare

Airbus

Systems Architect, Geospatial Software

Airbus

Shape secure, traceable architectures for Airbus Defence and Space geospatial software, translating requirements into solution designs. Apply MBSE on Government and MOD intelligence, surveillance and reconnaissance projects.

Deschide
Gentex Corporation

Software Systems Engineer

Gentex Corporation

Define and validate software and systems requirements for Gentex automotive technologies. This on-site role supports engineering, manufacturing, validation, and compliance teams.

Deschide
B

Junior Salesforce Service Engineer

BearingPoint

Deliver Salesforce CRM solutions for international clients at BearingPoint, working across configuration, troubleshooting, development, and customer support. Build technical expertise through structured learning and project experience, with a path toward technical and team leadership.

Deschide