Pinterest एक विज़ुअल डिस्कवरी प्लेटफ़ॉर्म है, जहाँ लोग प्रेरणा पाते हैं, विचारों को सहेजते हैं और उन्हें अपनी रुचियों, परियोजनाओं तथा खरीदारी के अनुसार व्यवस्थित करते हैं। इसका अनुभव घर की सजावट, फ़ैशन, रेसिपी और आयोजनों जैसे विषयों पर व्यक्तिगत सुझावों और विज़ुअल सर्च को जोड़ता है। साथ ही, कॉमर्स टूल और विज्ञापन के माध्यम से क्रिएटर्स तथा रिटेलर्स को अपने दर्शकों तक पहुँचने में मदद करता है।
Senior Staff Software Engineer, AI Platform - Palo Alto Hybrid
Lead the strategy, architecture, and adoption of Pinterest’s AI and machine learning evaluation platform. Help establish reliable evaluation practices for GenAI experiences across the company.
संयुक्त राज्य
कैलिफ़ोर्निया$2,08,592 – $4,29,454 / वर्ष
हाइब्रिडपूर्णकालिकवरिष्ठआवश्यक भाषा: अंग्रेज़ीAI इंजीनियरमशीन लर्निंग इंजीनियरविवरण
- Identify modernization opportunities and expand the roadmap for a company-wide evaluation system with technical leadership
- Set cross-functional technical direction, align partner teams, and increase adoption of shared evaluation capabilities
- Make long-term architectural decisions that strengthen the user experience and reliability of Pinterest’s AI and ML evaluation platform
- Develop evaluation methods and standards that combine automated metrics, expert review, human feedback, safety, and business outcomes
- Lead complex initiatives across teams, manage technical tradeoffs and risks, and deliver measurable impact
- Evolve Pinterest’s AI and ML evaluation platform into a unified, dependable system used across the company
- Work with engineering, research, product, and safety teams to improve quality, launch decisions, and confidence in AI-powered experiences
आवश्यकताएँ
- At least 3 years of hands-on experience designing and operating evaluation systems for GenAI and complex machine learning systems
- Experience creating benchmarks and golden datasets, applying automated metrics and human evaluation, using model-based grading, and analyzing failures
- Strong proficiency in Python
- Working knowledge of distributed systems principles
- Ability to iterate effectively with AI tools during coding and system design
- Extensive knowledge of GenAI and recommendation-system evaluation libraries and frameworks, including AutoEvals, OpenEvals, and Ragas
- At least 5 years of experience developing scalable platforms for distributed experimentation, data and model versioning, orchestration, observability, release management, and production monitoring
- Sound judgment regarding GenAI risks such as robustness, bias, privacy, security, and the limits of automated evaluation signals
- Bachelor’s degree in computer science, engineering, or a related discipline, or equivalent experience
लाभ
- Eligibility for equity
- Flexible PinFlex work model
- In-person collaboration once or twice per quarter
- Equal opportunity workplace
- Medical or religious accommodation support during the application process