Stefanini LATAM
Stefanini LATAM
Stefanini LATAM is a technology solutions provider focused on digital transformation and business modernization. With more than 30 years of experience, the company helps organizations improve operational models and customer experiences through automation, artificial intelligence, cybersecurity, and data analytics. Its work combines consulting with technology implementation, supporting clients as they identify opportunities to optimize processes, respond to changing market conditions, and pursue sustainable growth.

QA Data Analyst – Search Relevance (Hybrid, Santiago)

QA Data Analyst responsible for measuring the quality and relevance of digital search at Stefanini, a global technology company. Analyze KPIs, A/B tests, and dashboards to improve conversion and product discovery.

Description

  • Measure, validate, and safeguard search quality across digital platforms.
  • Evaluate performance through business KPIs and relevance metrics.
  • Ensure ranking and search-experience changes produce measurable gains in navigation, product discovery, and conversion.
  • Track and report search KPIs, including Search session share, suggestion CTR, conversion, and attributed revenue.
  • Calculate relevance metrics such as NDCG and MRR, and compare pre- and post-release results to verify measurable ranking improvements.
  • Identify regressions and edge cases, including zero-result searches and uncorrected spelling errors.
  • Support the design and analysis of A/B tests for ranking and search UX changes.
  • Build and maintain search-performance dashboards for product and business teams.
  • Work with Backend, Frontend, Search, and Product teams to prioritize findings and deliver ongoing improvements.

Requirements

  • Data analysis experience using SQL and Python.
  • Familiarity with search relevance metrics, including NDCG and MRR.
  • Experience designing and analyzing A/B tests.
  • Proficiency in data visualization and BI dashboards.
  • Strong critical thinking and analytical rigor.
  • Ability to communicate findings to technical and business teams.
  • Results-oriented approach.
  • Degree in Civil Engineering, Computer Engineering, Statistics, or a related field.
  • Experience in data analysis, QA, or digital product analytics, with strong SQL and Python skills.
  • Knowledge of search relevance metrics such as NDCG and MRR, applied statistics for A/B testing, and BI and web analytics tools.

Related Jobs

Knowtion Health

Remote Talent Acquisition Manager

Knowtion Health

Oversee recruiting systems, requisitions, analytics, and contingent workforce operations at Knowtion Health. Help support scalable hiring processes for a growing healthcare company.

Open