Join Arena as a Member of Product Staff to lead product development and drive measurable outcomes in AI evaluation.
Posted by employer 1 month ago
First seen on Joblaze 1 month ago
Last verified on the company career page 2 hours ago
Skills & Technologies
What you'll build
Must have
Nice to have
AI in the day-to-day
Arena evaluates AI models' performance in real-world use.
Requirements
Not disclosed in this posting: compensation, work arrangement, visa sponsorship.
Benefits
Joblaze summary
The Member of Product Staff at Arena takes ownership of a specific product area, engaging in tasks that range from identifying opportunities to shipping products and measuring their impact. This role requires a strong background in product management, particularly in consumer or enterprise products, along with technical skills to collaborate effectively with engineers and researchers. Ideal candidates will have a proven track record of driving measurable outcomes and a deep understanding of AI evaluation. Arena's small, mission-driven team emphasizes craftsmanship and curiosity, making it suitable for those comfortable in a dynamic startup environment.
Joblaze insights
Quick facts
From the original posting
We're looking for a Member of Product Staff to be the GM and owner of a product pillar, identifying what to build, building conviction, shipping with engineering and research, and driving it to measurable outcomes. This is a highly cross functional role, and you are close to users, close to the data, and close to the code. You write the PRDs, you query the tables yourself, and you stay with the product after launch until it works.
Arena is small, and the product surface is unusually broad: a consumer product used by tens of millions of people each month, an API and enterprise offering that leading AI labs and enterprises rely on, and the evaluation methodology and leaderboard that sit underneath all of it. Depending on your background, you'll focus on one of the following areas:
Enterprise & API. The API and enterprise product surface that labs, enterprises, and independent researchers build on. You'll partner directly with customers to integrate models, run evals, and deliver high-quality results; translate their feedback into product and engineering initiatives; and own packaging and monetization so that every new product ships instrumented, billable, and correctly represented in our systems.
Evaluation. The products that turn human preference into trustworthy evaluation. This is the leaderboard, the methodology, and the tools model developers use. You'll partner with research to develop new metrics, methodologies, and evaluation protocols that go beyond traditional benchmarks, disentangle performance factors like style, reasoning, and robustness, and protect the scientific integrity and transparency of the Arena leaderboard.
Growth. How tens of millions of people discover, use, and come back to Arena. You’ll run experiments, and partner with design and marketing engineering to turn what we learn about our highest-expectation users into a product they can't stop using.
Own product areas end to end, from identifying opportunities that aren't on anyone's roadmap, to building conviction, shipping, and driving to measurable outcomes
Ship and iterate, You measure, course-correct, and drive to sustained impact against the companies north star goals.
Work with ML researchers to turn research into product, creating new methods, models, and data consumable for the people who need them
Develop a deep understanding of our highest-expectation users, consumers, labs, enterprises, researchers and how they actually use Arena
Monitor user feedback, usage data, and analytics to identify trends, prioritize initiatives, and refine what we've shipped
Write the PRDs, specs, and narratives that align engineering, design, research, and leadership, and create clarity out of ambiguity when needed
Make high-stakes product decisions under uncertainty, and be accountable for the outcomes
Raise the product quality bar on the team and introduce practices others adopt, unblock teammates, and hold the line on craft
5-10+ years of product management experience on consumer, developer, or enterprise products, ideally including 0-to-1 work at an early-stage company
A track record of repeated, attributable impact, multiple projects across different roles or companies where you can quantify outcomes (revenue, engagement, efficiency) and the impact sustained after you moved on
Product judgment, taste and autonomous ownership. You've identified opportunities, validated them with evidence, built buy-in, shipped, and the bet paid off.
You’ve killed important projects in your career for the betterment of the product.
Clear, persuasive communication. You build buy-in across engineering, research, design, and leadership. You create clarity for others, not just yourself
Technical depth to work directly with engineers and researchers
Genuine conviction about AI evaluation and Arena's mission — you can articulate why this domain matters and where the product should go
Comfort with ambiguity. We're a startup. Scope is fluid, context shifts, and you'll wear many hats
Production experience with AI/LLM systems — inference pipelines, evaluation workflows, model integration, or AI-powered product features
Experience with developer- or enterprise-facing products, and fluency in consumption or usage-based revenue models
Comfort working with real-world usage data and designing metrics beyond standard benchmarks, including experiments run with statistical rigor
Experience growing a consumer or developer product at scale, with hands-on ownership of experimentation and analytics
You've raised the bar on a team with measurable before/after — introduced practices, tools, or standards that others adopted
We offer competitive compensation aligned to the markets where our team members are based. The compensation range for each role is listed on its posting and will depend on the candidate's experience and work location.
Standard company text repeated across Arena's postings is omitted here.
Explore more