Lead the development of Reddit's agent optimization platform to enhance AI-assisted software development.
Posted by employer 1 day ago
First seen on Joblaze 1 hour ago
Last verified on the company career page 1 hour ago
Skills & Technologies
What you'll build
- Design and build agent optimization harness
- Develop evaluation environments for agent performance
- Build systems for automated evaluation and regression detection
- Design model routing and orchestration strategies
- Define metrics for developer productivity
Must have
- 5-12+ years of engineering experience
- Experience building large-scale production software systems
- Experience designing evaluation systems for AI
- Strong understanding of modern LLMs and AI agents
- Ability to operate independently in ambiguous environments
AI in the day-to-day
You'll build systems to measure and improve agents' impact on engineering velocity, including feedback loops that learn from production usage.
Requirements
- Experience
- 5–12 years
Not disclosed in this posting: visa sponsorship.
Benefits
Joblaze summary
In this role, the Software Engineer focuses on developing and refining Reddit's agent optimization and evaluation platform, which enhances the efficiency of AI-assisted software development. Key skills include extensive experience in building large-scale production systems, a strong grasp of AI agents, and the ability to design evaluation frameworks that measure engineering productivity. This position is suited for seasoned engineers with a background in complex distributed systems and a collaborative mindset. The team is dedicated to creating a flexible, model-agnostic agent platform that aligns with Reddit's long-term AI strategy.
Joblaze insights
- Listed today — first seen on Joblaze October 20, 2026. Last confirmed on Reddit's careers page October 20, 2026.
- Salary band is below the typical range for AI/ML roles (median ~$190,000).
- Starts above 1% of 134 comparable senior ai/ml roles in United States that list AI/ML we track (median $180,200 across 53 companies). See AI/ML salary trends
- AI/ML appears in 41.9% of 544 comparable senior ai/ml roles in United States; benchmarking appears in 0.2% of 544 comparable senior ai/ml roles in United States.
Quick facts
- Is the Software Engineer, Agent Optimization & Evaluation role remote?
- Yes — Reddit lists this as a fully remote position.
- What's the salary range?
- Reddit lists $109,800–$325,000 for this role.
- How much experience is required?
- 5–12 years of relevant experience for this Software Engineer, Agent Optimization & Evaluation role.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AI agents, AI/ML, LLMs, Software Engineering, benchmarking, evaluation systems.
- What seniority level is this role?
- Reddit targets senior candidates for this position.
- Is this full-time or contract?
- Full-time for this Software Engineer, Agent Optimization & Evaluation role at Reddit.
From the original posting
We are Software Engineers across multiple levels!
The Team
We're building Reddit's next-generation AI developer platform: a best-in-class agent stack that helps every Snoo build, test, review, and ship software efficiently while preserving Reddit's control over quality, costs, and long-term AI strategy. Our optimization harness measures and improves agents across the software development lifecycle by benchmarking models, detecting regressions, optimizing routing, incorporating production feedback, and improving developer productivity.
You'll report to Kyle Maxwell and partner with Platform Engineering, Infrastructure, and Developer Productivity to shape AI-assisted software development across Reddit.
The Role
As a Software Engineer, Agent Optimization & Evaluation, you will lead our agent optimization and evaluation platform. You'll build systems to measure and improve agents' impact on engineering velocity, including Reddit-specific evaluation environments, intelligent model orchestration, and feedback loops that learn from production usage. This hands-on role involves writing production code and building new systems with ownership and autonomy. Strong platform and infrastructure partners will support your work on agent optimization, evaluation, and orchestration.
What You’ll Do:
- Design and build Reddit's agent optimization harness for evaluating, benchmarking, and improving AI agents across real software engineering workflows.
- Develop Reddit-specific evaluation environments that accurately measure agent performance against meaningful engineering tasks.
- Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
- Design model routing and orchestration strategies that optimize for quality, latency, and cost.
- Define metrics and experimentation frameworks that measure developer productivity and engineering velocity.
- Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
- Partner closely with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into engineering workflows.
- Help shape Reddit's long-term strategy for a flexible, model-agnostic agent platform that gives us control over our AI capabilities and economics
You Will Bring:
- 5-12+ years of engineering experience
- Extensive experience building and shipping large-scale production software systems.
- Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI, search, developer platforms, or other complex distributed systems.
- Strong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.
- Experience building systems that optimize across multiple dimensions, including quality, latency, reliability, and cost.
- Excellent software engineering fundamentals and a passion for building production-quality systems.
- Ability to operate independently in ambiguous environments and drive technical direction for highly strategic initiatives.
- Strong cross-functional collaboration skills and experience working across engineering, infrastructure, and platform organizations.
Pay Transparency:
In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
Standard company text repeated across Reddit's postings is omitted here.