Applied AI Engineer
Join Judgment Labs as an Applied AI Engineer to build self-improving AI systems using real-world agent interaction data.
Posted by employer 8 months ago
First seen on Joblaze 1 week ago
Last verified on the company career page 1 day ago
Skills & Technologies
AI in the day-to-day
You'll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product.
Not disclosed in this posting: compensation, years of experience, work arrangement, visa sponsorship.
Joblaze summary
The Applied AI Engineer at Judgment Labs focuses on developing AI systems that analyze agent interaction data to enhance agent performance across various sectors, including finance and legal. Key skills include expertise in reinforcement learning, data evaluation, and building infrastructure for agent workflows. This role is ideal for individuals with a strong background in AI and a proactive approach to problem-solving, as it requires ownership of projects and the ability to translate complex research into practical applications. The position offers significant autonomy and collaboration with both internal teams and external research partners.
Joblaze insights
- Listed 9 days ago on Joblaze — tracked directly from Judgment Labs's career page.
- Judgment Labs has 4 other open roles including Product engineer, full stack, Backend/Infra Engineer, Founding Account Executive.
- 5148 active AI/ML roles on Joblaze right now.
- 799 active Machine Learning roles on Joblaze right now.
- 135 active reinforcement learning roles on Joblaze right now.
- Typical AI/ML salary we track runs $140,000–$231,000 (median $180,000, across 2237 roles). See AI/ML salary trends
Quick facts
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AI/ML, Machine Learning, reinforcement learning.
- What seniority level is this role?
- Judgment Labs targets mid-level candidates for this position.
- Is this full-time or contract?
- Full-time for this Applied AI Engineer role at Judgment Labs.
From the original posting
The Role:
We are looking for Applied AI Engineers to build AI systems that use agent interaction data to understand how agents behave, evaluate them at scale, and improve them through learning and feedback.
Your research will not live on a whiteboard. You’ll work directly with real-world agent data, apply frontier methods in production, and see your work ship into the product. By making agent behavior measurable and debuggable, your systems will support teams deploying agents across finance, legal, operations, and other high-stakes workflows. You will own projects end-to-end, with significant autonomy, and work closely with the team to build self-improving agent systems.
What You'll Do:
Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data in order to extract meaningful signals
Design and implement post-training and optimization workflows to improve agents, both internally and for customers
Build agent platform infrastructure, including orchestration, runtimes, and developer tools that help teams define, test, deploy, and iterate on complex agent workflows
Build internal tools and infrastructure that support rapid experimentation, analysis, and training
Work closely with product to integrate agents into customer-facing workflows
Collaborate with external companies and research partners on frontier AI research
What We're Looking For
Every hire clears three bars, no exceptions:
Agency. You are intellectually curious, self-directed, and stay up to date with the latest research, blogs, trends, and ideas.
Depth of thought. You can reason clearly about abstract systems, and ideally have experience working on agents, RL, or the infrastructure that supports them.
Ownership. You own outcomes, not just tasks. You use freedom to experiment responsibly, make business-driven decisions, and focus first on work that moves the company forward.
More specifically, you should bring strength in at least one of the following areas:
Data quality, evaluation, benchmarking, and hands-on work with messy production data
Agent systems built or evaluated in real-world or production settings
Reinforcement learning, post-training, agents, or machine learning fundamentals
Infrastructure and systems work across training, data pipelines, evaluation, or model serving
Translating research into product while balancing customer constraints, technical tradeoffs, and business impact
Turning ambiguous problems into clear, well-designed plans