"llm inference" Jobs

46 open tech roles matching “llm inference”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 46 results

Traversal

Join Traversal as a Backend AI Engineer to design and build core systems for AI-driven site reliability in complex production environments.

Traversal New York $150k–$300k/yr Published 1 year ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Site Reliability Engineer to ensure safe AI model launches and automate deployment processes.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $320k–$485k/yr Published 1 week ago
Flexible on stack
Doctronic

Own full-cycle recruiting for exceptional AI and engineering talent at a startup focused on transforming healthcare.

Doctronic New York City Published 3 months ago
Flexible on stack
Fireworks AI

Own foundational capabilities for enterprise AI, designing data models and APIs while ensuring security and compliance for large-scale customers.

Fireworks AI New York Published 1 month ago
Flexible on stack
AssemblyAI

Join AssemblyAI as a Senior Design Engineer to shape and build exceptional product experiences in a fast-growing AI company.

AssemblyAI New York City $180k–$240k/yr Published 3 weeks ago
Flexible on stack
AssemblyAI

Join AssemblyAI as a Senior Research Engineer to enhance large-scale distributed training and inference systems in Voice AI.

AssemblyAI Remote - New York $270k–$310k/yr Published 1 week ago
Flexible on stack
Bluefish AI

Join Bluefish AI as a Senior/Staff Data Scientist to lead analytics and experimentation efforts in a fast-growing AI marketing platform.

Bluefish AI New York, Hybrid Published 3 months ago
Flexible on stack
AssemblyAI
AssemblyAI San Francisco OR New York $300k–$370k/yr Published 4 months ago
Coreweave

As an AI Engineer, you'll design and build systems that help engineers resolve real customer issues effectively.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA $143k–$210k/yr Published 2 weeks ago
Flexible on stack 70% coding
Databricks

Lead the development of data ingestion and normalization for advertising platforms at Databricks.

Databricks New York City, New York $190.9k–$253.8k/yr Published 2 weeks ago
Roboflow

Join Roboflow as an Infrastructure Engineer to secure and scale core infrastructure in a fast-paced AI-native startup environment.

Roboflow NY, SF or Remote $165k–$200k/yr Published 1 week ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 5 months ago
Harvey AI

Join Harvey AI as a Senior Software Engineer to build and operate core infrastructure for leading law firms and enterprises.

Harvey AI New York $161.3k–$241.9k/yr Published 1 month ago
Flexible on stack
Harvey AI

Join Harvey AI as a Staff Software Engineer to build and operate core infrastructure for AI workloads in a fast-growing company.

Harvey AI New York $231k–$340k/yr Published 1 month ago
Translucent

Join Translucent as an AI Engineer to build an agentic platform transforming healthcare finance decision-making.

Translucent New York City, New York $175k–$275k/yr Published 1 month ago
Flexible on stack 70% coding
Anthropic

Lead the Search Platform team at Anthropic, focusing on building and improving search systems for AI applications.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 1 month ago
Heavy meetings
Coreweave

Drive the adoption of AI runtime services at CoreWeave, leveraging your expertise in distributed systems and AI infrastructure.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA $207k–$275k/yr Published 2 months ago
Flexible on stack
Formation Bio

Join Formation Bio as a Senior Data Scientist to transform Real World Data into actionable insights for drug development.

Formation Bio New York, NY; Boston, MA; San Francisco, CA; Raleigh-Durham, NC $185.5k–$232k/yr Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and scale Claude Managed Agents in a rapidly growing team.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 3 weeks ago