"llm inference systems" Jobs

40 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 40 results

AssemblyAI

Join AssemblyAI as a Senior Research Engineer to enhance large-scale distributed training and inference systems in Voice AI.

AssemblyAI Remote - New York $270k–$310k/yr Published 1 week ago
Flexible on stack
Doctronic

Own full-cycle recruiting for exceptional AI and engineering talent at a startup focused on transforming healthcare.

Doctronic New York City Published 3 months ago
Flexible on stack
Coreweave

As an AI Engineer, you'll design and build systems that help engineers resolve real customer issues effectively.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA $143k–$210k/yr Published 2 weeks ago
Flexible on stack 70% coding
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 5 months ago
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and scale Claude Managed Agents in a rapidly growing team.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 3 weeks ago
Fireworks AI

Own foundational capabilities for enterprise AI, designing data models and APIs while ensuring security and compliance for large-scale customers.

Fireworks AI New York Published 1 month ago
Flexible on stack
Harvey AI

Join Harvey AI as a Staff Software Engineer to build and operate core infrastructure for AI workloads in a fast-growing company.

Harvey AI New York $231k–$340k/yr Published 1 month ago
Roboflow

Join Roboflow as an Infrastructure Engineer to secure and scale core infrastructure in a fast-paced AI-native startup environment.

Roboflow NY, SF or Remote $165k–$200k/yr Published 1 week ago
Flexible on stack
Harvey AI

Join Harvey AI as a Senior Software Engineer to build and operate core infrastructure for leading law firms and enterprises.

Harvey AI New York $161.3k–$241.9k/yr Published 1 month ago
Flexible on stack
Databricks

Lead the development of data ingestion and normalization for advertising platforms at Databricks.

Databricks New York City, New York $190.9k–$253.8k/yr Published 2 weeks ago
Anthropic

Lead the Search Platform team at Anthropic, focusing on building and improving search systems for AI applications.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 1 month ago
Heavy meetings
Translucent

Join Translucent as an AI Engineer to build an agentic platform transforming healthcare finance decision-making.

Translucent New York City, New York $175k–$275k/yr Published 1 month ago
Flexible on stack 70% coding
Coreweave

Drive the adoption of AI runtime services at CoreWeave, leveraging your expertise in distributed systems and AI infrastructure.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA $207k–$275k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Customer Trust Specialist to enhance security engagements and build trust with enterprise customers.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $255k–$270k/yr Published 5 days ago
Gusto
Gusto Denver, CO - Hybrid; New York, New York, United States; San Francisco, CA - Hybrid $217k–$265k/yr Published 4 months ago
Coreweave

Join CoreWeave as an Account Solution Architect to deepen partnerships with financial services customers and scale AI workloads.

Coreweave New York, NY $143k–$210k/yr Published 3 months ago
Flexible on stack
Snorkel AI

Own the roadmap and execution for Snorkel AI's Infrastructure organization, focusing on internal platforms and security systems.

Snorkel AI New York City, NY (Hybrid); San Francisco, CA (Hybrid) $220k–$280k/yr Published 3 months ago
Coreweave

Join CoreWeave as an Account Solution Architect to partner with AI teams and drive technical success across the customer lifecycle.

Coreweave New York, NY $143k–$210k/yr Published 3 months ago
Flexible on stack
Pallet

Join Pallet as a Senior/Staff Platform Engineer to build security foundations for AI-driven logistics systems in a fast-growing company.

Pallet San Francisco or New York $195k–$265k/yr Published 5 months ago
Flexible on stack 70% coding