"inference systems" Jobs

1244 open tech roles matching “inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1244 results

SambaNova

Join SambaNova as a Senior Inference Systems Performance Architect to enhance AI/ML system performance.

SambaNova San Jose, California, United States Published 2 months ago
Cartesia

Join Cartesia as an Inference Engineer to design and build low latency, scalable model inference for cutting-edge AI applications.

Cartesia *HQ - San Francisco, CA Published 1 year ago
Flexible on stack
Anthropic

Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.

Anthropic Ontario, CAN Published 2 months ago
Flexible on stack
Sierra

Join Sierra as a Software Engineer on the Inference team to build efficient AI systems for customer-facing applications.

Sierra San Francisco, CA Published 3 weeks ago
Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 2 months ago
Flexible on stack Heavy meetings
Together AI

Join Together AI as a Research Intern to work on cutting-edge distributed inference and optimization for large foundation models.

Together AI San Francisco $58–$70/hr Published 1 month ago
Flexible on stack
Inferact

Join Inferact as a co-op student to work on cutting-edge AI inference systems in a hands-on engineering role.

Inferact San Francisco Published 1 month ago
Flexible on stack
Together AI

Join Together AI as a Research Intern to work on cutting-edge distributed inference and optimization for large foundation models.

Together AI San Francisco $58–$70/hr Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build the distributed runtime for large-scale LLM inference in a high-impact team.

baseten San Francisco Published 3 weeks ago
Hippocratic AI

Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.

Hippocratic AI Menlo Park, CA Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 5 months ago
Flexible on stack
Hedra

Join Hedra as an Inference Optimization Engineer to enhance visual models' efficiency and performance in a collaborative research environment.

Hedra San Francisco Published 3 weeks ago
Flexible on stack
Inworld AI

Join Inworld AI as a Senior Machine Learning Engineer to optimize and run real-time AI inference systems in a collaborative environment.

Inworld AI Mountain View, California, USA $250k–$300k/yr Published 1 week ago
Flexible on stack
Mirendil

Own the inference systems that power frontier AI models in production and research at a tech-first startup.

Mirendil San Francisco $300k–$400k/yr Published 4 months ago
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 4 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to build and scale AI systems that serve millions of users worldwide.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Hippocratic AI

Join Hippocratic AI as a senior LLM Inference Systems Engineer to build high-performance networking for large language models.

Hippocratic AI Menlo Park, CA Published 3 weeks ago
Flexible on stack