joblaze
← Back to jobs

LLM inference serving

1 job tagged LLM inference serving

Anthropic
Engineering Manager, Inference Routing and Performance Remote Visa
Anthropic
continuous batching coordination planes prefill/decode disaggregation KV caching Trainium
Indexed 1 day ago Apply →