"real time serving" Jobs

585 open tech roles matching “real time serving”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, SQL. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 585 results

Staff Software Engineer, Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 9 months ago

scheduling Routing AI/ML CPU distributed systems

Apply →

Senior Software Engineer, Model Serving

Databricks San Francisco, California $166k–$225k/yr Published 9 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $192k–$260k/yr Published 3 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $166k–$225k/yr Published 3 months ago

AI/ML model serving CPU inference systems large-scale distributed systems

Apply →

Software Engineer, Distributed Systems

Join Discord's Realtime Infrastructure team to build and operate large-scale distributed systems that enhance gaming experiences.

Discord San Francisco Bay Area $160k–$180k/yr Published 1 month ago

Terraform AWS Elixir Salt GCP

Flexible on stack

Apply →

Research Engineer, Core ML

Together AI San Francisco $200k–$280k/yr Published 5 months ago

LLMs RLAIF SGLang vLLM quantization

Apply →

Delivery Consultant- West Coast Remote

Join Airtable as a Delivery Consultant to transform client workflows using no-code solutions and AI-driven efficiencies.

Airtable San Francisco, CA; Austin, TX; Remote - US $153k–$221.5k/yr Published 1 month ago

integrations Customer Engagement Automation data modeling AI

Apply →

Staff Software Engineer, AI Platform

Harvey AI San Francisco $231k–$340k/yr Published 3 months ago

AI/ML Backend infrastructure

Apply →

Program Manager, Professional Services - West Remote

Lead technical delivery for enterprise customers at Airtable, managing complex engagements and driving AI workflow transformation.

Airtable San Francisco, CA; Remote - US $162k–$199.8k/yr Published 1 month ago

AirTable AI

Apply →

Staff Software Engineer, Agents

Harvey AI San Francisco $231k–$340k/yr Published 2 months ago

agent frameworks Python LLM APIs

Apply →

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 11 months ago

TypeScript NVLink Triton CUDA Go

Apply →

Staff Product Manager, Serverless Workspaces Remote

Databricks San Francisco, California $181.7k–$249.8k/yr Published 5 months ago

AWS cloud infrastructure SaaS GCP Azure

Apply →

Staff Machine Learning Engineer, Voice AI

Join Together AI as a Staff ML Engineer to optimize voice model serving for real-time applications on a high-impact team.

Together AI San Francisco $220k–$280k/yr Published 2 months ago

TTS H100 TensorRT-LLM ASR SGLang

Flexible on stack 60% coding

Apply →

Staff Software Engineer, Core Infrastructure

Harvey AI San Francisco $236k–$290k/yr Published 3 months ago

Terraform Datadog Sentry Pulumi Go

Apply →

Senior Machine Learning Engineer, Voice AI

Together AI San Francisco $200k–$260k/yr Published 4 months ago

TTS STT H100 TensorRT-LLM ASR

Apply →

Senior Software Engineer, AI Platform

Harvey AI San Francisco $220k–$300k/yr Published 4 months ago

Evaluation Frameworks AI/ML Agentic AI platform primitives model integration

Apply →

Staff Software Engineer, Site Reliability Engineer

Harvey AI San Francisco $238k–$290k/yr Published 7 months ago

Terraform Datadog CloudFormation Sentry AWS

Apply →

Real Estate Program Coordinator Remote Visa

Anthropic San Francisco, CA $185k–$185k/yr Published 2 months ago

AirTable Google Sheets Google Docs

Apply →

Senior Staff Applied AI Engineer - Context Retrieval Remote

Databricks Mountain View, California; San Francisco, California $228.6k–$342.8k/yr Published 2 months ago

BM25 HNSW Faiss cross-encoders ScaNN

Apply →

Senior Software Engineer, Enforce - Safety Processing

Join Discord as a Senior Software Engineer to enhance safety processing systems for millions of users in the gaming community.

Discord San Francisco Bay Area or Los Angeles Area $196k–$220.5k/yr Published 2 months ago

Datadog gRPC Pub/Sub Python GCP

Flexible on stack

Apply →