Software Engineer, Infrastructure

What you’ll do

As a Software Engineer, Infrastructure at Sierra, you will be responsible for designing, building, and maintaining the core systems that make our AI platform possible. You’ll focus on making Sierra’s infrastructure secure, reliable, and scalable, enabling product teams to deliver with speed and confidence.

• Ensure the reliability, scalability, and performance of our platform and LLM inference serving as we rapidly grow traffic.

• Build and maintain cloud infrastructure using Terraform to ensure scalable, secure, and reproducible environments.

• Create and maintain a self-serve infrastructure platform that enables the rest of engineering to deploy and operate services.

• Own and evolve CI/CD pipelines and release management, enabling fast, reliable deployments for Sierra’s platform.

• Architect and operate distributed systems that leverage distributed databases, retrieval systems, and ML models.

• Develop and maintain core data serving abstractions along with authentication and security features (SSO, RBAC, authentication controls).

• Navigate and integrate our stack with enterprise customer environments in scalable and maintainable ways.

• Enhance observability tooling (metrics, logging, tracing) to provide deep visibility into platform health and performance.

• Lead and participate in incident management, improving system resilience through proactive monitoring, root cause analysis, and postmortems.

What you’ll bring

• Strong software engineering background with 5–7+ years of hands-on development experience in highly technical products.

• A strong inclination towards building automation, tooling, and platform, along with designing maintainable systems.

• Proven experience with cloud platforms (AWS, GCP, or Azure) and infrastructure as code (Terraform preferred).

• Hands-on expertise in CI/CD systems, release management, and container orchestration (e.g., Docker, Kubernetes).

• Experience with observability tools (Prometheus, Grafana, Datadog, OpenTelemetry, etc.).

• Experience in incident response and operating distributed systems in production.

• Degree in Computer Science or related field, or equivalent professional experience

Even better…

• Production experience working with LLMs and machine learning models.

• Background in distributed systems, running SaaS services at scale, and agentic architecture.

• Familiarity with security and authentication protocols (OAuth, SSO, mTLS).

• Previous experience in a fast-paced startup environment or platform/infra-focused team.

Our values

• Trust: We build trust with our customers with our accountability, empathy, quality, and responsiveness. We build trust in AI by making it more accessible, safe, and useful. We build trust with each other by showing up for each other professionally and personally, creating an environment that enables all of us to do our best work.

• Flexible (unlimited) paid time off

• Life insurance and disability benefits

• Retirement plan dependent on country of employment

• Parental leave

• Fertility and family building benefits through Carrot

• Free alphorn lessons