← Back to results

Member of Technical Staff (Index Engineer, Search Crawler)

Join Perplexity as a Senior Index Engineer to build and optimize large-scale indexing systems for their Search Crawler.

Location
London, United Kingdom
Compensation
Not disclosed
Level
senior
Type
full time

Posted by employer 16 hours ago

First seen on Joblaze 41 minutes ago

Last verified on the company career page 41 minutes ago

Skills & Technologies

What you'll build

  • Design and operate large-scale indexing systems
  • Develop and optimize indexing strategies
  • Work on storage formats and update mechanisms
  • Keep pipelines reliable under high-throughput conditions
  • Define and implement observability across pipelines

Must have

  • 5+ years of experience building production backend or data infrastructure systems
  • Strong programming experience in Go, C++, or Rust
  • Experience with high-throughput data processing systems
  • Strong understanding of distributed systems
  • Experience running production systems

Requirements

Experience
5+ years

Not disclosed in this posting: compensation, work arrangement, visa sponsorship.

Joblaze summary

In this role, the engineer focuses on designing and maintaining the indexing and data processing systems that underpin Perplexity's search functionality. Proficiency in programming languages like Go, C++, or Rust, along with experience in high-throughput data processing and distributed systems, is essential. This position is best suited for seasoned professionals with a strong background in backend infrastructure and a systems-thinking approach. The team emphasizes reliability and performance, ensuring that data remains fresh and accessible for effective search results.

Joblaze insights

  • Listed today — first seen on Joblaze November 18, 2026. Last confirmed on Perplexity's careers page November 18, 2026.

Quick facts

How much experience is required?
At least 5 years of relevant experience for this Member of Technical Staff (Index Engineer, Search Crawler) role.
What's the tech stack?
Joblaze extracted these technologies from the posting: C++, Go, Rust.
What seniority level is this role?
Perplexity targets senior candidates for this position.
Is this full-time or contract?
Full-time for this Member of Technical Staff (Index Engineer, Search Crawler) role at Perplexity.

From the original posting

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.

  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.

  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.

  • Keep pipelines reliable and predictable under high-throughput conditions.

  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.

  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.

  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.

  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.

  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.

  • Strong programming experience in Go, C++, or Rust.

  • Experience with high-throughput data processing systems and very large datasets.

  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.

  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.

  • Experience running production systems and handling operational incidents.

  • A systems-thinking mindset and the ability to reason about end-to-end data flows.