"web crawling" Jobs

63 open tech roles matching “web crawling”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Rust, TypeScript, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 63 results

Reflection AI

Join Reflection AI as a Web Crawl Engineer to build and operate large-scale web crawling systems for frontier AI models.

Reflection AI San Francisco, CA Published 4 months ago
Exa

Join Exa as a Web Crawler engineer to build a distributed crawler handling 100M+ pages per day.

Exa San Francisco, California Published 4 days ago
Flexible on stack
Perplexity AI

Join our Crawler team as a Backend Software Engineer to develop and optimize large-scale web crawlers and data processing systems.

Perplexity AI Belgrade Published 1 year ago
Flexible on stack
Exa

Join Exa as a Web Crawler engineer to build a massive-scale web crawling system in San Francisco.

Exa San Francisco, California Published 1 year ago
Flexible on stack
Exa

Join Exa as a Web Crawler engineer to build a massive-scale web crawling system in Singapore.

Exa Singapore Published 10 months ago
Flexible on stack AI-first team
Perplexity

Join Perplexity as a Search Crawler Analyst to enhance our crawling and storage system through data analysis and engineering.

Perplexity Belgrade Published 3 weeks ago
Perplexity AI

Join Perplexity AI as a Search Crawler Analyst to enhance our crawling pipeline and improve search quality.

Perplexity AI Belgrade Published 3 weeks ago
Horizon3.ai

Join Horizon3.ai as a Senior Software Engineer to enhance our browser automation and crawling engine for autonomous pentesting.

Horizon3.ai US, Remote $169k–$208k/yr Published 4 months ago
Flexible on stack
Cursor

Join a small, passionate team to build data systems for training frontier coding models at Cursor.

Cursor Palo Alto, CA Published 2 months ago
Exa

Join Exa as a Software Engineer Intern to work on innovative AI-driven search technologies in San Francisco.

Exa San Francisco, California Published 2 months ago
Flexible on stack
Exa

Join Exa as a Research Engineer to define indexing signals and improve search quality in a cutting-edge AI lab.

Exa San Francisco, California Published 1 month ago
Exa

Join Exa as a Research Engineer to define indexing signals and improve search quality in a cutting-edge AI environment.

Exa Zurich Published 4 days ago
Exa

Own the query engine for Exa's knowledge engine, building systems that search hundreds of billions of claims with precision.

Exa San Francisco, California Published 1 week ago
Flexible on stack
Exa

Own the query engine for Exa's knowledge engine, building systems that deliver precise answers over vast data at scale.

Exa Zurich Published 4 days ago
Flexible on stack
Reflection AI

Join Reflection AI as a Data Ingestion Engineer to build and operate large-scale data ingestion systems for AI model training.

Reflection AI San Francisco, CA Published 4 months ago
Flexible on stack
Exa

Join Exa as a Research Engineer to enhance search and retrieval systems in a cutting-edge AI lab.

Exa San Francisco, California Published 3 months ago
Cognition

Lead the development of Cognition's organic demand engine, focusing on SEO and AEO strategies in a fast-paced AI startup.

Cognition San Francisco Published 1 month ago
Exa

Join Exa as a Research Engineer to advance AI-driven content understanding for a revolutionary search engine.

Exa San Francisco, California Published 1 month ago
Flexible on stack
Exa

Join Exa as a Research Engineer to build innovative AI-driven search solutions in Singapore.

Exa Singapore Published 8 months ago