"web crawling" Jobs

60 open tech roles matching “web crawling”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: SEO, Python, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 60 results

Reflection AI

Join Reflection AI as a Web Crawl Engineer to build and operate large-scale web crawling systems for frontier AI models.

Reflection AI San Francisco, CA Published 2 months ago
Perplexity AI

Join our Crawler team as a Backend Software Engineer to develop and optimize large-scale web crawlers and data processing systems.

Perplexity AI Belgrade Published 1 year ago
Flexible on stack
Exa

Join Exa as a Web Crawler engineer to build a massive-scale web crawling system in San Francisco.

Exa San Francisco, California Published 1 year ago
Flexible on stack
Exa

Join Exa as a Web Crawler engineer to build a massive-scale web crawling system in Singapore.

Exa Singapore Published 9 months ago
Flexible on stack AI-first team
Horizon3.ai

Join Horizon3.ai as a Senior Software Engineer to enhance our browser automation and crawling engine for autonomous pentesting.

Horizon3.ai US, Remote $169k–$208k/yr Published 2 months ago
Flexible on stack
Cursor

Join a small, passionate team to build data systems for training frontier coding models at Cursor.

Cursor San Francisco Published 2 weeks ago
Exa

Join Exa as a Software Engineer Intern to work on innovative AI-driven search technologies in San Francisco.

Exa San Francisco, California Published 2 weeks ago
Flexible on stack
Reflection AI

Join Reflection AI as a Data Ingestion Engineer to build and operate large-scale data ingestion systems for AI model training.

Reflection AI San Francisco, CA Published 2 months ago
Flexible on stack
Exa

Join Exa as a Research Engineer to enhance search and retrieval systems in a cutting-edge AI lab.

Exa San Francisco, California Published 2 months ago
Exa

Join Exa as a Research Engineer to build innovative AI-driven search solutions in Singapore.

Exa Singapore Published 7 months ago
Exa

Join Exa as a backend engineer to build massive-scale ML systems for a revolutionary search engine.

Exa San Francisco, California Published 1 year ago
Flexible on stack
ElevenLabs

Join ElevenLabs as a Research Engineer to build and operate large-scale web crawlers for AI model training.

ElevenLabs United Kingdom Published 2 weeks ago
Exa

Join Exa as a Backend Engineer to build massive-scale ML systems for a revolutionary search engine.

Exa Singapore Published 3 months ago
Flexible on stack
Horizon3.ai

Lead and grow a team of engineers specializing in web application discovery at a fast-growing remote cybersecurity company.

Horizon3.ai US, Remote $225.3k–$265k/yr Published 2 weeks ago
Flexible on stack Heavy meetings
Sierra

Define and execute Sierra's SEO strategy to drive organic growth and optimize website performance in a high-growth AI-focused company.

Sierra San Francisco, CA Published 1 month ago
Horizon3.ai

Join Horizon3.ai as a Senior Software Engineer to build an autonomous pentesting agent for cybersecurity.

Horizon3.ai US, Remote $169k–$208k/yr Published 2 weeks ago
70% coding
Instawork

Own Instawork's discoverability strategy, leveraging technical SEO and AI tools to enhance user engagement and organic acquisition.

Instawork San Francisco, California, United States $110k–$140k/yr Published 2 weeks ago
Flexible on stack
Exa

Join Exa as a Software Engineer to build systems that enhance AI's understanding of knowledge and information.

Exa San Francisco, California Published 2 months ago
AI-first team
Instacart

Join Instacart as a Software Engineer II to enhance search engine visibility and drive organic traffic with a flexible remote-first team.

Instacart Canada - Remote (ON, AB, BC, or NS Only) CA$145k–CA$153k/yr Published 3 months ago
Flexible on stack