"web crawling" Jobs
31 open tech roles matching “web crawling”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Rust, C++. Every listing is re-checked daily and closed roles are removed.
Showing 20 of 31 results
Join Reflection AI as a Web Crawl Engineer to build and operate large-scale web crawling systems for frontier AI models.
Join Exa as a Web Crawler engineer to build a distributed crawler handling 100M+ pages per day.
Join Exa as a Web Crawler engineer to build a massive-scale web crawling system in San Francisco.
Join Exa as a Software Engineer Intern to work on innovative AI-driven search technologies in San Francisco.
Join Exa as a Research Engineer to define indexing signals and improve search quality in a cutting-edge AI lab.
Own the query engine for Exa's knowledge engine, building systems that search hundreds of billions of claims with precision.
Join Reflection AI as a Data Ingestion Engineer to build and operate large-scale data ingestion systems for AI model training.
Lead the development of Cognition's organic demand engine, focusing on SEO and AEO strategies in a fast-paced AI startup.
Join Exa as a Research Engineer to advance AI-driven content understanding for a revolutionary search engine.
Join Exa as a backend engineer to build massive-scale ML systems for a revolutionary search engine.
Lead the strategy and execution for Cloudflare's Agentic Search products, focusing on AI-driven search solutions.
Join Exa as a Software Engineer to build systems that enhance AI's understanding of knowledge and information.
Lead the development of Cloudflare's AI-driven search products to enhance information retrieval for developers and agents.
Drive the strategy for Signals and shape data products at Cloudflare, leveraging AI to enhance web intelligence.
Join Exa as a Safety Engineer to build fraud detection systems and ensure platform security and content moderation.
Join Exa as a Technical Sourcer to build a world-class engineering team using innovative AI-driven recruiting processes.
Join Exa as a Full Stack Engineer to build innovative AI-driven search solutions for developers and enterprises.
Join Exa as an ML evals engineer to design and build evaluation frameworks for a groundbreaking AI search engine.
Join Exa as a Product Manager on the Evals team to oversee evaluation data for search models in a cutting-edge AI lab.
Lead the web strategy and performance for LangChain, enhancing its online presence and driving conversion.