Senior Software Engineer, Agentic Discovery

About the Department

Emerging Technologies & Incubation (ETI) is where new and bold products are built and released within Cloudflare. Rather than being constrained by the structures which make Cloudflare a hugely successful business, we are able to leverage them to deliver entirely new tools and products to our customers. Cloudflare’s edge and network make it possible to solve problems at massive scale and efficiency which would be impossible for almost any other organization.

About the Team

We build the products that enable the next era of the Internet: making domains Readable, Discoverable, and Callable for autonomous AI agents.

Here at Cloudflare, agentic discovery is a core part of our vision for the Agentic Internet. As AI agents change how humans and machines find, evaluate, and act on information, businesses need tools to control how they are represented and reached. We build capabilities that enable website owners to prepare their sites for agent interaction, test and observe how agents read their content, establish open interaction standards (like WebMCP and MCP), and create entirely new channels to reach agentic audiences.

We are a cross functional group that communicates and collaborates regularly. We celebrate our achievements, support each other when we make mistakes, and hold each other and our work to a high standard.

About the Role

We are looking for a Senior Software Engineer to serve as a technical anchor and become a subject matter expert on our Agentic Discovery team. In this role, you will define the architecture, core protocols, and multi-team standards powering the next generation of agent-web interactions.

As a senior technical leader, you will shape product roadmaps, mentor engineers across Cloudflare, and write technical specifications that drive execution across multiple teams. You will drive engineering excellence across edge infrastructure, data pipelines, protocol layers, and developer tooling, ensuring systems are resilient and complexity is reduced for your peers.

What You'll Do

• Architect and ship high-throughput, resilient production services that make web properties Readable (structured content transformation), Discoverable (indexing and AEO), and Callable (WebMCP, tool-calling APIs, Generative UI) for autonomous agents.
• Define emerging agent protocols and integrations (MCP, MCP Apps, UCP, MPP, WebMCP). Author architectural specifications and technical designs that guide engineering work both within and outside the ETI team.
• Partner directly with Product Management, customers and stakeholders to translate customer needs into technical requirements, clarify KPIs, and shape engineering roadmaps.
• Drive improvements in system health and observability. Lead complex incident responses, conduct post-incident retrospectives, and rearchitect systems to eliminate failure modes and minimize customer-escalation issues.
• Elevate the engineering process across Cloudflare through code reviews, technical mentorship, architectural governance, and candidate evaluation for engineering hiring.

Desirable Skills, Knowledge, and Experience

• Experience designing scalable system architecture and setting performance metrics in a distributed environment.
• Experience writing technical specifications and leading cross-functional technical initiatives to completion.
• Deep understanding of HTTP, APIs, proxies, caching, web security, and performance bottlenecks spanning multi-service architectures.
• Hands-on experience and deep conceptual understanding of AI agents, tool calling, Model Context Protocol (MCP), or agent harnesses.
• Ability to partner with product managers and customers to navigate ambiguous problem spaces and iteratively deliver large-scale architecture.
• Experience mentoring junior and mid-level engineers, contributing to hiring, and driving improvements to engineering processes and incident response workflows.

Bonus Points

• Fluency in async Rust or TypeScript/JavaScript edge runtimes (e.g., Cloudflare Workers) at scale.
• Active contributions to or leadership in open-source agent frameworks, protocols (e.g., MCP), web standards bodies, browser engines, or network proxies.
• Track record of resolving complex, multi-team production incidents and driving post-mortem recommendations to completion.
• Background in search engines, Answer Engine Optimization (AEO), web crawling at scale, or RAG platform engineering.
• Expertise in cryptographic protocols (public-key encryption, digital signatures) or privacy-preserving web architectures.