About the Job
At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Intern...
At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution ...
Available Locations: Austin, TX | New York City, NY | San Francisco, CA
Key Responsibilities
Build and lead the models team: Hire, coach, and grow the people who run the catalog today and build its intelligence over time. Give people real ownership, give direct feedback, and grow leads who can run their own areas.
Run model launches end-to-end: Scope integrations, coordinate testing and evals, confirm pricing, metering, capacity, and security, and get docs and announcements ready. Prepare day-zero launches in advance so they can ship in minutes.
Keep the catalog true: Make sure what we publish (capabilities, limits, versions, prices) matches what developers actually get. Catch silent regressions, such as broken tool calling, truncated streams, quantization changes, or usage and pricing mismatches, before customers do.
Build model intelligence: As it comes online, own the evals, capability maps, and per-task rankings behind our auto-routing profiles and model recommendations. Make sure they measure what they claim to, and connect regressions to routing decisions so customers who chose "auto" aren't the ones who discover a problem.
Treat the catalog and intelligence as products: Have a point of view on which models belong in the catalog, which routing profiles to ship, and what market intelligence to publish. Base it on usage, quality, reliability, and cost data. Turn what you learn into roadmap input.
Run a lightweight operating cadence: Keep one source of truth for what's in flight, who owns it, what's blocked, and what ships next. Keep Engineering, Product, Partnerships, and other stakeholders aligned and informed without status meetings.
Automate relentlessly: Turn repeatable steps into scripts, tools, and agent workflows: endpoint validation, eval runs, catalog and pricing reconciliation, regression detection, and provider follow-ups. Manual effort per launch should fall as the catalog grows.
Day-Zero & Quality Launches: Ensure new models launch on day zero with tested capabilities, accurate pricing, docs, and a clear call on routing eligibility.
Catalog Reliability & Health: Ensure the catalog reflects reality, and proactively identify when a model or provider is underperforming before customers notice.
Auto-Routing & Optimization: Deliver auto-routing that measurably beats a fixed model choice on cost or quality for users.
Developer Trust & Methodology: Build and maintain trusted rankings and recommendations grounded in solid methodology.
Partner & Stakeholder Management: Set clear expectations for providers, while keeping Engineering, Product, Partnerships, and other stakeholders aligned.
Team Leadership & Growth: Provide clear ownership and direction so the team knows what's next, who owns it, and how to grow into bigger roles.
Operational Scalability: Continually drive down the human effort required for each launch, eval, and routing update through tools and automation.
Required Skills & Abilities
People Leadership: Experience hiring, managing, and growing engineers or operators, giving direct feedback, delegating real ownership, and expanding scope without becoming a bottleneck.
Technical & Shipping Capabilities: Proven track record of taking technical launches or integrations from ambiguity to production across teams and partners. Hands-on ability to write TypeScript, Python, or Rust, read API docs, inspect endpoints, and debug using terminal tools (logs, cURL).
Model Ecosystem Expertise: Deep familiarity with new models, labs, and inference providers. Hands-on understanding of streaming, tool calling, structured outputs, rate limits, token pricing, and provider-specific model behavior variations.
Product & SRE Mindset: Data-driven product instincts to advocate for adding, modifying, or retiring catalog items. SRE approach to defining, measuring, and alerting on service health, managing incidents calmly, and fixing root causes.
Agent Workflows & Detail-Oriented Execution: Daily experience building with agents—scoping work, verifying outputs, and integrating deterministic checks or human judgment appropriately. Meticulous attention to detail regarding model IDs, context limits, per-token prices, and response fields.
Experience at an inference provider, model lab, model router, eval platform, or API company.
Background in evals, ranking/recommendation systems, observability, metering, or usage-based billing.
Familiarity with Cloudflare Workers, AI Gateway, Workers AI, or Replicate.
Relevant domain backgrounds in engineering management, SRE, partner engineering, evals/applied ML, technical program management, or solutions engineering.
