Staff Plus Software Engineer, Vector Database

Описание

Anthropic seeks a Staff+ Software Engineer to build and operate its vector database and retrieval infrastructure. The role covers ANN index design, storage and serving architecture, performance, scalability, cost, and hybrid lexical/vector search.

Responsibilities

• Own the core of Anthropic's vector database layer: index structures, storage layout, query execution and the serving layer
• Own production readiness - benchmarking against exact search, capacity planning, onboarding new workloads, and the operational tooling to run it at scale
• Drive the recall, latency and cost trade-offs - quantization, filtered search, index build and refresh strategy, and how compute and storage are separated and scaled
• Scale throughput by an order of magnitude as research and training demand grows, and work out whether the bottleneck is architecture, hardware or engineering bandwidth
• Extend the retrieval stack toward hybrid retrieval - lexical search and fused ranking alongside vector search
• Set the evaluation methodology for the system - recall targets, latency objectives, cost per query, and the regression detection that keeps them honest
• Set technical direction for a growing team - lead design reviews, make architectural decisions others build on, and mentor the engineers joining the effort
• Share the on-call for the systems you own

Requirements

• Direct experience building a vector database or approximate nearest-neighbor search system that ran in production at scale
• Deep knowledge of ANN index structures (graph-based, clustering-based or disk-resident approaches), vector quantization and filtered search
• Experience with search relevance and ranking
• Strong systems programming skills in a language such as Rust, C++ or Go, including performance-critical and memory-intensive code
• Experience designing and operating large-scale distributed storage or serving systems with strict latency and reliability requirements
• A track record of independently scoping and delivering ambiguous, multi-quarter technical projects
• Strong written and verbal communication, with experience driving alignment across teams with different priorities
• Interest in AI safety and Anthropic's mission

Nice to have

• Experience with object-storage-backed or disaggregated compute and storage database designs
• Experience building or operating full-text search engines (inverted indexes, BM25) or hybrid retrieval systems
• Familiarity with embedding models and the retrieval demands of LLM training and inference
• Experience using GPUs or other accelerators for index build or search
• Prior experience as a technical lead on a database or search infrastructure team

We offer

• Annual Salary: $320,000–$485,000 USD
• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Currently, we expect all staff to be in one of our offices at least 25% of the time
• Visa sponsorship is available