Описание

This role is with the Inference team, which builds and maintains critical systems for serving Claude to millions of users globally, focusing on maximizing compute efficiency and enabling breakthrough AI research through high-performance inference infrastructure.

Responsibilities

Designing intelligent routing algorithms that optimize request distribution across thousands of accelerators
Autoscaling the compute fleet to dynamically match supply with demand across production, research, and experimental workloads
Building production-grade deployment pipelines for releasing new models to millions of users
Integrating new AI accelerator platforms to maintain hardware-agnostic competitive advantage
Contributing to new inference features (e.g., structured sampling, prompt caching)
Supporting inference for new model architectures
Analyzing observability data to tune performance based on real-world production workloads
Managing multi-region deployments and geographic routing for global customers

Requirements

Significant software engineering experience, particularly with distributed systems
Results-oriented, with a bias towards flexibility and impact
Willingness to pick up slack, even if it goes outside the job description
Desire to learn more about machine learning systems and infrastructure
Ability to thrive in environments where technical excellence directly drives both business results and research breakthroughs
Care about the societal impacts of your work
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience

Nice to have

Experience with high-performance, large-scale distributed systems
Experience implementing and deploying machine learning systems at scale
Experience with load balancing, request routing, or traffic management systems
Experience with LLM inference optimization, batching, and caching strategies
Experience with Kubernetes and cloud infrastructure (AWS, GCP)
Experience with Python or Rust

We offer

Annual Salary: 235,000-295,000 EUR/year
Visa sponsorship is provided, with reasonable efforts to secure a visa if an offer is made
Competitive compensation and benefits
Optional equity donation matching
Generous vacation and parental leave
Flexible working hours
A collaborative office space
Location-based hybrid policy: expectation to be in one of the offices at least 25% of the time, with some roles potentially requiring more

Hiring process

Applications will be reviewed on a rolling basis