Описание

Anthropic is hiring a Staff Software Engineer, Inference in Dublin on a hybrid basis. The role builds and maintains large-scale inference serving infrastructure for Claude, including request routing, autoscaling, deployment pipelines, and accelerator integration. Responsibilities emphasize ML infrastructure and distributed systems rather than model development.

Responsibilities

Building and maintaining critical systems that serve Claude to millions of users worldwide
Maximizing compute efficiency to serve explosive customer growth
Enabling breakthrough research by giving scientists high-performance inference infrastructure
Tackling complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms
Identifying and addressing key infrastructure blockers to serve Claude to millions of users while enabling breakthrough AI research
Designing intelligent routing algorithms that optimize request distribution across thousands of accelerators
Autoscaling our compute fleet to dynamically match supply with demand across production, research, and experimental workloads
Building production-grade deployment pipelines for releasing new models to millions of users
Integrating new AI accelerator platforms to maintain our hardware-agnostic competitive advantage
Contributing to new inference features (e.g., structured sampling, prompt caching)
Supporting inference for new model architectures
Analyzing observability data to tune performance based on real-world production workloads
Managing multi-region deployments and geographic routing for global customers

Requirements

Familiarity with performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing
Significant software engineering experience, particularly with distributed systems
Results-oriented, with a bias towards flexibility and impact
Ability to pick up slack, even if it goes outside your job description
Desire to learn more about machine learning systems and infrastructure
Thrives in environments where technical excellence directly drives both business results and research breakthroughs
Cares about the societal impacts of your work
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Nice to have

Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments
Experience with high-performance, large-scale distributed systems
Experience implementing and deploying machine learning systems at scale
Experience with load balancing, request routing, or traffic management systems
Experience with LLM inference optimization, batching, and caching strategies
Experience with Kubernetes and cloud infrastructure (AWS, GCP)
Experience with Python or Rust

We offer

Hybrid work in Dublin, Ireland
Annual salary: €295,000 – €355,000 EUR
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices
Visa sponsorship is available; every reasonable effort will be made to get you a visa if an offer is made, and an immigration lawyer is retained to help with this
Competitive compensation and benefits
Optional equity donation matching
Generous vacation and parental leave
Flexible working hours
Lovely office space in which to collaborate with colleagues

Hiring process

Applications will be reviewed on a rolling basis