Senior Agentic AI Engineer

Описание

Vallettasoftware is seeking a Senior Agentic AI Engineer to join a client's team, focusing on designing and shipping specialist AI agents, building multi-agent orchestration, and developing systems for evaluating confidence and uncertainty.

Responsibilities

• Design and ship specialist AI agents that use memory, tools, data and multi-step reasoning
• Build multi-agent orchestration that routes work between specialist agents, manages dependencies and synthesises conflicting outputs
• Develop systems that evaluate confidence, uncertainty and consequence before recommendations reach a practitioner
• Build human-in-the-loop escalation so the system knows when to answer, when to ask for more information and when to defer to a human
• Create workflows that turn sport scientist expertise into validated, versioned and testable agent capabilities
• Build evaluation, observability and regression testing so agent performance can be measured and improved in production
• Work with domain experts to ensure AI outputs are grounded, traceable and actionable

Requirements

• Production agentic AI: memory or persistent state, tool use/tool calling, multi-step reasoning or workflows, production deployment and operation (chatbots, prompt engineering, and RAG alone are not enough)
• Multi-agent orchestration: experience with production multi-agent systems, agent routing, specialist agent composition, dependency-aware workflows, parallel and sequential execution, handling conflicting agent outputs, response synthesis
• Experience with LangGraph, AutoGen, CrewAI or equivalent frameworks is valuable
• Confidence calibration: hands-on experience calibrating probabilistic ML or AI systems, including Platt scaling, isotonic regression, Expected Calibration Error (ECE), reliability and calibration curves, confidence and uncertainty estimation
• 5+ years of professional experience in applied ML, AI, or software engineering
• Strong Python
• Strong software engineering fundamentals
• Experience building and operating production systems
• English level: Advanced / Native

Nice to have

• Production RAG and reranking
• Foundation-model fine-tuning or domain adaptation (LoRA, PEFT or similar)
• LLM observability and drift detection
• Evaluation harnesses and automated regression testing
• Human-in-the-loop architectures, confidence thresholds, and escalation models
• Causal or counterfactual reasoning
• Go/Golang
• AWS, including ECS, EC2, Lambda, SNS, or SQS
• GraphQL, REST, or gRPC
• PostgreSQL or MongoDB
• Experience working with sport scientists, clinicians, or other domain experts is a plus

We offer

• Global team of 100+ specialists from 20+ countries
• Diverse projects in Fintech, MedTech, AI/ML, e-commerce, and more
• Support and interview preparation
• Well-structured processes, strong management, and long-term vision
• Regular salary
• Remote work
• Working hours: 11:00-20:00 CET (>50% overlap with New York)
• Employment Type: Full-time, B2B Contract
• Salary: $4500- $5300 /mo