Social Health Insurance Fund 1 час назад
Senior LLMOps Engineer
1 500 000 – 2 000 000 KZTв месяц
- Astana
- В офисе
- Опыт от 3 лет
AIKubernetesDockerLinuxLLMMachine LearningHelmCUDASGLangLLMOpsTritonNVIDIA H200
Описание
Responsibilities
- Deploy LLMs and related models in a closed environment; ensure stable, efficient inference.
- Build RAG and AI-agent infrastructure with AI and Data Engineers.
- Establish CI/CD, model versioning, monitoring, access controls, and auditing.
Requirements
- Higher education in IT and 3+ years’ experience operating production ML/LLM services.
- Linux, Docker, Kubernetes, and Helm experience.
- Deploy LLMs with vLLM, SGLang, or Triton; understand inference systems.
- Experience with NVIDIA GPUs, drivers, and CUDA.
- Python, Bash, CI/CD, Prometheus, and Grafana.
We offer
- 1,500,000 to 2,000,000 KZT Gross per month