Social Health Insurance Fund 1 час назад

Senior LLMOps Engineer

1 500 000 – 2 000 000 KZTв месяц
  • Astana
  • В офисе
  • Опыт от 3 лет
AIKubernetesDockerLinuxLLMMachine LearningHelmCUDASGLangLLMOpsTritonNVIDIA H200

Описание

Responsibilities

  • Deploy LLMs and related models in a closed environment; ensure stable, efficient inference.
  • Build RAG and AI-agent infrastructure with AI and Data Engineers.
  • Establish CI/CD, model versioning, monitoring, access controls, and auditing.

Requirements

  • Higher education in IT and 3+ years’ experience operating production ML/LLM services.
  • Linux, Docker, Kubernetes, and Helm experience.
  • Deploy LLMs with vLLM, SGLang, or Triton; understand inference systems.
  • Experience with NVIDIA GPUs, drivers, and CUDA.
  • Python, Bash, CI/CD, Prometheus, and Grafana.

We offer

  • 1,500,000 to 2,000,000 KZT Gross per month