CHOICEIT вчера

Middle / Senior Data Engineer

  • Belgrade
  • Удалённо
  • Полная занятость
PythonSQLPostgreSQLClickHouseETLDWHApache SparkGreenPlumApache Airflow

Описание

Responsibilities

  • Design, develop and evolve data pipelines
  • Work with DWH: data models, layers, marts and ETL/ELT processes
  • Write and optimize complex SQL queries
  • Develop tools and services for working with data in Python
  • Support and develop production pipelines
  • Work with large volumes of data and distributed processing
  • Monitor data quality and reliability
  • Participate in the selection of technical solutions and the development of the data platform
  • Interact with analysts, developers, and other product teams

For Senior level, experience in independent architectural design and responsibility for the technical approach to the task is also important.

Requirements

  • Very good knowledge of SQL and experience with complex queries and large data volumes
  • Confident Python: not only small scripts, but also production code, libraries or internal tools
  • Good understanding of DWH construction principles
  • Experience in designing and developing ETL/ELT processes
  • Understanding of data modeling, building marts and data quality control
  • Ability to independently understand the task and propose a technical solution

Nice to have

  • Practical experience with Airflow: DAG development and support, scheduling, retries, backfill, monitoring
  • Experience with dbt or similar data transformation tools
  • Experience with Spark and understanding of distributed data processing
  • Work with analytical DBMS: ClickHouse, Greenplum, Vertica or other MPP/OLAP systems
  • Kafka
  • Iceberg
  • Trino
  • Docker / Kubernetes
  • CI/CD
  • Understanding of Data Mesh approaches
  • Participation in open-source or personal technical projects

We offer

  • Full-time
  • Remote work format
  • Flexible start of the working day
  • Corporate equipment
  • Probation period of 3 months
  • Extended benefits package after the probation period: medical insurance, budget for sports / languages / additional medical coverage, additional paid days off
  • Internal technical meetings, training, and the opportunity to participate in professional conferences and training

Hiring process

Introduction with a recruiter -> short technical screening -> technical sessions on SQL, DWH, and Python -> for Senior candidates, an additional session on architecture and design -> meeting with the team.