CHOICEIT вчера
Middle / Senior Data Engineer
- Belgrade
- Удалённо
- Полная занятость
PythonSQLPostgreSQLClickHouseETLDWHApache SparkGreenPlumApache Airflow
Описание
Responsibilities
- Design, develop and evolve data pipelines
- Work with DWH: data models, layers, marts and ETL/ELT processes
- Write and optimize complex SQL queries
- Develop tools and services for working with data in Python
- Support and develop production pipelines
- Work with large volumes of data and distributed processing
- Monitor data quality and reliability
- Participate in the selection of technical solutions and the development of the data platform
- Interact with analysts, developers, and other product teams
For Senior level, experience in independent architectural design and responsibility for the technical approach to the task is also important.
Requirements
- Very good knowledge of SQL and experience with complex queries and large data volumes
- Confident Python: not only small scripts, but also production code, libraries or internal tools
- Good understanding of DWH construction principles
- Experience in designing and developing ETL/ELT processes
- Understanding of data modeling, building marts and data quality control
- Ability to independently understand the task and propose a technical solution
Nice to have
- Practical experience with Airflow: DAG development and support, scheduling, retries, backfill, monitoring
- Experience with dbt or similar data transformation tools
- Experience with Spark and understanding of distributed data processing
- Work with analytical DBMS: ClickHouse, Greenplum, Vertica or other MPP/OLAP systems
- Kafka
- Iceberg
- Trino
- Docker / Kubernetes
- CI/CD
- Understanding of Data Mesh approaches
- Participation in open-source or personal technical projects
We offer
- Full-time
- Remote work format
- Flexible start of the working day
- Corporate equipment
- Probation period of 3 months
- Extended benefits package after the probation period: medical insurance, budget for sports / languages / additional medical coverage, additional paid days off
- Internal technical meetings, training, and the opportunity to participate in professional conferences and training
Hiring process
Introduction with a recruiter -> short technical screening -> technical sessions on SQL, DWH, and Python -> for Senior candidates, an additional session on architecture and design -> meeting with the team.