Vi.Tech 4 дня назад
Data Engineer
- Удалённо
- Опыт от 3 лет
PythonSQLCI/CDETLAirflowDBTDWHData QualitySQL ServerSSIS
Описание
Responsibilities
- Develop the corporate data platform and DWH;
- Migrate existing ETL processes from SSIS to Apache Airflow 3 and an internal YAML-driven Python framework;
- Develop and support reliable data pipelines;
- Ensure stable industrial operation: retry, backfill, idempotency, deduplication, and correct error handling;
- Develop data quality checks;
- Optimize SQL and work with Microsoft SQL Server;
- Develop CI/CD processes for working with data;
- Create reusable tools and self-service solutions for analytical teams;
- Participate in the development of DWH architecture and data modeling approaches.
Requirements
- Data Engineer experience from 3 years;
- Confident SQL and practical experience with Microsoft SQL Server;
- Python: OOP, modular architecture, type hints, testing, logging, working with REST API and databases;
- Experience with Apache Airflow or other industrial orchestrator;
- Experience with dbt or similar SQL transformation framework;
- Understanding of ETL/ELT, batch and near-real-time processing;
- Ability to build reliable and fault-tolerant data pipelines;
- Experience with Git and CI/CD;
- Experience implementing Data Quality checks;
- Understanding of DWH architecture and data layer organization;
- Knowledge of data modeling approaches: Kimball, Inmon, Data Vault, Anchor Modeling.
Nice to have
We offer
- Opportunity to influence the product, we are always open to new ideas and feedback;
- Opportunity to be effective anywhere in the world, we work remotely, but this does not prevent us from being a team (if desired, you can work from the office - Moscow, Nizhny Novgorod, Kovrov, Vladimir);
- Friendly atmosphere and openness to new knowledge, we communicate informally, organize internal meetups, speak at conferences, share experience;
- Opportunity to become an ambassador of the IT brand, we have a developer relations program :)
- Happy and engaged team – we maintain a high employee satisfaction rate (eNPS);
- Performance reviews twice a year with bonuses up to two salaries and defined grades;
- Health care - expanded DМS with dentistry for you, and family can be connected with a discount;
- Comfortable workspace - we provide equipment or you can work on your own.