Vi.Tech 4 дня назад

Data Engineer

  • Удалённо
  • Опыт от 3 лет
PythonSQLCI/CDETLAirflowDBTDWHData QualitySQL ServerSSIS

Описание

Responsibilities

  • Develop the corporate data platform and DWH;
  • Migrate existing ETL processes from SSIS to Apache Airflow 3 and an internal YAML-driven Python framework;
  • Develop and support reliable data pipelines;
  • Ensure stable industrial operation: retry, backfill, idempotency, deduplication, and correct error handling;
  • Develop data quality checks;
  • Optimize SQL and work with Microsoft SQL Server;
  • Develop CI/CD processes for working with data;
  • Create reusable tools and self-service solutions for analytical teams;
  • Participate in the development of DWH architecture and data modeling approaches.

Requirements

  • Data Engineer experience from 3 years;
  • Confident SQL and practical experience with Microsoft SQL Server;
  • Python: OOP, modular architecture, type hints, testing, logging, working with REST API and databases;
  • Experience with Apache Airflow or other industrial orchestrator;
  • Experience with dbt or similar SQL transformation framework;
  • Understanding of ETL/ELT, batch and near-real-time processing;
  • Ability to build reliable and fault-tolerant data pipelines;
  • Experience with Git and CI/CD;
  • Experience implementing Data Quality checks;
  • Understanding of DWH architecture and data layer organization;
  • Knowledge of data modeling approaches: Kimball, Inmon, Data Vault, Anchor Modeling.

Nice to have

We offer

  • Opportunity to influence the product, we are always open to new ideas and feedback;
  • Opportunity to be effective anywhere in the world, we work remotely, but this does not prevent us from being a team (if desired, you can work from the office - Moscow, Nizhny Novgorod, Kovrov, Vladimir);
  • Friendly atmosphere and openness to new knowledge, we communicate informally, organize internal meetups, speak at conferences, share experience;
  • Opportunity to become an ambassador of the IT brand, we have a developer relations program :)
  • Happy and engaged team – we maintain a high employee satisfaction rate (eNPS);
  • Performance reviews twice a year with bonuses up to two salaries and defined grades;
  • Health care - expanded DМS with dentistry for you, and family can be connected with a discount;
  • Comfortable workspace - we provide equipment or you can work on your own.

Hiring process