Middle and Senior Data Engineers
ItransitionPolandГибридот 2 лет
PythonSQLREST APIData EngineeringETLAirflowDBTData PipelinesELTSnowflakeGraphQL
Описание
This is a hybrid role for Middle and Senior Data Engineers with Snowflake experience to join an established project for a UK-based customer.
Responsibilities
- Solve complex technical issues while developing high quality software systems using modern technologies
Requirements
- Commercial experience with Python and Snowflake
- English level B2 and higher
- Ability to work in a hybrid setup from one of the locations specified
- 2+ years with Python including strong knowledge of data libraries (pandas, multiprocess, Google Cloud SDK)
- 2+ years of experience in ETL/ELT technologies (REST API, GraphQL, DBT, etc.) and data pipeline orchestration (e.g., Airflow, Astronomer, DBT cloud, etc)
- Hands-on experience with Snowflake
- Problem-solving and root cause analysis in live production systems along with experience querying and transforming large volumes of data, data quality and data validation
- Experience in SQL (SQL Server, Oracle, MySQL, BigQuery, Snowflake)
- Comfortable working with serialized data format (JSON, AVRO, XML, CSV) as well as compressed and encoded files
- Comfortable with ingesting data using REST APIs, data transformations and data loading/unloading techniques
- English proficiency sufficient to work in an international environment
Nice to have
- Capable of designing and implementing data pipelines over cloud architecture
- Experience working with CI/CD deployments
- Experience working with GIT
We offer
- Projects for clients such as PayPal, Wargaming, Xerox, Philips, Adidas and Toyota
- Competitive compensation that depends on your qualification and skills
- Career development system with clear skill qualifications
- Flexible working hours aligned to your schedule
- Options to work remotely
- Corporate medical insurance covering services of private and public medical centers
- English courses online
- Corporate parties and events for employees and their children
- Internal conferences, workshops and meetups for learning and experience sharing
- Gym membership compensation
- 5 days of paid sick leave per year with no obligation to submit a sick-leave certificate