Middle / Senior Data Engineer

Описание

Aristek Systems is actively involved in the development of innovative IT solutions for the US and European markets. The company is looking for a Middle/Senior Data Engineer to join its team, working on a new Data Lake and analytics initiative for a US-based EdTech company.

Responsibilities

• Design the AWS data lake architecture (raw / cleaned / curated zones), data model and partitioning
• Build ingestion pipelines from MySQL (RDS), application events and third-party sources (CDC, batch, incremental loads)
• Develop ETL/ELT jobs and transformations (Glue / PySpark / SQL), data quality checks and monitoring
• Prepare analytics-ready datasets and support dashboards and reports (learning analytics, usage, district-level reporting)
• Implement data governance: district opt-in, access control, PII handling, encryption, audit (FERPA/COPPA, state laws, DPAs)
• Describe data infrastructure as code together with DevOps (Terraform)
• Participate in estimation, technical discussions and Agile/Scrum ceremonies; present results to the customer

Requirements

• 4+ years of commercial experience in Data Engineering
• AWS is mandatory: hands-on S3, Glue (jobs, crawlers, Data Catalog), Athena, Lake Formation / IAM, Lambda, Step Functions
• Experience building a data lake / lakehouse from scratch (Parquet, Iceberg / Delta / Hudi, partitioning)
• Strong Python (PySpark) and advanced SQL
• Ingestion from relational databases (MySQL / PostgreSQL), CDC with AWS DMS or similar
• Orchestration: Airflow (MWAA), Step Functions or Dagster
• Data modeling for analytics (dimensional modeling), data quality and testing
• Security and governance practices for PII: encryption, row/column-level access, auditing
• Infrastructure as code (Terraform or CDK), Git, CI/CD basics
• English B2 and higher

Nice to have

• Redshift, QuickSight or other BI tools (Power BI, Tableau, Superset), dbt
• Streaming (Kinesis, Kafka)
• EdTech / student-data privacy (FERPA, COPPA) experience
• AWS certifications (Data Engineer / Data Analytics)

We offer

• Remote work