Analytica 1 час назад

Data Engineer

  • United States
  • Удалённо
PythonSQLCI/CDETLSparkDBTData ModelingDatabricksData QualityDelta Lake

Описание

Responsibilities

  • Design, build, and maintain scalable data pipelines and data architectures using Databricks and distributed processing frameworks (ownership and complexity vary by level)
  • Develop and optimize data models, including dimensional (star/snowflake) schemas, to support analytics and reporting use cases
  • Build and support ETL/ELT processes using SQL, Python, and Spark to ingest, transform, and curate datasets
  • Collaborate with stakeholders to translate business requirements into technical data solutions
  • Ensure data quality, integrity, and performance through testing, monitoring, and optimization
  • Contribute to data platform design decisions, tooling selection, and engineering best practices (increasing influence at higher levels)
  • Implement and support CI/CD pipelines for data workflows and assist with deployment and maintenance of data applications
  • Apply data governance, security, and metadata management best practices

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related quantitative field (or equivalent experience)
  • Experience working across cloud (AWS, Azure) or hybrid data environments
  • Demonstrated hands-on experience with Databricks commensurate with overall years of experience and seniority level
  • US Citizenship and must be able to obtain and maintain security clearance
  • Strong SQL and programming skills (Python and/or Scala)
  • Experience designing data models and optimizing data processing workflows
  • Ability to independently deliver data solutions and troubleshoot performance issues
  • Hands-on experience building and maintaining data pipelines using Databricks and Spark

Nice to have

  • Experience with Delta Lake and lakehouse architecture pattern
  • Familiarity with modern data stack tools (e.g., dbt, Airflow, or similar orchestration tools)
  • Experience with data governance, cataloging, and lineage tools
  • Experience mentoring junior engineers or leading technical initiatives (senior level)
  • Relevant certifications in data engineering or big data technologies particularly in Databricks

We offer

  • Competitive compensation
  • Performance-based bonuses
  • Employer-sponsored health benefits
  • Professional development funding
  • 401(k) match

Hiring process

  • Application Review: AI tools may help identify skills and experiences relevant to the role.
  • Interview Support: AI-powered notetaking tools may be used during interviews to document discussions and summarize key points.
  • All hiring decisions are made by Analytica recruiters and hiring managers.