Analytica 1 час назад
Data Engineer
- United States
- Удалённо
PythonSQLCI/CDETLSparkDBTData ModelingDatabricksData QualityDelta Lake
Описание
Responsibilities
- Design, build, and maintain scalable data pipelines and data architectures using Databricks and distributed processing frameworks (ownership and complexity vary by level)
- Develop and optimize data models, including dimensional (star/snowflake) schemas, to support analytics and reporting use cases
- Build and support ETL/ELT processes using SQL, Python, and Spark to ingest, transform, and curate datasets
- Collaborate with stakeholders to translate business requirements into technical data solutions
- Ensure data quality, integrity, and performance through testing, monitoring, and optimization
- Contribute to data platform design decisions, tooling selection, and engineering best practices (increasing influence at higher levels)
- Implement and support CI/CD pipelines for data workflows and assist with deployment and maintenance of data applications
- Apply data governance, security, and metadata management best practices
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related quantitative field (or equivalent experience)
- Experience working across cloud (AWS, Azure) or hybrid data environments
- Demonstrated hands-on experience with Databricks commensurate with overall years of experience and seniority level
- US Citizenship and must be able to obtain and maintain security clearance
- Strong SQL and programming skills (Python and/or Scala)
- Experience designing data models and optimizing data processing workflows
- Ability to independently deliver data solutions and troubleshoot performance issues
- Hands-on experience building and maintaining data pipelines using Databricks and Spark
Nice to have
- Experience with Delta Lake and lakehouse architecture pattern
- Familiarity with modern data stack tools (e.g., dbt, Airflow, or similar orchestration tools)
- Experience with data governance, cataloging, and lineage tools
- Experience mentoring junior engineers or leading technical initiatives (senior level)
- Relevant certifications in data engineering or big data technologies particularly in Databricks
We offer
- Competitive compensation
- Performance-based bonuses
- Employer-sponsored health benefits
- Professional development funding
- 401(k) match
Hiring process
- Application Review: AI tools may help identify skills and experiences relevant to the role.
- Interview Support: AI-powered notetaking tools may be used during interviews to document discussions and summarize key points.
- All hiring decisions are made by Analytica recruiters and hiring managers.