Gemini 59 минут назад
Senior Data Engineer
126 000 – 180 000 $в год
- New York, New York, USA · Miami, Florida, USA
- Гибрид
- Опыт от 5 лет
PythonSQLKafkaAirflowSparkSnowflakeDatabricksBigQueryFlinkBeam
Описание
Responsibilities
- Design, build, and maintain data infrastructure and pipelines spanning both batch and real-time / streaming workloads, contributing to architectural decisions along the way
- Build and maintain scalable, efficient, and reliable ETL/ELT pipelines using languages and frameworks such as Python, SQL, Spark, Flink, Beam, or equivalents
- Work on real-time or near-real-time data solutions (e.g. CDC, streaming, micro-batch) for use cases that require timely data
- Partner with data scientists, ML engineers, analysts, and product teams to understand data requirements, define SLAs, and deliver coherent data products that others can self-serve
- Establish data quality, validation, observability, and monitoring frameworks (data auditing, alerting, anomaly detection, data lineage)
- Investigate and resolve complex production issues: root cause analysis, performance bottlenecks, data integrity, fault tolerance
- Document data flows, data dictionaries, architecture patterns, and operational runbooks
Requirements
- 5+ years of experience in data engineering (or similar) roles
- Strong experience in ETL/ELT pipeline design, implementation, and optimization
- Deep expertise in Python and SQL writing production-quality, maintainable, testable code
- Experience with large-scale data warehouses (e.g. Databricks, BigQuery, Snowflake)
- Solid grounding in software engineering fundamentals, data structures, and systems thinking
- Hands-on experience in data modeling (dimensional modeling, normalization, schema design)
- Experience building systems with real-time or streaming data (e.g. Kafka, Kinesis, Flink, Spark Streaming), and familiarity with CDC frameworks
- Experience with orchestration / workflow frameworks (e.g. Airflow)
- Familiarity with data governance, lineage, metadata, cataloging, and data quality practices
Nice to have
- Experience with crypto, financial services, trading, markets, or exchange systems
- Experience with blockchain, crypto, Web3 data — e.g. blocks, transactions, contract calls, token transfers, UTXO/account models, on-chain indexing, chain APIs, etc.
- Experience with infrastructure as code, containerization, and CI/CD pipelines
- Hands-on experience managing and optimizing Databricks on AWS
We offer
- Competitive starting pay
- A discretionary annual bonus
- Long-term incentive in the form of a new hire equity grant
- Comprehensive health plans
- 401K with company matching
- Paid Parental Leave
- Flexible time off
- The base salary range for this role is between $126,000 - $180,000 in the State of New York.
- In the United States, we offer a hybrid work approach at our hub offices, balancing the benefits of in-person collaboration with the flexibility of remote work.
- Employees who do not live near one of our hubs are part of our remote workforce.
- All employees, however, are required to onboard in-person at one of our office locations.
Hiring process
- In-person onboarding