Senior Data Engineer
180 000 – 200 000 $в год
MytraBrisbane и ещё 2 городаВ офисеот 5 лет
PythonJavaKafkaGoC++ClickHouseData EngineeringRustIcebergData PlatformPulsarRobotics Telemetry
Описание
Mytra is hiring a Senior Data Engineer in Brisbane, CA to build and operate a scalable data platform for high-volume robotics telemetry. The role covers ingestion, storage tiers, pipeline transforms, durable data paths, ID keying, retention, and egress policy.
Responsibilities
- Design the data capture lanes, storage tiers, and pipeline layout
- Re-design the ingestion service with something that scales
- Build the transform machinery; you own the engine and what it guarantees; the team writes the transforms that run on it
- Build the durable path for what the system does and has to remember
- Build the ID keying and crosswalk tables that connect a stored fact to its site, robot, hardware revision, calibration, layout, and pallet
- Own retention, cost, and egress as policy instead of plumbing, including retention policies per record and the site-to-cloud replication path
- Run what you build, including CI/CD, monitoring, and alerting for services running in the cloud and inside customer sites
Requirements
- 5+ years building and running production backend or data infrastructure
- You’ve written production code in Go, Python, Rust, Java or C++
- You've worked with a durable message or streaming system (NATS/JetStream, Kafka, Pulsar, or similar) and know how delivery guarantees, backpressure, and replay actually behave
- You've used a columnar store, relational databases, and No-SQL databases in production and you have a strong understanding of how trade-offs work in these technologies when used in data solutions
- You've shipped services and kept them running: CI/CD, monitoring, alerting, and being on the hook when they break
- You've designed schemas or data contracts that had to survive change
- BS/MS in Computer Science, or the equivalent from having done the work
- You've built and run data services yourself; whether ingestion, CDC, or event pipelines, rather than writing jobs on top of someone else's platform
- You know how columnar stores like ClickHouse and object-storage lakes like Parquet or Iceberg work, and have opinions about which belongs where
- Schema governance, failure modes, and cost are design inputs for you, not afterthoughts
- Uncertainty isn’t scary, and you’re willing to realize mistakes and pivot
- You can convey complex ideas and technical concepts to a diverse audience
- Openness, inquisitiveness, and constant ambition are important values
- You enjoy collaborative working and taking time to help others
- You seek and value ownership, accountability, and taking on responsibility
Nice to have
- Experience with robotics, IoT, or industrial telemetry at volume, including formats like MCAP
- GCP (GCS, BigQuery/BigLake), Kubernetes, and data systems run on-prem, at the edge, or air-gapped, where you can't lean on a cloud service being reachable
- Prep the data store for ML or RL training to read directly
- Prometheus and Grafana experience as a consumer of the data pipeline
We offer
- Competitive compensation and equity grants at a high-growth company backed by top-tier VCs
- Fully subsidized health coverage, including medical (baseline plans), dental, and vision for employees and dependents
- 401(k) plans and employer-subsidized life insurance
- Fully subsidized lunch and snacks at HQ
- Generous PTO and company-paid holidays, including one week over the winter break
- Voluntary pet insurance, Voluntary Life Insurance, Accident, Critical Illness, and Hospital Indemnity
- Fully subsidized tax advisory services and education to help you understand your equity
- Commuter benefits, including a up to $150 monthly commuter benefit
- Lively, modern combined office and lab space where we rapidly iterate through design, build, and test phases
- Fully equipped onsite gym and showers at headquarters
- Compensation for this position will be set based on the candidate's experience level and location
- The posted salary band is applicable only to the San Francisco Bay Area and is subject to change
- Pay range: 180,000 - 200,000 USD per year