Senior Data Engineer (Autonomous Vehicles)

Описание

This Senior Data Engineer role focuses on building and maintaining data pipelines for autonomous-driving. You will work with multi-sensor data, prepare training datasets for machine learning teams, and contribute to geodata pipelines.

Responsibilities

• Build the pipelines that move multi-sensor data (multi-camera video, IMU, LiDAR, GPS) from vehicles into cloud storage, synchronize and geo-reference the streams
• Own the storage layout and lifecycle for sensor data: partitioning, hot and archival tiers, cost control as volume grows
• Build validation and monitoring on the ingest path: incomplete uploads, missing or unsynchronized streams, vehicles that stopped producing usable data
• Prepare training datasets for autonomous-driving models: select data by location, route, and conditions, version datasets, and deliver them in the formats ML teams need
• Take over and develop the current imagery and GPS-track pipelines from vehicle cameras, and contribute to geodata pipelines (ingestion from company data, OpenStreetMap, Overture Maps and vendors, conflation, validation, publication)
• Work with company data in BigQuery and keep spatial queries fast on large PostGIS and GeoParquet tables

Requirements

• 4+ years in data engineering
• Experience with multi-sensor data from vehicles or robots: cameras, IMU or LiDAR, and keeping the streams in sync
• Experience preparing training datasets for computer vision or autonomous-driving models
• Experience with large volumes of binary or media data in object storage (S3 or GCS); distributed processing (Spark or equivalent)
• Hands-on experience with spatial data: PostGIS, GeoPandas/Shapely, coordinate reference systems, GPS tracks
• Strong Python and SQL
• Experience with AWS or GCP, Docker, Kubernetes

Nice to have

• Sensor data formats such as ROS2 bag, MCAP or point clouds
• Parquet, Delta or Iceberg; Databricks
• Argo Workflows or Airflow
• OpenStreetMap and Overture Map
• QGIS
• BigQuery

We offer

• Opportunity to help challenge injustice by creating fair choices for millions of people across 47 countries
• Professional skills development with access to mentoring, career consulting, and learning programs
• Collaboration with teams around the world and international experience through our Global Talent Exchange Program
• Engagement in company-wide challenges, awards, sports activities, employee-led social impact and volunteering projects
• Work alongside people who take initiative, speak openly, and challenge themselves to grow
• Language skills improvement through co-financed courses and internal speaking clubs
• Final benefits may vary depending on the location