OpenAI 7 дней назад

Data Engineer

235 000 – 385 000 $в год
  • San Francisco
  • В офисе
JavaETLAirflowSparkComplianceData PipelinesHadoopS3ScalaFlinkPrefectData Ingestion

Описание

OpenAI is looking for Data Engineers to build data pipelines and core datasets for analytics, safety systems, and product growth.

Responsibilities

  • Build data pipelines
  • Build core datasets for analytics, safety systems, and product growth

Requirements

  • Data pipeline
  • ETL
  • Prefect
  • S3
  • Data ingestion
  • Java
  • Spark
  • Airflow
  • Flink
  • Scala
  • compliance
  • Hadoop
  • HDFS
  • data integrity
  • data security
  • data architecture
  • Python
  • Dagster
  • data processing
  • data warehouse

We offer

  • $235,000 - $385,000
  • Onsite in San Francisco