Описание

As a Senior Software Engineer in the Data and Insight team in Search Foundation, you will be working on Bing's mission-critical analytical data, supporting the grounding business and processing petabyte-scale data daily to generate real-time insights using open-source technologies and Azure.

Responsibilities

Design, build and own the optimal data processing architecture and systems for new data and analytics pipelines, dashboards, and metrics leveraging Azure and open-source technologies
Build core datasets as well as scalable and fault-tolerant pipelines
Build data anomaly detection, data quality checks, and optimize pipelines for ideal compute and storage systems while guaranteeing high quality and SLA datasets
Understand the data compliance and data governance
Collaborate with cross-functional partners including data scientists and product managers to design and develop end-to-end data assets that help improve products
Hand on at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
Hand on data storage technology like HDFS, Azure blob etc
Leverage AI technology in coding/testing/Data processing/data validation

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

Nice to have

6+ years of experience in one or more coding languages (C#, C++, Java)
Familiar at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
Experience on cloud environment like Azure
Experience on data storage technology like HDFS, Azure blob etc
Experience in leveraging AI technology in coding or testing work
Fluent verbal and written English communication
6+ years' experience in backend service development, 2+ years' experience in batch or streaming data processing to process the PiB level data
Domain expert on Spark or Flink to handle PiB level data every day
Experience in data pipeline performance optimization
Experience to use AI in data processing and data validation
Data compliance or governance experience

We offer

The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year
The base pay range for this role in the San Francisco Bay area and New York City metropolitan area is USD $160,200 - $261,000 per year
Work site 4 days / week in-office
Less than 25% travel
Full-Time employment

Hiring process

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled