Senior Data Engineer II - Real Time Data Engineering
111 000 – 145 000 £в год
WiseLondon и ещё 1 город
KafkaData Engineeringevent-driven architectureFlinkOLAPProtobufSpark StreamingDeployment PipelinesAvroReal-time data
Описание
This is a Senior Data Engineer role in Wise's Treasury Global Liquidity team, focused on real-time data engineering, involving designing and building streaming data pipelines, liquidity observability infrastructure, and high-throughput event processing systems. You will transform the financial engineering impact by pioneering the real-time Liquidity Attribution Model (LAM), architecting high-throughput Kafka and Flink streaming pipelines that continuously process global bank transactions.
Responsibilities
- Design and build the foundations of real-time liquidity observability stack and core streaming data pipelines that power global financial operations
- Deliver key infrastructure initiatives
- Set the technical streaming strategy
- Build robust, scalable systems that handle high-velocity financial movement with zero room for error
- Architect low-latency streaming pipelines that deliver instant, global liquidity visibility across every currency, jurisdiction, and nostro account
- Build the high-octane engine behind cash positioning, routing high-value transactions instantaneously with fine-grained event controls
- Fuel ML forecasting models to maximize yield on surplus capital
- Bulletproof event architecture against out-of-order spikes, network partitions, and schema shifts
- Master a cutting-edge Medallion architecture and pair streaming pipelines with sub-second OLAP querying
- Empower Treasury Ops with instant, precise visibility into unencumbered liquidity
- Proactively chase clarity using collaborative RFCs, whiteboard sessions, and direct stakeholder loops to solve ambiguity before it hits production
- Write well-tested, maintainable code
- Conduct rigorous design reviews
Requirements
- Proven track record building, deploying, and operating production-grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming)
- Deep hands-on experience handling duplicate events, out-of-order log processing, late-arriving data, and exactly-once processing semantics in financial or mission-critical domains
- Strong expertise in windowing techniques (tumbling, sliding, session windows), stateful stream processing, and high-throughput real-time aggregation across streaming data pipelines
- Advanced experience in modeling data for both real-time stream consumer patterns and downstream analytical stores (e.g., event schemas, state store schemas, schema evolution with Protobuf/Avro)
- Instinctive design for dead-letter queues, backpressure management, circuit breakers, and state-store recovery
We offer
- Salary: £111,000- £145,000 plus RSUs
- Comprehensive benefits package