Описание

BeyondTrust is hiring a remote Associate Data Engineer to help build and maintain a large-scale data lake and data pipelines for cybersecurity analytics. The role includes data modelling, distributed processing, pipeline optimization, monitoring, CI/CD, and support for ML operations.

Responsibilities

Contribute to data modelling efforts that support identity security use cases and analytical requirements.
Develop and maintain data pipelines that bring together complex information from disparate systems to support security analysis in the datalake
Optimize data workloads at a software level by improving processing efficiency.
Work with senior engineers to identify areas for process improvement and help implement solutions.
Use monitoring and observability best practices to ensure optimal pipeline performance.
Assist with ML Operations to ensure optimal model efficiency.
Leverage CI/CD best practices to effectively develop and release source code.
Participate in code reviews and collaborate with team members to improve engineering practices.

Requirements

Programming and technology knowledge in cloud data processing.
Spark experience is needed.
Ability to learn fast and strong desire to develop
Interest in cybersecurity; interest in identity security is preferred.
Understanding of software engineering principles, data structures, and distributed data processing concepts.
Experience working with distributed systems and data processing on object stores.
Ability to work autonomously and collaboratively.
Required: Data warehousing for analytics use cases
Required: Proficient in Python (or another object orientated language)
Required: Distributed processing framework experience

Nice to have

Existing Databricks knowledge is a plus.
Highly Preferred: Spark
Highly Preferred: Realtime processing experience.
Ideal: Some experience with graph data stores

We offer

Our culture of flexibility, trust, and continual learning means you will be recognized for your growth, and for the impact you make on our success.
You will be surrounded by people who challenge, support, and inspire you to be the best version of yourself.