Big Data Engineer - Elastic

Big Data Engineer (Elastic)

Based in Brentford

Option of some remote working

£75,000 - £85,000 Per Annum

Permanent Opportunity

Job Description

The Big Data Engineer is accountable and responsible for designing, implementing, operating and optimising the Elastic Stack infrastructure whilst providing guidance to Operating Companies' security teams on the activities related to the Elastic Stack infrastructure and the future roadmap of this Big Data platform. This is achieved through taking the lead in the constant improvement of the configuration of the Elastic Stack platform, as well as writing deployment policies and guidelines for infrastructure deployment and defining and maintaining best practices guides.

With us you will:

• Accountable for the configuration and change management of the Elastic Stack platform.

• Accountable for the correct operation and operational processes across the Elastic Stack infrastructure, defining and following industry best practices.

• Serve as Subject Matter Expert for the Elastic Stack providing guidance and advice on technology and support for the definition and implementation of the roadmap.

• Supporting the evaluation of new design methods and technologies to protect against existing and emerging security threats.

• Engage with Security Architecture and Security Design teams to define and develop automated capabilities via APIs

• Work cooperatively within the Security Operations Centre and other Cyber Security teams to establish and maintain a strong and supportive relationship with customers.

• Act as a point of escalation for other Engineers and provide guidance and mentoring.

Apply if you have:

• Extensive hands-on experience in the design, management and maintenance of solutions based on the Elastic Stack (Elasticsearch, Logstash, Kibana, Beats).

• Experience of the management and maintenance of Apache Kafka.

• Design of security automation via the definition of Application Programming Interfaces.

• Application of CI/CD pipeline principles to the security environment.

• Experience in the containerization of security workloads using Cloud-based Kubernetes.

• Professional experience in Security Design, System Design and Service Design.

• Agile delivery using Scrum or Kanban methodologies.

• Extensive experience in driving SIEM strategic roadmaps and developing next generation SIEM solutions such as Big Data platforms.

• Track record of delivering cyber security platform operations in a complex & dynamic technology environment.

• Personal experience and judgement to be able to quickly determine the right operational treatment of cyber security platforms.

• Strong analytical skills to inform effective data driven decisions on service improvement & risk reduction.

• Effective collaboration across globally dispersed teams in order to deliver the consistency, and risk reduction, outcomes required.

• Active & compelling engagement of people and stakeholders, across a broad range of internal and external stakeholders, up to and including Cyber Security Leadership Team level.

• Communicating & reporting concise summaries of complex scenarios & information across diverse and senior stakeholder groups.