Big Data Specialist
|Job Title:||Big Data Specialist|
|Job Published:||February 25, 2021 11:54|
The role holder will be responsible for supporting the system engineering of security and cyber products and solutions for both BT and its clients globally to time, cost and quality.
The role holder will have demonstrated experience and skills in the big data discipline with a focus on the design and engineering of Hadoop and Spark technologies, both design and hands on experience. This role is focused on the platform aspects of the big data discipline rather than data and analytics. The role holder will demonstrate an ability to adapt their skills in the realm of advanced security services including but not limited to the domain of cyber security.
You'll have the following responsibilities
Provide design input into further developing the capabilities of BT's principal advanced security platforms and offerings.
To provide analytical and innovative input to projects.
Upskill team members in the domain of Big Data platforms and development.
Provide input and thought leadership into big data platform architecture and design.
Provide input into data management design.
Represent BT at customer workshops.
Maintain knowledge of the Hadoop ecosystem and related emerging technologies.
Maintain knowledge of current trends in data handling techniques including life cycle and security maintenance.
Maintain knowledge of security and cyber telemetry, log feeds and intelligence platforms.
Maintain knowledge and awareness of current threat trends and security technologies.
Detailed understanding of the various open source projects that constitute a comprehensive big data platform.
Great understanding on how Spark works and demonstrated experience using it in production environments.
Experience of the Elastic stack, including Elasticsearch, Logstash and Kibana.
Experience designing, creating, optimising and troubleshooting batch ETL processes.
Experience building and supporting high velocity streaming ingestion frameworks.
Experience with NoSQL-based datastores a bonus.
The ability to architect and design both streaming and batch use cases in a big data platform.
Knowledge of security and cyber telemetry, log feeds and intelligence platforms.
Knowledge of leading Big Data public cloud and SaaS services.
Experience you would be expected to have
Mandatory - Extensive experience with designing and supporting large production Hadoop platforms.
Mandatory - Experience working with public cloud big data services.
Mandatory - Experience with DevOps methodologies.
Preferred - Knowledge of use of Agile methodologies.
Preferred - Experience operating and managing Linux environments.
BT has a key role in British society, fostering change and leading technology innovation. From delivering the Olympics, to supporting the emergency services, to investing more into research than any other UK technology company, we take pride in everything we do - and in the people who work here.
We're now a global company operating at the forefront of the information age, employing 90,000 people in 180 countries. And we're on a mission. Guided by our core values of Personal, Simple and Brilliant our goal is to help customers, communities and businesses overcome barriers and release their potential.
So, if you're interested in the power of potential, why not join us today and release yours? You can read more here about what it's like to work at BT
Get similar jobs like these by email
By submitting your details you agree to our T&C's