DevOps Big Data Engineer - AWS/Kubernetes - 6m - £550/£600pd
£550 - £600 a day
Senior DevOps Data Engineer - AWS (ECS), Big data, real time data analysis and streaming platforms (Spark Streaming, Kafka or Kinesis Streams etc), Container virtualization - Docker and Kubernetes, Unix/Linux, Jenkins, GIT, Docker, Scripting (bash or Python), monitoring, security.
Data driven and consumer centric organization are building out a big data platform which Is at the core of it's brands/data products. This platform will provide storage, big data compute, ad-hoc analytical data access, workflow pipeline management and data access services for both existing applications and new experiments. This platform is paramount in delivering deep learning techniques to derive insights that empower the organisations analytical community.
You will work closely with Agile aligned engineering teams in building out this large infrastructure platform at scale in a globally distributed and highly available cloud based system (AWS). On top of this you will be encouraged to automate everything along the way including operational and data driven metrics collection.
Key skills required:
Building large, complex cloud based infrastructure
Familiar working with data engineering/scientists and real time data products
Unix/Linux flavours (Networking, info sec)
Source code repositories - GIT mostly
Continuous Integration - Jenkins
Scripting - Bash or Python
Container Visualization - Docker, Kubernetes
Nice to have:
Real-time analytics and streaming platforms (Spark Streaming, Kafka, Kinesis Streams, etc)
Machine learning pipelines in production
Knowledge of Distributed Systems
Knowledge of No SQL databases like Redis, Cassandra or DynamoDB
Please send your CV
Posted by Linux Recruit, 17 Apr