DevOps Big Data Analyst

London

£500 - £565 a day


Build out the middle-tier and back-end parts of the program / solution
Integrating with existing Strategic Big Data Platform (basically Cloudera HDFS with Spark, Python etc)
Taking a set of functional requirements and a high-level design; elaborating to the detail where needed.
Ensuring data is complete, accurate, timely, and reconciled.
Refactoring the data flows / ETL / table schemas where needed
Keep it simple, and reuse standard components and frameworks were expedient.

Essential skills:

Extensive experience in a similar role, preferably within financial services
Big Data administration: RHEL Linux, Cloudera CDH, DevOps tools and Python scripting
Experience of production Java 8
Experience with continuous integration, delivery and deployment.
Kerberos, LDAP
Knowledge of No-SQL databases (HBase/Hadoop, Casandra, Accumulo etc.).
Experience with Windows & Linux operating environment & scripting experience (Windows Server 2008, RHEL 6).

Spring Technology is acting as an Employment Business in relation to this vacancy.

Posted by Spring, 16 May