Python/Big Data Engineer


£400 - £450 a day

Python/Big Data Developer

We are currently looking for a Python/Big Data Developer to join a global cyber security and defence organisation on an interim basis.

You will work directly on-site with one of their clients who have offices in London. This role is focusing on the build of a data pipeline with Hadoop. This is an international programme of work and we are specifically looking for someone with strong experience in Apache Spark (including the integration of Python with Spark).

You will also work within an Agile environment and join a team of like-minded, passionate developers all of whom work collaboratively and transparently to achieve results.

Key Responsibilities

Develop / code and test big data capability based on the design supplied
Align algorithms with relevant industry standards
Work with modern DevOps / open source development, build & continuous integration environment

Mandatory Skills and Experience Required

Good Python 2 skills essential
Good Apache Spark skills essential including Python integration with Spark
Software Engineering/Delivery experience essential, with experience working on large software development projects utilising source control.
Scala skills as an alternative to Python will be considered

Other Desirable Skills and Experience

Good Scala skills desirable including integration with Spark
Knowledge of Hadoop based technologies including Apache Hive and Impala
Ability to manage large volumes of data from multiple sources
Knowledge of approach data structures for algorithms for efficient ingest of e.g. large scale time series datasets, batch, real-time etc
Good time management to complete committed tasks to the set deadlines
Good communication to engage and interact with the clients teams directly

Security Clearance is required for this vacancy. If you are not currently Security Cleared, you will need to be eligible for this and willing to go through the process.

Posted by Jenrick IT Limited, 15 Feb