Big Data Platform Engineer / Designer – Hadoop – SC Clearable

Hadoop Big Data Platform Engineer / Technical Designer
£80,000 – £95,000 (negotiable – dependant on experience)

Croydon – SC Clearance desirable – must be willing/ eligible to undergo

Big Data Platform Engineer / Designer

The programme is developing a new digital platform of services. It is one of the highest priority programmes for our client. To help deliver this challenging programme, a skilled big data platform engineer is required to design and develop a big data store and associated services. Utilising cutting edge technologies the system is deployed in a secure cloud environment running a distributed big data platform.

The programme follows Agile principles, with a continuous integration pipeline and regular incremental releases. The programme requires that all resources be Security Check (SC) level or able to obtain.

Key responsibilities:

  • Design and development of the Big Data store
  • Hands on system development and support
  • Contribute to the design, technical governance and product choices for the data store
  • Represent the programme as the technical design authority as required
  • Ensure the designs address all hosting, security and NFR requirements.
  • Ensure the system is able to gain security accreditation.
  • Technical point of authority and advocate of high quality, maintainable software and systems.
  • Liaising with senior stakeholders to give appropriate updates on progress and issues.

Required Skills

The following software development skills are required:

  • Hadoop / HDFS
  • HBase, Kafka, Kerberos
  • Delivering in a big data development team
  • Big data architecture design and analysis
  • Solr
  • REST
  • Linux

Desirable Skills

  • Postgres
  • Apache Camel, Knox, Ranger
  • Drools
  • Kubernetes
  • Docker
  • Ansible, Terraform
  • JIRA / Confluence

Damia Group Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept our Data Protection Policy which can be found at

Damia Group is acting as an Employment Agency in relation to this vacancy.

Job Reference: HADOOP

Salary: £80000 - £95000 per annum + Additional Benefits (salary neg,)

Salary per: Annum

Job Duration: 6 months

Job Start Date: ASAP

Apply Now

Head Office

Guildford Business Park
Building 2
18 Guildford Park Road
Guildford, GU2 8xg
+44 1483 243 555

Edinburgh Office

93, George Street
+44 7718 258 398

Lisbon Office

Av. Almirante Reis, 54, 6º piso
1150-019, Lisboa
(+351) 211 601 380

Please follow & like us :)

WhatsApp chat