Big Data Developer

Location: Dublin City Centre

Duration: 12 months rolling contract 

Are you a Big Data Developer searching for your next contract position? A major client of Stelfox’s are looking to recruit a Big Data Developer to join the team in Dublin in the creation of their new Big Data Pipeline in the Hadoop environment.

 We are looking for someone skilled in Hadoop, Kafka, Scala, Python, Spark and Hive, with great communication skills. You’ll be one of two developers on the team, so the ideal candidate will be someone who can work independently and really own and be proud of your work.

 Are you ready to put your expertise in Big Data to work in a new challenge, in a hands-on, development position as you all work towards this new infrastructure?  Then keep reading below for more.

 Your day to day will include

General Programming bearing in mind Big Data architecture of this new pipeline
Data formats and Big Data formats 
SPARK written in Scala, Java or Python
Bash/Shell scripting
Hadoop File System
An understanding of Javascript to host job configuration details
 ETH (Jenkins/NEXUS/Maven/GIT/JIRA)
A knowledge of high-level Groovy scripting, for use with Jenkins
Hive/BigSQL (TEXTFILE, SEQUENCEFILE, RCFILE, AVRO, ORCFILE, PARQUET)
SQL Hbase and Kafka for real-time processing
Working closely with the team, mentoring junior members, and making sure everyone is focused on the end goal
Working closely with the dev team to ensure all bug fixes, and changes are correct before going live with the pipeline

This is a solid, 12+ month contract building the data pipelines, migrating from their previous system to Hadoop

If you are excited by the prospect of putting your skills to the test in a new position, apply today for immediate consideration or contact me directly on tamsin@stelfox.com or 00353 16793182

Email me jobs like this