Data Engineer - Dublin City Centre
I am currently working on a very exciting role with my client, an exciting company in the EdTech sector. This is a new role due to rapid expansion on the engineering team. You will gain hands on experience with a great range of tech! You will also work alongside an award winning team with some of the best developers and engineers in the industry!
You should have a passion for big data and learning new skills. This is a company where you will be challenged daily and work in a team where the boundaries are constantly pushed. You will work across multi functional teams including data science, development, DevOps and product teams.
The Role:
* You will work heavily with Spark and gather data from various parts of the business to populate the data lake.
* You will be using Kafka to stream large data sets which supports millions of users.
* You will work with a range of data teams to implement the data lake using AWS
* Improve APIs
* Working with the DevOps teams to create the right environments
* Troubleshoot issues over Spark, Kafka and AWS apps.
Requirements:
* Bachelor's degree in technical subject
* 4+ years experience in a similar role
* Experience working with Apache Spark
* Experience producing and consuming large datasets on Kafka.
* Experience working with Java and Spring Boot
* Experience working with big Data on AWS (Ideally EMR, S3 and E2C)
* Knowledge of Big Data architecture
* Experience with docker and containerisation would be an advantage but is not essential.
This is an excellent opportunity for anyone who wants to progress quickly and gain great experience in a growing field. There is a great range of benefits associated with the role including pension, healthcare, bonus structure, Friday pizza and beers and more! There is also an amazing atmosphere in this company where everyone continues to grow and learn together.
For more information please contact Eimear Mellotte at Reperio on 015713000 for a confidential discussion.
Reperio Human Capital Limited acts as an Employment Agency and an Employment Business.
Email me jobs like this
