Data Engineer required for our Cork based client, a Software Product House with massive scope for career progression. This is a fast paced, young, dynamic organization that develops a number of e-commerce web applications, delivering a high-performance system to global users.
This is a permanent role that can be worked remotely with occasional presence to the office in Cork (1-2 times a month)
Responsibilities
- Collaborating with product and analytics engineers on the build-out of new data pipelines using both internal and third party data sources
- Contributing to the build-out of new workflow processes and associated monitoring and alerting
- Providing assistance in the ongoing management, update and maintenance of our data platform
- Identifying and promoting efficiencies and increasing reliability at all stages of data pipelines
- Troubleshooting production issues, identify and implement effective solutions
- Providing support to Product Engineering and overall development of data assets Contributing to schema design, data consistency and the company data dictionary;
- Helping deliver overall company data governance and compliance
- Data integrity promotion and development of automated quality assurance tests
- Promotion of data-driven decision making as part of the overall company culture.
Requirements
- Undergraduate and/or postgraduate degree in a STEM field
- 2+ years of relevant experience
- Experience creating ETL processes from various different sources like REST APIs
- Fluency in writing SQL and experience with at least one NoSQL database
- Experience with open source languages such as Python/Spark/R
- Familiarity with data engineering tools and proficiency with at least one: Airflow, ElasticSearch, Cassandra
- Experience using Linux as a development environment
- Strong knowledge of data modelling approaches and/or marketing data tools such as Google Big Query
- Be a team player capable of conducting independent research
Starting salary: up to 55K p.a. (DOE)
Email me jobs like this
