Data Pipeline Engineer

·
Full time
Location: London
·
Job offered by: Hexegic
·
Category:
Hexegic

is a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role

The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code to identify fixes and making changes. Core Responsibilities

Maintain build schedules so that pipelines run effectively. Set up and maintain health checks on different data pipelines. Respond, triage, and debug the data pipeline when broken. Reading code and writing code changes and/or modifying the monitoring set-up. Knowing and understanding how to navigate the data pipelines and documentation. Following Standard Operating Procedures to contact other teams and data providers when data is incorrect or not received on time. Communicating outages with the end users of a data pipeline. What We Value

Comfortable reading and writing code in Python, Pyspark and Java. Basic understanding of Spark and interested in learning the basics of tuning Spark jobs. Data pipeline monitoring team members should be able to use and navigate pipeline development tools. Experience supporting data integration technologies. What We Offer

Salary: £50,000 to £60,000 25 days annual leave Personal development program: £5,000 per employee per year!

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details