Senior Data Engineer

·
Full time
Location: Belfast
·
Job offered by: Kainos
·
Category: IT & Technology
When you join Kainos, you get to think beyond limitations to make an immediate and positive impact – like transforming digital services for millions of citizens or helping Fortune 500 companies get live and thrive on Workday. You’ll be part of a people-first culture that is growing around the world. We’re a creative, committed, and diverse group of individuals who succeed as a team. At Kainos your ideas are heard and valued and you’ll leave a legacy that you can feel proud of.Join us and discover how our people write our story. MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS: As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments. Your responsibilities will include: Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution.

Working with Architects and Lead Engineers to ensure the software supports non-functional needs.

Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.

Working with operations teams to ensure operational readiness

Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.

Coaching and mentoring team members.

M

INIMUM

(

ESSENTIAL

)

REQUIREMENTS : Strong software development experience in one of Java, Scala, or Python

Software development experience withdata-processing platforms from vendors such as AWS, Azure, GCP, Databricks.

Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment

Proficient in SQL and SQL extensions for analytical queries

Solid understanding of ETL/ELT data processing pipelines and design patterns

Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats

Able to write quality, testable code and has experience of automated testing

Experience with Continuous Integration and Continuous Deployment techniques

DESIRABLE

REQUIREMENTS : Experience of performance tuning

Experience of data visualisation and complex data transformations

Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products

Expertise in continuous improvement and sharing input on data best practice

So what are you waiting for? Let’s write the next incredible chapter of our story together. Embracing our differences At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive. We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are. We also believe every candidate deserves a level playing field. Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out. We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details