Data Engineer

·
Full time
Location: London
·
Job offered by: Amber Labs
·
Category: IT & Technology
Direct message the job poster from Amber Labs Technology Recruitment Consultant - Public Sector

Location: Remote Work Pattern: Contract Security Clearance: Required The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. The Role: We are seeking a highly skilled

Data Engineer

with strong expertise in

AWS, EMR, Python, and PySpark

to join our dynamic team. This role requires a self-starter who is confident in their technical abilities, thrives in a fast-paced environment, and has experience working within the

public sector and consulting . You will play a key role in designing, building, and optimizing scalable data pipelines, working closely with cross-functional teams to deliver impactful data solutions. Key Responsibilities: Data Pipeline Development:

Design, develop, and optimize

ETL/ELT pipelines

using

AWS EMR, Python, and PySpark . Cloud Infrastructure:

Build and manage

scalable data processing solutions

on AWS, leveraging services such as

S3, Lambda, Glue, and Redshift . Big Data Processing:

Work with

large-scale datasets

in distributed computing environments, ensuring high performance and efficiency. Automation & Optimization:

Develop scripts to automate data ingestion, transformation, and validation processes. Collaboration & Stakeholder Engagement:

Work closely with clients, data scientists, and business analysts to understand requirements and deliver solutions that meet business needs. Consulting & Public Sector Expertise:

Provide strategic guidance on best practices in

data engineering

and analytics within the

public sector. Data Quality & Governance:

Implement

data validation, monitoring, and governance

best practices to ensure data integrity and compliance. Requirements: AWS Expertise:

Strong experience with

AWS EMR

and other AWS data services (Glue, S3, Lambda, Redshift, Athena, etc.). Programming:

Proficiency in

Python

and

PySpark

for big data processing. Big Data Technologies:

Hands-on experience working with

distributed computing frameworks

such as

Spark . Self-Starter & Confident Communicator:

Ability to take ownership of tasks, work autonomously, and engage confidently with stakeholders. Public Sector Experience:

Previous experience working on

government or public sector projects . Consulting Experience:

Proven track record of working in

client-facing consulting roles , delivering solutions to complex business challenges. Problem-Solving:

Strong analytical and troubleshooting skills, with the ability to work under pressure in a fast-paced environment. Nice-to-Have: Experience with

Terraform, Kubernetes, or Docker

for infrastructure automation. Knowledge of

SQL, NoSQL databases, and data warehousing solutions . Familiarity with

data security, governance, and compliance

in the public sector. Join a rapidly expanding start-up where personal growth is a part of our DNA. Benefit from a flexible work environment focused on deliverable outcomes. Receive private medical insurance through Aviva. Enjoy the benefits of a company pension plan through Nest. 25 days of annual leave plus UK bank holidays. Access Perkbox, a global employee rewards platform offering discounts, perks, and wellness resources. Participate in a generous employee referral program. A highly collaborative and collegial environment with opportunities for career advancement. Be encouraged to take bold steps and embrace a mindset of experimentation. Choose your preferred device, PC or Mac. Diversity & Inclusion: Here at Amber Labs, we are dedicated to fostering an inclusive and equitable workplace for all. Our commitment to diversity, equality, and inclusion includes: Valuing the unique experiences, perspectives, and backgrounds of all employees and creating an environment where everyone feels welcomed, respected, and valued. Prohibiting all forms of harassment, bullying, discrimination, and victimisation and promoting a culture of dignity and respect for all. Educating all new hires on our Diversity and Inclusion policies and ensuring they are aware of their rights and responsibilities to create a safe and inclusive workplace. By taking these steps, we are dedicated to building a workplace that reflects and celebrates the diversity of our employees and communities. This role at Amber Labs is a permanent position, and all employees are required to meet the Baseline Personnel Security Standard (BPSS). Please be advised that, at this time, we are unable to consider candidates who require sponsorship or hold a visa of any type. What Happens Next? Our Talent Acquisition Team will be in touch to advise you on the next steps. We have a two-stage interview process for most of our consultants. In certain cases, we may include a third and final stage, which is a conversation with the company Partners. This will only be considered if deemed necessary. Seniority level

Mid-Senior level Employment type

Contract Job function

IT Services and IT Consulting

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details