Data Pipeline Architect

·
Full time
Location: London
·
Job offered by: ISR Recruitment
·
Category: IT & Technology
This range is provided by ISR Recruitment. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range

Direct message the job poster from ISR Recruitment Digital Recruitment Specialist | GDS | Digital First | Discovery | Alpha | Beta | Live

The Opportunity: Consulting as a Data Pipeline Architect on a major central government project to provide the required services to develop robust data pipelines, analytics and visualisation tools that will support the integration of multiple infrastructure datasets across various sectors. These services will contribute to the creation of solutions that align with the principles of digital twins, which are virtual models connected to their real-world counterparts by a two-way flow of real-time data where the primary challenge is to consolidate these sources into one cohesive framework. N.B.

Candidates will have or be willing to undergo a basic level of security clearance prior to starting the role. Skills and Experience: Architectural Design: proven experience in implementing robust and scalable software architectures that meet both functional and non-functional requirements. Data Pipeline Architectures: proven experience in implementing large-scale data warehousing solutions and data streaming technologies (such as Apache Kafka). Data Pipeline and Application Scalability: experience in designing hosting and runtime architectures to scale ETL data pipelines. Security Expertise: strong background in application and data security, including overseeing penetration tests and implementing security remediations. Identity and Access Management: hands-on experience with federated authentication solutions using open standards (OAuth 2.0, OIDC, SAML). RBAC/ABAC: experience in implementing RBAC/ABAC access solutions in a national-scale service based on user profiles and data attributes. Cloud Technologies: extensive experience with AWS cloud services and best practices for cost optimisation and performance. Containerisation: proficient in using Kubernetes (AWS EKS preferred) for deploying and managing applications and ETL components in a containerised environment. Stakeholder Management: excellent ability to engage with stakeholders, facilitate discussions and achieve consensus on technical solutions. Technical Communication: strong verbal and written communication skills, with the ability to convey complex technical concepts to both technical and non-technical audiences. Infrastructure as Code (IaC): experience in deploying cloud environments using tools like Terraform. CI/CD Solutions: proven ability to design and implement continuous integration and continuous deployment pipelines using GitHub Actions. Seniority level

Mid-Senior level Employment type

Contract Job function

Information Technology, Consulting, and Other Industries

IT System Data Services, Data Infrastructure and Analytics, and IT System Design Services

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details