Big Data Architect

·
Per hour
Location: London
·
Job offered by: MBR Partners
·
Category: IT & Technology
We are headhunting for an AiOps Architect and I would like to run the role past you to see if you have any interest or could recommend someone to me. Our client is a mid-sized leader in AiOps Telecoms software products related to network management/service assurance. The role involves designing and supporting the implementation of our client's Cloud Native Big Data Analytics infrastructure layer. This infrastructure serves as the backbone for supporting AI/ML workflows, enabling both real-time and batch processing for training and inference purposes. The typical data throughput to support is in the range of continuous streams of Terabytes of data per hour. We are looking for someone with the following background: Software development background, with major experience in: Back-end data processing Data lakehouse Hands-on experience of Big Data opensource technologies such as: Apache Airflow Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake AWS Athena Trino MongoDB AWS S3 MinIO S3 Proven successful hands-on experience of: Setting up data governance tooling and processes (schema registry, data lineage control) and data access control Setting up data pipelines for model training and inference Kubernetes or Openshift in the context of Big Data analytics AWS services In the context of both on-premise and SaaS Telco Service Assurance product development, your role is to: Lead the general vision for a coherent and future-proof Big Data Analytics for AI/ML framework Be an innovation force to leverage GenAI technologies to facilitate and accelerate the delivery of big data jobs Build and validate the high-level design of the necessary components supporting the Roadmap requirements, including Test Strategy and Performance and Scalability validation Build the Project Design (work packages, skillsets, efforts, dependencies, resourcing) accompanying the architecture for every project iteration Communicate the architecture to the development teams and accompany the development process through periodic detailed reviews, ensuring architecture is understood and respected Produce quarterly Technology Watch reports on the latest Big Data Analytics landscape Setup rigorous selection process and support selection of appropriate 3rd-party components, supporting the Big Data Analytics stack Educate/evangelize the development teams on Analytics design best practices Review low-level designs and critical code changes produced by the development teams Support all Big Data Analytics-related technical questions in context of RFI/RFQ responses Provide feasibility study / high-level costings in response to 3 to 5 year roadmap high-level strategy

#J-18808-Ljbffr

Recent Jobs

London (On site) · Full time

Are you a smart, driven professional who takes pride in making a difference in local communities? Turner & Townsend’s Real Estate division is experiencing significant growth and we’re looking for an experienced industry professional with health project experience to join our high-performing and collaborative Project Management team. Why Join Us? Impactful Work: Contribute to social [...]Read More... from Assistant Project Manager – Healthcare See details

Chasetown (On site) · Full time

My client, Autosmart International are a manufacturing success story! Site Operations Manager – leading fast-paced manufacturing and warehousing About Our Client Autosmart International is a manufacturing success story, leading the field in vehicle cleaning products. We are the No.1 choice of automotive trade customers across the UK. We have doubled in size in the last [...]Read More... from Site Operations Manager See details

London (On site) · Full time

CSS are looking for an experienced duty officer to join our client’s team who are a local council responsible for all areas within the Tendering district. Working hours: All shifts are 8 hours long with various start times available: Monday to Friday – start times between 6AM – 3PM Saturday & Sunday – 6AM – [...]Read More... from Duty Officer See details