Our client is a mid-sized leader in AiOps Telecoms software products related to network management and service assurance.
The role involves designing and supporting the implementation of our client's Cloud Native Big Data Analytics infrastructure layer. This infrastructure serves as the backbone for supporting AI/ML workflows, enabling both real-time and batch processing for training and inference purposes. The typical data throughput to support is in the range of continuous streams of terabytes of data per hour.
We are looking for someone with the following background:
Software development background, with major experience in intense back-end data processing and data lakehouse. Hands-on experience with Big Data open-source technologies such as: Apache Airflow Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake AWS Athena Trino MongoDB AWS S3 MinIO S3
Proven successful hands-on experience of: Setting up data governance tooling and processes (schema registry, data lineage control) and data access control. Setting up data pipelines for model training and inference. Kubernetes or Openshift in the context of Big Data analytics. AWS services.
In the context of both on-premise and SaaS Telco Service Assurance product development, your role is to:
Lead the general vision for a coherent and future-proof Big Data Analytics for AI/ML framework. Be an innovation force to leverage GenAI technologies to facilitate and accelerate the delivery of big data jobs. Build and validate the high-level design of the necessary components supporting the roadmap requirements, including Test Strategy and Performance and Scalability validation. Build the Project Design (work packages, skillsets, efforts, dependencies, resourcing) accompanying the architecture for every project iteration. Communicate the architecture to the development teams and accompany the development process through periodic detailed reviews, ensuring architecture is understood and respected. Produce quarterly Technology Watch reports on the latest Big Data Analytics landscape. Setup a rigorous selection process and support the selection of appropriate 3rd-party components, supporting the Big Data Analytics stack. Educate/evangelize the development teams on Analytics design best practices. Review low-level designs and critical code changes produced by the development teams. Support all Big Data Analytics-related technical questions in the context of RFI/RFQ responses. Provide feasibility study/high-level costings in response to 3 to 5-year roadmap high-level strategy.
#J-18808-Ljbffr