Software development background, with major experience in: Back-end data processing Data lakehouse Hands-on experience of Big Data open-source technologies such as: Apache Airflow Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake AWS Athena Trino MongoDB AWS S3 MinIO S3 Proven successful hands-on experience of: Setting up data governance tooling and processes (schema registry, data lineage control) and data access control Setting up data pipelines for model training and inference Kubernetes or Openshift in the context of Big Data analytics AWS services In the context of both on-premise and SaaS Telco Service Assurance product development, your role is to:
Lead the general vision for a coherent and future-proof Big Data Analytics for AI/ML framework Be an innovation force to leverage GenAI technologies to facilitate and accelerate the delivery of the big data jobs Build and validate the high-level design of the necessary components supporting the Roadmap requirements, including Test Strategy and Performance and Scalability validation Build the Project Design (work packages, skillsets, efforts, dependencies, resourcing) accompanying the architecture for every project iteration Communicate the architecture to the development teams and accompany the development process through periodic detailed reviews, ensuring architecture is understood and respected Produce quarterly Technology Watch reports on the latest Big Data Analytics landscape Setup rigorous selection process and support selection of appropriate 3rd-party components, supporting the Big Data Analytics stack Educate/evangelize the development teams on Analytics design best practices Review low-level designs and critical code changes produced by the development teams Support all Big Data Analytics-related technical questions in context of RFI/RFQ responses Provide feasibility study / high-level costings in response to 3 to 5 year roadmap high-level strategy
#J-18808-Ljbffr