Job Description

PURPOSE

• The Data Platform Team is responsible for conceptualization, implementation and management of organisation-wide data platform and solutions.
• You will be part of the team responsible for the solutioning, development, support, execution and daily operations of enterprise data solutions.
• You are required to perform the following:
  • Data Platform Lead: Design, manage and maintain data platforms (on cloud and on-prem), including data architecture and data governance framework.
  • Data Engineering Lead: Manage projects to build data solutions using comprehensive and modern data engineering techniques to support advanced analytics needs and AI/ML use cases.
• Subject matter expert in data management and data architecture with adoption of best practices and innovations, formulate the organisational data strategy, including standards of data quality, the flow of data within the organisation and security of data. 
• Manage data platform and work with different stakeholders to drive data innovations.
• Operate in a  fast-paced environment that requires the ability to manage multiple priorities and needs of stakeholders, as well as the agility to respond to changes and developments.

RESPONSIBILITIES

• Technology owner of the data platforms and lead all technical and compliance matters, including design and maintenance of data architecture, data management and data governance frameworks
• Lead technology roadmap, enhancements, upgrade, and BAU support for the data platforms and solutions
• Set up and develop a team to manage data engineering and data infrastructure
• Plan team resources, project budgets and project management, including formulating business cases for data projects
• Work closely with business and technology stakeholders on the operational front, understand requirements and issues raised by users and provide assessment and resolution to address
• Translate business requirements to technical solutions, leveraging strong business acumen
• Design and provide technical expertise to data engineers, data scientists and database administrators, to ensure systems are implemented and developed according to the required standards
• Ensure quality assurance of all technical deliverables like data pipelines and visualisation/ dashboards built. Manage, highlight, and resolve any design integration risks/ issues with relevant business and stakeholders
• Ensure data security and governance, implement processes, policies, standards and metrics to ensure the efficient and effective use/ transfer/ storage of data and in compliance with all applicable regulations
• Lead incident response, investigation, and resolution by working closely with different stakeholders (vendors, development teams, infrastructure team, etc) to support system availability
• Monitor system vulnerabilities and patch availability and provide the relevant assessment and plan to implement the remediation
• Prepare and maintain proper documentations of architecture design, data management and operation procedures, etc
   

Qualifications

• At least 5 years of hands-on experience in several or all the following areas:
  • Modern data platform development (cloud-based and on-prem) like lakehouse and data mesh/fabric architecture, including data model, data ingestion, ETL/ELT, data storage and visualisation
  • Data management and engineering technologies using Presto, Iceberg, Spark, Python, SQL, etc
  • AI/ML framework and analytics, Jupyter Notebook
  • DevOps processes (including CI/CD) and Infrastructure-as-a-Code fundamentals.
  • Data security and governance
  • Application management and operations, covering application enhancement, patching, monitoring and BAU operations
• Experiences in both batch processing and real-time data streaming
• Familiar with IBM Watsonx.Data, Tableau/Grafana solutions
• Knowledge of container platform (RedHat OpenShift), cloud architecture (AWS, GCP, Alibaba, etc), infrastructure (server architecture), network (firewall, load balancer) will be advantageous
• Experiences in vendor and contract management including tender process
• Possesses leadership, project management and risk management skills to manage projects effectively and able to work under tight timeline with minimal supervision
• Good problem solving and effective communication skills to coordinate and collaborate with different stakeholders for new projects and use case delivery