Responsibilities:
- Install, configure, and maintain big data platforms like Hadoop, Clusters, Elasticsearch, Spark, Kafka, Hive, etc.
- Set up and manage distributed file systems (HDFS) and NoSQL databases (HBase, Cassandra).
- Monitor system performance, fine-tune jobs, and optimize cluster utilization.
- Manage and resolve performance bottlenecks in big data environments.
- Implement data security policies, user authentication (Kerberos), and access control (Ranger, Knox).
- Monitor the utilization of the data platform and plan for any expansions as and when required.
- Plan and implement backup and recovery strategies for big data environments.
- Design and implement workflows using tools like Apache Oozie or Apache Airflow.
- Develop shell scripts and Ansible playbooks to automate routine tasks, including monitoring, backups, and deployments.
- Provide 24/7 on-call support for production systems and resolve incidents.
- Implement data security measures to safeguard sensitive information within the data environments.
- Conduct regular reviews of user accounts and take necessary actions to ensure users are valid and active.
- Work closely with data engineers and developers to support ETL pipelines and data processing jobs.
Requirements:
- Bachelor's Degree in Computer Science, Information Technology, or related fields.
- Minimum 5-7 years of experience in a Big Data Administrator role in banking or financial institutions.
- Must have experience in big data ecosystems like Hadoop, Hadoop Distributed File System (HDFS), YARN, Hive, HBase, Spark, Kafka, and Elasticsearch.
- Proficiency in Linux/Unix system administration.
- Experience with monitoring tools like Nagios, Grafana, or Splunk.
- Able to handle high-pressure production environments.
- Excellent stakeholder management skills.
- Able to work in a fast-paced environment.
Rupa Kankariya EA License No. 02C3423 Personnel Registration No. R1441955
Please note that your response to this advertisement and communications with us pursuant to this advertisement will constitute informed consent to the collection, use and/or disclosure of personal data by ManpowerGroup Singapore for the purpose of carrying out its business, in compliance with the relevant provisions of the Personal Data Protection Act 2012. To learn more about ManpowerGroup's Global Privacy Policy, please visit https://www.manpower.com.sg/privacy-policy
