Data Engineer (Spark, Hadoop) | Contract role

Location Singapore
Discipline Information & Communications Technology
Job Reference BBBH105448_1632499580
Salary Negotiable
Consultant Name Bernice Mae Nocum Rallonza
Consultant Email bernice.rallonza@manpower.com.sg
Consultant Contact No. 65515576
EA License No. 02C3423
Consultant Registration No. R1442141

Job Scope:

  • Help write rules engines, analytics code, services and components in Java, Spark, Kafka, Hadoop, Hive
  • Responsible for systems analysis - Design, Coding, Unit Testing and other SDLC activities
  • Requirement gathering and understanding, analyse and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates
  • Spark query tuning and performance optimisation
  • Work proactively, independently and with global teams to address project requirements, and articulate issues/challenges with enough lead time to address project delivery risks
  • Providing expertise in technical analysis and solving technical issues during project delivery
  • Code reviews, test case reviews and ensure code developed meets the requirements

Job Qualifications:

  • Degree in Information Technology or Computer Science or equivalent
  • 5+ years of hands-on experience on HDFS (Hadoop), spark, impala, hive, as well as database technology
  • Experience in Core Java
  • Fundamental knowledge of distributed architectures, SOA, Micro-services, PaaS
  • Good knowledge of data manipulation using distributed data processing systems such as Spark SQL
  • Required to have good SPARKS skills
  • Source Code Control (experience with Git preferably)
  • Able to perform Unix / Linux scripting
  • Knowledge in Distributed computing, Big Data Analytics, Data Transformation
  • Relevant industry experience in large scale crawling on cloud platforms would be advantageous
  • Computer Science fundamentals in algorithm design, problem-solving, and complexity analysis

Bernice Mae Nocum Rallonza EA License No. 02C3423 Personnel Registration No. R1442141

Please note that your response to this advertisement and communications with us pursuant to this advertisement will constitute informed consent to the collection, use and/or disclosure of personal data by ManpowerGroup Singapore for the purpose of carrying out its business, in compliance with the relevant provisions of the Personal Data Protection Act 2012. To learn more about ManpowerGroup's Global Privacy Policy, please visit https://www.manpower.com.sg/privacy-policy