Data Engineer (Python, Pyspark) 6 months contract - $13K

Location Singapore
Discipline Information & Communications Technology
Job Reference BBBH136974_1711332816
Salary S$10000 - S$13000 per month
Consultant Name Rupa Kankariya
Consultant Email rupa.kankariya@manpower.com.sg
Consultant Contact No. 65515317
EA License No. 02C3423
Consultant Registration No. R1441955


Job Summary:
You will have the opportunity to develop data-driven innovative analytical solutions and identify opportunities to support business and client needs in a quantitative manner and facilitate informed recommendations/decisions through activities like building restful API for data products, AI-driven engineering solutions, automated data pipelines, performing jobs in big data cluster by using different execution engines and program such as Java, Python, Spark, Hive, Impala, etc.

Job Description

  • Develop, maintain, and fine-tune highly reliable and scalable back-end services and applications primarily using Java and Spring Boot.
  • Know well about the Continuous Integration/Continuous Deployment (CI/CD) process and know how to leverage Jenkins and other similar tools.
  • Testing frameworks and familiarity in test-driven development (TDD) practices.
  • Building, deploying, and maintaining production-level data driven applications and data processing workflows or pipelines.
  • Curiosity, creativity, and excitement for technology and innovation.
  • Understanding of product requirements, engaging with team members and customers to define solutions, and estimating the scope of work required.


Job Qualifications

  • Bachelor's Degree in Applied Mathematics, Engineering or any related field.
  • At least 4 years of experience, ideally within a Software Engineer, Data Engineer with Java and Python technical stack, Data Solution role.
  • High proficiency in Java, Python, and SQL.
  • Solid Java development experience with Spring-Boot, Jenkins, Database, Cloud Foundry, and testing framework (e.g. unit test, integration test, etc).
  • Experience in the cloudnative big data framework (e.g. Hadoop, Yarn, Spark, Impala, Hive, NiFi, Airflow)
  • Experience in deploying solutions in cloud environments (e.g. Cloudera, Databricks, AWS) and services (e.g. Tableau, PowerBI, Databricks SQL dashboards).
  • Experience working with engineering best practices (e.g. Git, Jira, DevOps).
  • Solid understanding of data modeling, data monitoring, data dashboarding, database design, and data warehousing concepts.
  • Experience working in an Agile/Scrum environment.

Rupa Kankariya EA License No. 02C3423 Personnel Registration No. R1441955

Please note that your response to this advertisement and communications with us pursuant to this advertisement will constitute informed consent to the collection, use and/or disclosure of personal data by ManpowerGroup Singapore for the purpose of carrying out its business, in compliance with the relevant provisions of the Personal Data Protection Act 2012. To learn more about ManpowerGroup's Global Privacy Policy, please visit https://www.manpower.com.sg/privacy-policy