Research Scientist

Location Singapore
Discipline Information & Communications Technology
Job Reference BBBH135560_1705978810
Salary Negotiable
Consultant Email shirley.rajasekar@experisitcont.sg.manpowersg
EA License No. 02C3423


Job Responsibilities:

  • Work with technical and non-technical stakeholders to design and execute research testing how humans evaluate large (LLM) features.
  • Conduct research with humans to validate and create automated benchmarks for LLM evaluations.



Requirements:

  • PhD or advanced Degree in Computer Science, Machine Learning, Cognitive Science, Psychology, Economics, or similar discipline.
  • Minimum 2 years of relevant experience in LLM research.
  • Fluent in at least one statistical programming such as Python or R.
  • Understanding of machine learning principles, especially in the context of LLMs.
  • Knowledgeable about LLM evaluation techniques, such as human evaluation and automated benchmarks.
  • Able to own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out projects.
  • Demonstrated background in collecting data from human participants (e.g. surveys, experiments) with knowledge in data quality, data validity, etc.
  • Communications skills with the ability to work effectively across internal and external organizations and virtual teams.