Research scientist - human evaluation
Location
Sunnyvale, CA | United States
Job description
Required:
Demonstrated background in collecting data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
Can own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out projects.
- Strong understanding of machine learning principles, especially in the context of LLMs.
- Knowledgeable about LLM evaluation techniques, such as human evaluation and automated benchmarks.
- Can own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out projects.
- Fluent in at least one statistical programming language such as Python (preferred) or R.
- Demonstrated background in collecting data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
- Strong verbal and written communications skills with the ability to work effectively across internal and external organizations and virtual teams.
- PhD or advanced degree in computer science, machine learning, cognitive science, psychology, economics, or similar (preferred)
Report this job
- Dice Id: 10123373
- Position Id: UT-HEM-851
Job tags
Salary