Jay Shin

* denotes equal contribution (order is random)

🔥 Prometheus: Inducing Fine-grained Evaluation Capability in Language Models (Jamin Shin, Seungone Kim, Yejin Cho)*, Joel Jang, Shayne Longpre, Hwaran Lee, Sangdoo Yun, Seongjin Shin, Sungdong Kim, James Thorne, Minjoon Seo To appear at Instruction Workshop @ NeurIPS 2023

arXiv Site

EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim, Yoonjoo Lee, Jamin Shin, Young-Ho Kim, Juho Kim Preprint Under Review

arXiv Site

The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning Seungone Kim, Se June Joo, Doyoung Kim, Joel Jang, Seonghyeon Ye, Jamin Shin, Minjoon Seo To appear at EMNLP 2023 arXiv

Aligning Large Language Models through Synthetic Feedback Sungdong Kim, Sangwhan Bae, Jamin Shin, Soyoung Kang, Donghyun Kwak, Kang Min Yoo, Minjoon Seo To appear at EMNLP 2023 arXiv

Who Wrote this Code? Watermarking for Code Generation Taehyun Lee, Seokhee Hong, Jaewoo Ahn, Ilgee Hong, Hwaran Lee, Sangdoo Yun, Jamin Shin, Gunhee Kim Preprint Under Review, Corresponding Author arXiv

Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation Takyoung Kim, Jamin Shin, Young-Ho Kim, Sanghwan Bae, Sungdong Kim Preprint Under Review arXiv

Towards Zero-Shot Functional Compositionality of Language Models Hangyeol Yu, Myeongho Jeong, Jamin Shin, Hyeongdon Moon, Juneyoung Park, Seungtaek Choi Preprint, Corresponding Author arXiv

Evaluating the Knowledge Dependency of Questions Hyeongdon Moon*, Yoonseok Yang*, Jamin Shin, Hangyeol Yu, Seunghyun Lee, Myeongho Jeong, Juneyoung Park, Minsam Kim, Seungtaek Choi EMNLP 2022 (Long, Main, Corresponding Author) arXiv Code

Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking Jamin Shin*, Hangyeol Yu*, Hyeongdon Moon*, Andrea Madotto, Juneyoung Park ACL 2022 (Long, Findings) PDF arXiv Code

KLUE: Korean Language Understanding Evaluation Sungjoon Park and 30 others including Jamin Shin (3.8 Dialogue State Tracking) NeurIPS Datasets and Benchmarks Track 2021 PDF arXiv Code Site

Pedagogical Word Recommendation: A novel task and dataset on personalized vocabulary acquisition for L2 learners Jamin Shin, Juneyoung Park arXiv

Tracing Knowledge for Tracing Dropouts: Multi-Task Training for Study Session Dropout Prediction Seewoo Lee, Kyu Seok Kim, Jamin Shin, Juneyoung Park Educational Data Mining 2021 PDF

Fast End-to-end Coreference Resolution for Korean Cheoneum Park, Jamin Shin, Sungjoon Park, Joonho Lim, Changki Lee EMNLP 2020 (Findings) PDF

Generating Empathetic Responses by Looking Ahead the User's Sentiment Jamin Shin, Peng Xu, Andrea Madotto, Pascale Fung ICASSP 2020 (Oral) PDF arXiv Code Slides

CAiRE: An End-to-End Empathetic Chatbot Zhaojiang Lin, Peng Xu, Genta Indra Winata, Farhad Bin Siddique, Zihan Liu, Jamin Shin, Pascale Fung AAAI 2020 (Demo) PDF arXiv

Attention over Parameters for Dialogue Systems Andrea Madotto, Zhaojiang Lin, Chien-Sheng Wu, Jamin Shin, Pascale Fung Conversational AI Workshop @NeurIPS 2019 (Best Paper Award) PDF arXiv

MoEL: Mixture of Empathetic Listeners Zhaojiang Lin, Andrea Madotto, Jamin Shin, Peng Xu, Pascale Fung EMNLP 2019 (Oral Presentation) PDF arXiv Code

Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variables Zihan Liu, Jamin Shin, Yan Xu, Genta Indra Winata, Peng Xu, Andrea Madotto, Pascale Fung EMNLP 2019 PDF arXiv Code

Hierarchical Meta-Embeddings for Code-Switching Named Entity Recognition Genta Indra Winata, Zhaojiang Lin, Jamin Shin, Zihan Liu, Pascale Fung EMNLP 2019 PDF arXiv Code

Interpreting Word Embeddings with Eigenvector Analysis Jamin Shin, Andrea Madotto, Pascale Fung Interpretability and Robustness in Audio, Speech, and Language Workshop @NeurIPS 2018 (Oral Presentation) PDF Code

Reducing Gender Bias in Abusive Language Detection Ji Ho Park, Jamin Shin, Pascale Fung EMNLP 2018 (Oral Presentation) PDF arXiv