Alert button
Picture for Lei Hou

Lei Hou

Alert button

KoLA: Carefully Benchmarking World Knowledge of Large Language Models

Jun 15, 2023
Jifan Yu, Xiaozhi Wang, Shangqing Tu, Shulin Cao, Daniel Zhang-Li, Xin Lv, Hao Peng, Zijun Yao, Xiaohan Zhang, Hanming Li, Chunyang Li, Zheyuan Zhang, Yushi Bai, Yantao Liu, Amy Xin, Nianyi Lin, Kaifeng Yun, Linlu Gong, Jianhui Chen, Zhili Wu, Yunjia Qi, Weikai Li, Yong Guan, Kaisheng Zeng, Ji Qi, Hailong Jin, Jinxin Liu, Yu Gu, Yuan Yao, Ning Ding, Lei Hou, Zhiyuan Liu, Bin Xu, Jie Tang, Juanzi Li

Figure 1 for KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Figure 2 for KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Figure 3 for KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Figure 4 for KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Viaarxiv icon

The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation

Jun 15, 2023
Hao Peng, Xiaozhi Wang, Feng Yao, Kaisheng Zeng, Lei Hou, Juanzi Li, Zhiyuan Liu, Weixing Shen

Figure 1 for The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
Figure 2 for The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
Figure 3 for The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
Figure 4 for The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation
Viaarxiv icon

Benchmarking Foundation Models with Language-Model-as-an-Examiner

Jun 07, 2023
Yushi Bai, Jiahao Ying, Yixin Cao, Xin Lv, Yuze He, Xiaozhi Wang, Jifan Yu, Kaisheng Zeng, Yijia Xiao, Haozhe Lyu, Jiayin Zhang, Juanzi Li, Lei Hou

Figure 1 for Benchmarking Foundation Models with Language-Model-as-an-Examiner
Figure 2 for Benchmarking Foundation Models with Language-Model-as-an-Examiner
Figure 3 for Benchmarking Foundation Models with Language-Model-as-an-Examiner
Figure 4 for Benchmarking Foundation Models with Language-Model-as-an-Examiner
Viaarxiv icon

Learn to Not Link: Exploring NIL Prediction in Entity Linking

May 25, 2023
Fangwei Zhu, Jifan Yu, Hailong Jin, Juanzi Li, Lei Hou, Zhifang Sui

Figure 1 for Learn to Not Link: Exploring NIL Prediction in Entity Linking
Figure 2 for Learn to Not Link: Exploring NIL Prediction in Entity Linking
Figure 3 for Learn to Not Link: Exploring NIL Prediction in Entity Linking
Figure 4 for Learn to Not Link: Exploring NIL Prediction in Entity Linking
Viaarxiv icon

Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering

May 24, 2023
Jiajie Zhang, Shulin Cao, Tingjia Zhang, Xin Lv, Jiaxin Shi, Qi Tian, Juanzi Li, Lei Hou

Figure 1 for Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering
Figure 2 for Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering
Figure 3 for Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering
Figure 4 for Reasoning over Hierarchical Question Decomposition Tree for Explainable Question Answering
Viaarxiv icon

ChatLog: Recording and Analyzing ChatGPT Across Time

Apr 27, 2023
Shangqing Tu, Chunyang Li, Jifan Yu, Xiaozhi Wang, Lei Hou, Juanzi Li

Figure 1 for ChatLog: Recording and Analyzing ChatGPT Across Time
Figure 2 for ChatLog: Recording and Analyzing ChatGPT Across Time
Figure 3 for ChatLog: Recording and Analyzing ChatGPT Across Time
Figure 4 for ChatLog: Recording and Analyzing ChatGPT Across Time
Viaarxiv icon

MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs

Apr 05, 2023
Jifan Yu, Mengying Lu, Qingyang Zhong, Zijun Yao, Shangqing Tu, Zhengshan Liao, Xiaoya Li, Manli Li, Lei Hou, Hai-Tao Zheng, Juanzi Li, Jie Tang

Figure 1 for MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs
Figure 2 for MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs
Figure 3 for MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs
Figure 4 for MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs
Viaarxiv icon

GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation

Mar 26, 2023
Ji Qi, Jifan Yu, Teng Tu, Kunyu Gao, Yifan Xu, Xinyu Guan, Xiaozhi Wang, Yuxiao Dong, Bin Xu, Lei Hou, Juanzi Li, Jie Tang, Weidong Guo, Hui Liu, Yu Xu

Figure 1 for GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation
Figure 2 for GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation
Figure 3 for GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation
Figure 4 for GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation
Viaarxiv icon

Syntactically Robust Training on Partially-Observed Data for Open Information Extraction

Jan 17, 2023
Ji Qi, Yuxiang Chen, Lei Hou, Juanzi Li, Bin Xu

Figure 1 for Syntactically Robust Training on Partially-Observed Data for Open Information Extraction
Figure 2 for Syntactically Robust Training on Partially-Observed Data for Open Information Extraction
Figure 3 for Syntactically Robust Training on Partially-Observed Data for Open Information Extraction
Figure 4 for Syntactically Robust Training on Partially-Observed Data for Open Information Extraction
Viaarxiv icon

Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization

Dec 21, 2022
Yushi Bai, Xin Lv, Juanzi Li, Lei Hou

Figure 1 for Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization
Figure 2 for Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization
Figure 3 for Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization
Figure 4 for Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization
Viaarxiv icon