Alert button
Picture for Hayeon Lee

Hayeon Lee

Alert button

Diffusion-based Neural Network Weights Generation

Add code
Bookmark button
Alert button
Feb 28, 2024
Bedionita Soro, Bruno Andreis, Hayeon Lee, Song Chong, Frank Hutter, Sung Ju Hwang

Viaarxiv icon

Co-training and Co-distillation for Quality Improvement and Compression of Language Models

Add code
Bookmark button
Alert button
Nov 07, 2023
Hayeon Lee, Rui Hou, Jongpil Kim, Davis Liang, Hongbo Zhang, Sung Ju Hwang, Alexander Min

Viaarxiv icon

A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models

Add code
Bookmark button
Alert button
May 26, 2023
Hayeon Lee, Rui Hou, Jongpil Kim, Davis Liang, Sung Ju Hwang, Alexander Min

Figure 1 for A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
Figure 2 for A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
Figure 3 for A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
Figure 4 for A Study on Knowledge Distillation from Weak Teacher for Scaling Up Pre-trained Language Models
Viaarxiv icon

DiffusionNAG: Task-guided Neural Architecture Generation with Diffusion Models

Add code
Bookmark button
Alert button
May 26, 2023
Sohyun An, Hayeon Lee, Jaehyeong Jo, Seanie Lee, Sung Ju Hwang

Figure 1 for DiffusionNAG: Task-guided Neural Architecture Generation with Diffusion Models
Figure 2 for DiffusionNAG: Task-guided Neural Architecture Generation with Diffusion Models
Figure 3 for DiffusionNAG: Task-guided Neural Architecture Generation with Diffusion Models
Figure 4 for DiffusionNAG: Task-guided Neural Architecture Generation with Diffusion Models
Viaarxiv icon

Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets

Add code
Bookmark button
Alert button
May 26, 2023
Hayeon Lee, Sohyun An, Minseon Kim, Sung Ju Hwang

Figure 1 for Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
Figure 2 for Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
Figure 3 for Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
Figure 4 for Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
Viaarxiv icon

SuperNet in Neural Architecture Search: A Taxonomic Survey

Add code
Bookmark button
Alert button
Apr 08, 2022
Stephen Cha, Taehyeon Kim, Hayeon Lee, Se-Young Yun

Figure 1 for SuperNet in Neural Architecture Search: A Taxonomic Survey
Figure 2 for SuperNet in Neural Architecture Search: A Taxonomic Survey
Figure 3 for SuperNet in Neural Architecture Search: A Taxonomic Survey
Figure 4 for SuperNet in Neural Architecture Search: A Taxonomic Survey
Viaarxiv icon

Online Hyperparameter Meta-Learning with Hypergradient Distillation

Add code
Bookmark button
Alert button
Oct 06, 2021
Hae Beom Lee, Hayeon Lee, Jaewoong Shin, Eunho Yang, Timothy Hospedales, Sung Ju Hwang

Figure 1 for Online Hyperparameter Meta-Learning with Hypergradient Distillation
Figure 2 for Online Hyperparameter Meta-Learning with Hypergradient Distillation
Figure 3 for Online Hyperparameter Meta-Learning with Hypergradient Distillation
Figure 4 for Online Hyperparameter Meta-Learning with Hypergradient Distillation
Viaarxiv icon

Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets

Add code
Bookmark button
Alert button
Jul 02, 2021
Hayeon Lee, Eunyoung Hyung, Sung Ju Hwang

Figure 1 for Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets
Figure 2 for Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets
Figure 3 for Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets
Figure 4 for Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets
Viaarxiv icon

HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning

Add code
Bookmark button
Alert button
Jun 16, 2021
Hayeon Lee, Sewoong Lee, Song Chong, Sung Ju Hwang

Figure 1 for HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning
Figure 2 for HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning
Figure 3 for HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning
Figure 4 for HELP: Hardware-Adaptive Efficient Latency Predictor for NAS via Meta-Learning
Viaarxiv icon

Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning

Add code
Bookmark button
Alert button
Mar 02, 2021
Wonyong Jeong, Hayeon Lee, Gun Park, Eunyoung Hyung, Jinheon Baek, Sung Ju Hwang

Figure 1 for Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning
Figure 2 for Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning
Figure 3 for Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning
Figure 4 for Task-Adaptive Neural Network Retrieval with Meta-Contrastive Learning
Viaarxiv icon