Alert button
Picture for Hyungjun Kim

Hyungjun Kim

Alert button

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Feb 15, 2024
Taesu Kim, Jongho Lee, Daehyun Ahn, Sarang Kim, Jiwoong Choi, Minkyu Kim, Hyungjun Kim

Viaarxiv icon

SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks

Feb 14, 2024
Jiwon Song, Kyungseok Oh, Taesu Kim, Hyungjun Kim, Yulhwa Kim, Jae-Joon Kim

Viaarxiv icon

Squeezing Large-Scale Diffusion Models for Mobile

Jul 03, 2023
Jiwoong Choi, Minkyu Kim, Daehyun Ahn, Taesu Kim, Yulhwa Kim, Dongwon Jo, Hyesung Jeon, Jae-Joon Kim, Hyungjun Kim

Figure 1 for Squeezing Large-Scale Diffusion Models for Mobile
Figure 2 for Squeezing Large-Scale Diffusion Models for Mobile
Figure 3 for Squeezing Large-Scale Diffusion Models for Mobile
Figure 4 for Squeezing Large-Scale Diffusion Models for Mobile
Viaarxiv icon

OWQ: Lessons learned from activation outliers for weight quantization in large language models

Jun 13, 2023
Changhun Lee, Jungyu Jin, Taesu Kim, Hyungjun Kim, Eunhyeok Park

Figure 1 for OWQ: Lessons learned from activation outliers for weight quantization in large language models
Figure 2 for OWQ: Lessons learned from activation outliers for weight quantization in large language models
Figure 3 for OWQ: Lessons learned from activation outliers for weight quantization in large language models
Figure 4 for OWQ: Lessons learned from activation outliers for weight quantization in large language models
Viaarxiv icon

Temporal Dynamic Quantization for Diffusion Models

Jun 04, 2023
Junhyuk So, Jungwon Lee, Daehyun Ahn, Hyungjun Kim, Eunhyeok Park

Figure 1 for Temporal Dynamic Quantization for Diffusion Models
Figure 2 for Temporal Dynamic Quantization for Diffusion Models
Figure 3 for Temporal Dynamic Quantization for Diffusion Models
Figure 4 for Temporal Dynamic Quantization for Diffusion Models
Viaarxiv icon

INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold

Apr 18, 2022
Changhun Lee, Hyungjun Kim, Eunhyeok Park, Jae-Joon Kim

Figure 1 for INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold
Figure 2 for INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold
Figure 3 for INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold
Figure 4 for INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold
Viaarxiv icon

Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution

Dec 02, 2020
Hyungjun Kim, Jihoon Park, Changhun Lee, Jae-Joon Kim

Figure 1 for Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution
Figure 2 for Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution
Figure 3 for Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution
Figure 4 for Improving Accuracy of Binary Neural Networks using Unbalanced Activation Distribution
Viaarxiv icon

Empirical Strategy for Stretching Probability Distribution in Neural-network-based Regression

Sep 08, 2020
Eunho Koo, Hyungjun Kim

Figure 1 for Empirical Strategy for Stretching Probability Distribution in Neural-network-based Regression
Figure 2 for Empirical Strategy for Stretching Probability Distribution in Neural-network-based Regression
Figure 3 for Empirical Strategy for Stretching Probability Distribution in Neural-network-based Regression
Figure 4 for Empirical Strategy for Stretching Probability Distribution in Neural-network-based Regression
Viaarxiv icon

BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations

Feb 16, 2020
Hyungjun Kim, Kyungsu Kim, Jinseok Kim, Jae-Joon Kim

Figure 1 for BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations
Figure 2 for BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations
Figure 3 for BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations
Figure 4 for BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary Activations
Viaarxiv icon