Get our free extension to see links to code for papers anywhere online!
Free add-on: code for papers everywhere!
Free add-on: See code for papers anywhere!
Add to Chrome
Add to Firefox
Add to Edge
CatalyzeX Icon
Search Icon
Code for
OPT: Open Pre-trained Transformer Language Models
Github Icon
facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf
Explore Code
Download Icon
Github Icon
NVIDIA/Megatron-LM/blob/main/examples/pretrain_gpt3_175B.sh
Explore Code
Download Icon