Alert button
Picture for Hanie Sedghi

Hanie Sedghi

Alert button

Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models

Dec 22, 2023
Avi Singh, John D. Co-Reyes, Rishabh Agarwal, Ankesh Anand, Piyush Patil, Xavier Garcia, Peter J. Liu, James Harrison, Jaehoon Lee, Kelvin Xu, Aaron Parisi, Abhishek Kumar, Alex Alemi, Alex Rizkowsky, Azade Nova, Ben Adlam, Bernd Bohnet, Gamaleldin Elsayed, Hanie Sedghi, Igor Mordatch, Isabelle Simpson, Izzeddin Gur, Jasper Snoek, Jeffrey Pennington, Jiri Hron, Kathleen Kenealy, Kevin Swersky, Kshiteej Mahajan, Laura Culp, Lechao Xiao, Maxwell L. Bileschi, Noah Constant, Roman Novak, Rosanne Liu, Tris Warkentin, Yundi Qian, Yamini Bansal, Ethan Dyer, Behnam Neyshabur, Jascha Sohl-Dickstein, Noah Fiedel

Figure 1 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Figure 2 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Figure 3 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Figure 4 for Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Viaarxiv icon

Frontier Language Models are not Robust to Adversarial Arithmetic, or "What do I need to say so you agree 2+2=5?

Nov 15, 2023
C. Daniel Freeman, Laura Culp, Aaron Parisi, Maxwell L Bileschi, Gamaleldin F Elsayed, Alex Rizkowsky, Isabelle Simpson, Alex Alemi, Azade Nova, Ben Adlam, Bernd Bohnet, Gaurav Mishra, Hanie Sedghi, Igor Mordatch, Izzeddin Gur, Jaehoon Lee, JD Co-Reyes, Jeffrey Pennington, Kelvin Xu, Kevin Swersky, Kshiteej Mahajan, Lechao Xiao, Rosanne Liu, Simon Kornblith, Noah Constant, Peter J. Liu, Roman Novak, Yundi Qian, Noah Fiedel, Jascha Sohl-Dickstein

Viaarxiv icon

Can Neural Network Memorization Be Localized?

Jul 18, 2023
Pratyush Maini, Michael C. Mozer, Hanie Sedghi, Zachary C. Lipton, J. Zico Kolter, Chiyuan Zhang

Figure 1 for Can Neural Network Memorization Be Localized?
Figure 2 for Can Neural Network Memorization Be Localized?
Figure 3 for Can Neural Network Memorization Be Localized?
Figure 4 for Can Neural Network Memorization Be Localized?
Viaarxiv icon

The Role of Pre-training Data in Transfer Learning

Mar 01, 2023
Rahim Entezari, Mitchell Wortsman, Olga Saukh, M. Moein Shariatnia, Hanie Sedghi, Ludwig Schmidt

Figure 1 for The Role of Pre-training Data in Transfer Learning
Figure 2 for The Role of Pre-training Data in Transfer Learning
Figure 3 for The Role of Pre-training Data in Transfer Learning
Figure 4 for The Role of Pre-training Data in Transfer Learning
Viaarxiv icon

Leveraging Unlabeled Data to Track Memorization

Dec 08, 2022
Mahsa Forouzesh, Hanie Sedghi, Patrick Thiran

Figure 1 for Leveraging Unlabeled Data to Track Memorization
Figure 2 for Leveraging Unlabeled Data to Track Memorization
Figure 3 for Leveraging Unlabeled Data to Track Memorization
Figure 4 for Leveraging Unlabeled Data to Track Memorization
Viaarxiv icon

Layer-Stack Temperature Scaling

Nov 18, 2022
Amr Khalifa, Michael C. Mozer, Hanie Sedghi, Behnam Neyshabur, Ibrahim Alabdulmohsin

Figure 1 for Layer-Stack Temperature Scaling
Figure 2 for Layer-Stack Temperature Scaling
Figure 3 for Layer-Stack Temperature Scaling
Figure 4 for Layer-Stack Temperature Scaling
Viaarxiv icon

REPAIR: REnormalizing Permuted Activations for Interpolation Repair

Nov 15, 2022
Keller Jordan, Hanie Sedghi, Olga Saukh, Rahim Entezari, Behnam Neyshabur

Figure 1 for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
Figure 2 for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
Figure 3 for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
Figure 4 for REPAIR: REnormalizing Permuted Activations for Interpolation Repair
Viaarxiv icon

Teaching Algorithmic Reasoning via In-context Learning

Nov 15, 2022
Hattie Zhou, Azade Nova, Hugo Larochelle, Aaron Courville, Behnam Neyshabur, Hanie Sedghi

Figure 1 for Teaching Algorithmic Reasoning via In-context Learning
Figure 2 for Teaching Algorithmic Reasoning via In-context Learning
Figure 3 for Teaching Algorithmic Reasoning via In-context Learning
Figure 4 for Teaching Algorithmic Reasoning via In-context Learning
Viaarxiv icon

Understanding the effect of sparsity on neural networks robustness

Jun 22, 2022
Lukas Timpl, Rahim Entezari, Hanie Sedghi, Behnam Neyshabur, Olga Saukh

Figure 1 for Understanding the effect of sparsity on neural networks robustness
Figure 2 for Understanding the effect of sparsity on neural networks robustness
Figure 3 for Understanding the effect of sparsity on neural networks robustness
Figure 4 for Understanding the effect of sparsity on neural networks robustness
Viaarxiv icon

Leveraging Unlabeled Data to Predict Out-of-Distribution Performance

Feb 09, 2022
Saurabh Garg, Sivaraman Balakrishnan, Zachary C. Lipton, Behnam Neyshabur, Hanie Sedghi

Figure 1 for Leveraging Unlabeled Data to Predict Out-of-Distribution Performance
Figure 2 for Leveraging Unlabeled Data to Predict Out-of-Distribution Performance
Figure 3 for Leveraging Unlabeled Data to Predict Out-of-Distribution Performance
Figure 4 for Leveraging Unlabeled Data to Predict Out-of-Distribution Performance
Viaarxiv icon