The authors of A Mixture of $h-1$ Heads is Better than $h$ Heads have not publicly listed the code yet.

Request code directly from the authors:   Ask Authors for Code

Get an expert to implement this paper:   Request Implementation



(OR if you have code to share with the community, please submit it here ✉️😊🙏)