Cosmo-1B, a Phi-1.5 Reproduction Attempt
🤗 tried to reproduce the Phi-1.5 "little Large Language Model" based on the papers that Microsoft has published. They fell short on their first attempt but have published the results and are continuing to work on it. This is what they did.