3rd May 2023 - Link Blog
OpenLLaMA. The first openly licensed model I’ve seen trained on the RedPajama dataset. This initial release is a 7B model trained on 200 billion tokens, but the team behind it are promising a full 1 trillion token model in the near future. I haven’t found a live demo of this one running anywhere yet.
Recent articles
- The Pelican comparison grid for Astra is pretty interesting - 4th September 2026
- OpenAI's rogue agents were caught communicating via public wikis - 4th September 2026
- Claude's new system prompt really doesn't want to reproduce song lyrics - 2nd September 2026