Command R+ now ranked 6th on the LMSYS Chatbot Arena

2024-04-09T16:19:09+00:00

Command R+ now ranked 6th on the LMSYS Chatbot Arena

The LMSYS Chatbot Arena Leaderboard is one of the most interesting approaches to evaluating LLMs because it captures their ever-elusive “vibes”—it works by users voting on the best responses to prompts from two initially hidden models

Big news today is that Command R+—the brand new open weights model (Creative Commons non-commercial) by Cohere—is now the highest ranked non-proprietary model, in at position six and beating one of the GPT-4s.

(Linking to my screenshot on Mastodon.)

Tags: ai, generative-ai, llms, cohere, command-r, chatbot-arena

llm-command-r

2024-04-04T17:38:42+00:00

llm-command-r

Cohere released Command R Plus today—an open weights (non commercial/research only) 104 billion parameter LLM, a big step up from their previous 35 billion Command R model.

Both models are fine-tuned for both tool use and RAG. The commercial API has features to expose this functionality, including a web-search connector which lets the model run web searches as part of answering the prompt and return documents and citations as part of the JSON response.

I released a new plugin for my LLM command line tool this morning adding support for the Command R models.

In addition to the two models it also adds a custom command for running prompts with web search enabled and listing the referenced documents.

Tags: plugins, projects, ai, generative-ai, llms, llm, cohere, command-r, rag, llm-tool-use, llm-release

Simon Willison's Weblog: command-r

Command R+ now ranked 6th on the LMSYS Chatbot Arena

llm-command-r