http://simonwillison.net/2023-08-24T22:31:57+00:00Simon Willison2023-08-24T22:31:57+00:002023-08-24T22:31:57+00:00https://simonwillison.net/2023/Aug/24/airoboros-lmoe/#atom-tag

<p><strong><a href="https://github.com/jondurbin/airoboros#lmoe">airoboros LMoE</a></strong></p> airoboros provides a system for fine-tuning Large Language Models. The latest release adds support for LMoE—LoRA Mixture of Experts. GPT-4 is strongly rumoured to work as a mixture of experts—several (maybe 8?) 220B models each with a different specialty working together to produce the best result. This is the first open source (Apache 2) implementation of that pattern that I’ve seen. <p>Tags: <a href="https://simonwillison.net/tags/opensearch">opensearch</a>, <a href="https://simonwillison.net/tags/ai">ai</a>, <a href="https://simonwillison.net/tags/generative-ai">generative-ai</a>, <a href="https://simonwillison.net/tags/gpt-4">gpt-4</a>, <a href="https://simonwillison.net/tags/llms">llms</a>, <a href="https://simonwillison.net/tags/fine-tuning">fine-tuning</a></p>

2023-02-17T18:45:33+00:002023-02-17T18:45:33+00:00https://simonwillison.net/2023/Feb/17/replacing-mapbox/#atom-tag

<p><strong><a href="https://www.kschaul.com/post/2023/02/16/how-the-post-is-replacing-mapbox-with-open-source-solutions/">How The Post is replacing Mapbox with open source solutions</a></strong></p> Kevin Schaul describes the Washington Post’s emerging open source GIS stack: OpenMapTiles, Maputnik, PMTiles and Maplibre-gl-js. <p><small></small>Via <a href="https://news.ycombinator.com/item?id=34836700">Hacker News</a></small></p> <p>Tags: <a href="https://simonwillison.net/tags/maps">maps</a>, <a href="https://simonwillison.net/tags/opensearch">opensearch</a>, <a href="https://simonwillison.net/tags/openstreetmap">openstreetmap</a>, <a href="https://simonwillison.net/tags/washington-post">washington-post</a></p>

2007-02-09T00:52:43+00:002007-02-09T00:52:43+00:00https://simonwillison.net/2007/Feb/9/opensearch/#atom-tag

<p><strong><a href="http://blog.unto.net/opensearch/add-opensearch-to-your-site-in-five-minutes/">Add OpenSearch to your site in five minutes</a></strong></p> OpenSearch is easy. DeWitt demonstrates how you don’t even need a site search engine to implement it if you take advantage of Google’s site: operator. <p>Tags: <a href="https://simonwillison.net/tags/dewitt-clinton">dewitt-clinton</a>, <a href="https://simonwillison.net/tags/google">google</a>, <a href="https://simonwillison.net/tags/opensearch">opensearch</a></p>