soft-shell crab vietnam crab exporter

Simon Willison’s Weblog

23rd June 2020

Release datasette-block-robots 0.1 — Datasette plugin that blocks robots and crawlers using robots.txt

Posted 23rd June 2020 at 2:53 am

Recent articles

Datasette Agent - 21st May 2026
Gemini 3.5 Flash: more expensive, but Google plan to use it for everything - 19th May 2026
The last six months in LLMs in five minutes - 19th May 2026

This is a beat by Simon Willison, posted on 23rd June 2020.

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe