Simon Willison's Weblog: io

ZeroMQ: Modern and Fast Networking Stack

2010-09-05T19:41:00+00:00

ZeroMQ: Modern and Fast Networking Stack

I get ZeroMQ now. I was having trouble figuring out how it differed from things like RabbitMQ—it turns out it’s an entirely new low-level socket abstraction, designed to make common socket programming tasks like message sending/receiving and publish/subscribe a whole lot easier than dealing with raw BSD sockets.

Tags: io, messaging, networking, sockets, zeromq, recovered

Understanding node.js

2010-05-18T18:44:00+00:00

Understanding node.js

A king providing orders to his army of servants is a much better analogy than my hyperactive squid.

Tags: async, eventio, io, javascript, nodejs, recovered

Reexamining Python 3 Text I/O

2010-01-28T13:28:07+00:00

Reexamining Python 3 Text I/O

Python 3.1’s IO performance is a huge improvement over 3.0, but still considerably slower than 2.6. It turns out it’s all to do with Python 3’s unicode support: When you read a file in to a string, you’re asking Python to decode the bytes in to UTF-8 (the new default encoding) at the same time. If you open the file in binary mode Python 3 will read raw bytes in to a bytestring instead, avoiding the conversion overhead and performing only 4% slower than the equivalent code in Python 2.6.4.

Tags: david-beazley, io, performance, python, python3, text, unicode

node.js

2009-11-09T23:25:47+00:00

node.js

“Evented I/O for V8 JavaScript”—a JavaScript environment built on top of the super-fast V8 engine which provides event-based IO functionality for building highly concurrent TCP and HTTP servers. The API design is superb—everything is achieved using JavaScript events and callbacks (even regular file IO) and the small standard library ships with comprehensive support for HTTP and DNS. Overall it’s very similar to Twisted and friends, but JavaScript’s anonymous function syntax feels more natural than the Python equivalent. It compiles cleanly on Snow Leopard. Definitely a project to watch.

Tags: dns, eventbasedio, http, io, javascript, nodejs, twisted, v8

Offline Processing on App Engine: a Look Ahead

2009-05-20T12:40:12+00:00

Offline Processing on App Engine: a Look Ahead

A session at IO next week: “App Engine was designed to run request-driven web applications, although this will change in the coming year with the release of a number of offline computing components. In this session, we’ll explore the task queue/executor model of computation and some of the more interesting applications.”

Tags: google, google-app-engine, io, message-queues, offlineprocessing, workers

Eventlet - Second Life Wiki

2007-11-26T15:21:02+00:00

Eventlet - Second Life Wiki

Seriously powerful non-blocking IO library for Python, currently maintained by Linden Lab as part of the server architecture used for Second Life.

Tags: eventlet, io, lindenlab, python, secondlife

skipdb

2007-02-04T13:09:59+00:00

skipdb

Small, fast BerkeleyDB style database using skip lists, by the creator of the Io programming language.

Via programming.reddit.com

Tags: berkeleydb, io, skipdb, skiplists, steve-dekorte