soft-shell crabvietnam crab exporter

Simon Willison’s Weblog

Newsletter
Atom feed

Entries

Filters: Sorted by date

Is there an API that returns metadata for a given URL?

I suggest taking a look at http://embed.ly/—it can take a huge range of URLs and turn them in to JSON metadata. Here’s what it can do with a Wikipedia page: http://embed.ly/docs/explore/obj...—and here’s Google Maps URL (not as useful, but still some interesting metadata extracted) http://embed.ly/docs/explore/obj...

[... 69 words]

How did art.sy get a “.sy” url?

Here’s a generally useful tip: if you’re interested in learning more about ANY top level domain, visit the Wikipedia page for it—which will be http://en.wikipedia.org/wiki/.sy in this case (just add the domain, complete with its dot prefix, directly after en.wikipedia.org/wiki/ ).

[... 105 words]

Which sites have the best URL design?

GitHub’s URL design is fantastic—it’s a virtually flawless mapping of Git semantics to URL space. Their basic URL structure is excellent, but they also have a bunch of neat URL hacks going on. Here are a few of my favourites:

[... 97 words]

When referring to our web site in publications (or Twitter or Facebook), when is it important to provide the full URL—http://www.mywebsite.com and when should you provide just the mywebsite.com?

You have no control over how other publications refer to your site—if you’re lucky, they might spell it correctly and check the link works before publishing (but I wouldn’t bet on it). What you DO have control over is making sure you compensate for any mistakes they make.

[... 166 words]

How to maximize the conference experience as an attendee?

Talk to people.

[... 181 words]

Is there a site which aggregates CFPs (calls for papers/speakers) for tech conferences?

We have a crowdsourced collection of CFPs on Lanyrd: http://lanyrd.com/calls/

[... 80 words]

How to prepare for and what (gadgets) to take to Wikimania?

As general conference advice, carrying as little as possible is a very good idea. These days I take an 11 inch MacBook Air, an iPhone and an external battery for the iPhone (thus making it run out at the end of the day as opposed to half way through the afternoon). I only have the MacBook Air in case I’m on support duty and need to fix something—I’d prefer to just have the phone.

[... 150 words]

What is the best design conference in the midwest?

If you’re looking for a general UX/web design event, the An Event Apart series are excellent—they tour various American cities including Chicago from August 27-29. http://aneventapart.com/2012/chi...

[... 140 words]

Is there a feed or otherwise centralized list of calls for proposals for technical conferences?

We have a crowdsourced index of calls for proposals from (mostly technical) conferences here: http://lanyrd.com/calls/—you can also subscribe to the RSS feed for individual topics, e.g. if you want to hear about PHP conference CFPs you can subscribe to the feed linked to from this page: http://lanyrd.com/topics/php/calls/

[... 72 words]

What are some system administration best practices? If someone is running a production web server, what are the basic things they should be doing?

Graph everything. I’m not a good sysadmin, but one thing I’ve learned from working with with good sysadmins is that they spend a bunch of time looking at graphs.

[... 107 words]

What separates a CIO, CTO, and VP of engineering?

Jason Hoffman and Bryan Cantrill, CTO and VP Engineering respectively of Joyent, gave an excellent talk on exactly this subject at the Monki Gras conference in London a couple of weeks ago. Their slides plus a video of their talk are available here: http://lanyrd.com/2012/monkigras...

[... 60 words]

What is the best travelling iPhone application for a 9 day trip through Europe?

Instapaper is essential—it will let you save any web page for offline access on your iPhone which is fantastic things like Wikipedia and Wikitravel.

[... 65 words]

Who is the best conference panel moderator?

Two of the best moderators I’ve seen are Jeffrey Veen and Jeremy Keith, both of whom are regular contributors at SXSW.

[... 103 words]

Has JSON pretty much replaced XML for string processing for the web, or are there use cases where XML is still necessary?

It’s replaced XML as the default format for most APIs. XML is still necessary for Atom/RSS feeds and other existing standards built on top of XML. It’s also a better choice than JSON for markup-style data—stuff like XHTML where tags are applied to sequences of characters within larger chunks of text.

[... 81 words]

How can I sort a huge amount of numbers?

Sorting large amounts of data is one of the first exercises you’ll see described in any Hadoop or map/reduce tutorial—so I’d suggest taking a look at Hadoop.

[... 44 words]

What are the ideal laser pointers for conference presentations?

I’ll swear by the Logitech Cordless Presenter: http://www.gadgetgrid.com/2008/1...—it’s very popular amongst friends of mine who speak frequently as well.

[... 234 words]

Is Microsoft’s platform prohibitively expensive for large scale web deployment? Would licensing costs have killed Twitter/Facebook early?

I would argue that the cost of the Microsoft stack is a lot more than just the license fees.

[... 546 words]

What’s the best way to learn how to scale web applications?

Read “Building Scalable Websites” by Cal Henderson. It’s a few years old now but still very relevant—it basically covers everything he learnt the hard way scaling Flickr. It’s a really fun read, too.

[... 98 words]

What is the best advice your father ever gave you?

It’s a small thing, but the piece of advice I turn to most often is “When travelling, the only things you really need are money, your passport and the address of where you’re going”. Makes travelling a lot less stressful, since I can just think “got those three” and know that anything else I’ve forgotten doesn’t really matter that much.

[... 76 words]

Which sites do a good job of guiding first time users?

The Twitter sign up process is fascinating, and constantly evolves. I create a new Twitter account every six months or so just to see what their latest iteration looks like.

[... 157 words]

What activities, games or examples have you used to persuade developers that they are different from ’real’ users?

I doubt there’s anything as effective as getting them to watch a well-run usability test—either a video, a fancy one-way glass setup or just having them quietly observe a zero-budget testing session in a coffee shop.

[... 62 words]

Why does Facebook Comments Box only support two levels of hierarchy?

I’ve heard in the past that regular (i.e. non-geek) users often have enormous trouble understanding hierarchical comments—they don’t understand tree based file systems either.

[... 65 words]

Will I be able to make a decent eCommerce website just by learning coding from Codecademy?

I have more than ten years experience building dynamic sites, and I’d still personally much rather use a hosted service like http://www.shopify.com/ than build an eCommerce system myself.

[... 51 words]

What are the best resources for learning regular expressions?

The O’Reilly book on Regular Expressions is absolutely superb. It will help you build a much deeper understanding if how they actually work than any online tutorial I’ve seen.

[... 62 words]

Why does Twitter use a hashbang instead of using the History API?

I asked a friend who is an engineer there about this a while ago. When they shipped the first version of Twitter that used fully Ajax driven pages there was a critical bug with pushState in a widely deployed version of Safari, which made it impractical to commit to.

[... 67 words]

What web programming framework best supports ’drag and drop’ actions?  Please give examples of sites and/or plug-ins that support the interaction.

Drag and drop is a client-side thing—it has nothing to do with the server-side technology being used.

[... 72 words]

Why did Twitter have so many problems if it is made with Ruby?

The technical problem Twitter solves (distributing millions of short messages per minute to an enormous graph of follow relationships) is extremely hard in any language.

[... 44 words]

Is it reasonably safe to visit Ethiopia and then to fly from Ethiopia back home via Cairo?

If you’re specifically interested in the Cairo leg then yes, it’s safe. Cairo is a modern city if over 20 million people. Tourism is Egypt’s most important industry and they are very, very good at protecting that cash cow even during times of political turmoil. If you pay attention to the news and don’t go actively looking for street riots to get involved with you’ll be fine.

[... 90 words]

What is the best way to allow  users to add videos on a website ?

Encourage them to host their videos on YouTube, Vimeo etc and give you the URL, then generate an embed code on your site (using your own code or with the http://embed.ly/ API).

[... 71 words]

System Administration: What service/product do you recommend for central logging of events and errors from multiple servers? Why?

We rolled our own solution to this using MongoDB, due to its super-fast writes and ability to store, index and search JSON. We were also attracted by its capped collections, which make it easy to e.g. only log the last 100,000 items.

[... 113 words]