General

The next Amazon web services

Jeff Bezos took the stage here at Web 2.0 Expo yesterday, followed by a conversation with Tim O’Reilly.

Bezos was talking about the current state and future vision for Amazon Web Services. He said that basically Amazon wants to give web applications developers of the world the tools they need to be able to leave the server operations part of their business to Amazon, and focus on the development and building of their business – adding that over the course of 13 years Amazon had gotten “quite good at it”. Knowing by heart how all involving this part of operations can get as soon as an application sees significant traffic I buy into this easily.

Bezos refrained from answering many of O’Reilly’s questions. One of them about what new web services Amazon had coming. It’s an interesting question – and I immediately started guessing.

Let’s first see what they have in the field:

  • Simple Queue Service (SQS): A highly scalable message queue.
  • Mechanical Turk: A way to integrate humans into your applications. (I bet Bezos read this blog post when coming up with it :))
  • Simple Storage Service (S3): A massive file storage service.
  • Elastic Compute Cloud (EC2): Servers on demand, rented by the computing hour.

Additionally they have several E-commerce services related to their retail business and Amazon’s Alexa also has some web services available, but these services are really a part of another business strategy.

So, looking at the above, I can immediately guess a few likely upcoming services:

  • Database Service: A web service wrapping the operations of large scale databases into a simple API, hiding all the complexities of clustering, redundancy, replication and backup from the blissfully ignorant developers. Could be interesting to see this as a RDF datastore, but that’s probably premature or at least something to include in a separate service for the time being.
  • Authentication and payment services: It’s something that Amazon is really good at, it makes perfect sense to give the rest of us access for a fee. This could potentially take a serious stab at PayPal. Note to Bezos: Use OpenID.
  • Web application framework: Wrapping EC2 in at a higher level would make sense. With the current solution, deciding when to spawn new servers and so on is still left to the developer. An application framework could relief this burden and once again let the developer focus solely on the application itself.

Anyone out there have further ideas?

The world needs more people like him

This is a video of a presentation by Hans Rosling of Gapminder, the Swedish data visualisation organization that Google recently bought.

Rosling has a great vision: To make the world a better place by improving access to and presentation of data about the world, such as statistics about poor countries.

He makes the point very well in the presentation – which in turn is actually funny as hell and at times as exciting as a good sports broadcast – just a lot more important.

When you next think about sitting down to watch a brain-numbing sitcom, watch this instead. It’ll make you feel better.

Who will kill Google?

Paul Graham wrote an interesting piece a few days ago about the “death of Microsoft”. Not death in the sense that Nietzsche proclaimed to God, but in the sense Microsoft “killed” IBM. IBM remained (and remains) a strong company through the Microsoft era, but they were no longer ruling the IT industry. The same is true of Microsoft now, but Google holds the throne.

This begs the question: Who will kill Google?

As that question is probably impossible to answer, an easier version is: What will kill Google?

We can say that each of the three previous kings represents an era in IT:

  • IBM: The mainframe era
  • Microsoft: The desktop era
  • Google: The web era

What is the next era? Will it have to do with the semantic web, i.e. “The data era”? Will it have to do with P2P, i.e. “The distributed computing era”? Or maybe the exact opposite – characterized by massive central data storage and computing, i.e. “The massive data center era”?

What other candidates are out there? And who is likely to grab the throne in each scenario?

Trends that shape the future Internet

I’m working on a document as a part of a study by Eurescom on the Future Internet – the Operator’s vision. Our part is on the applications of the future internet and as a starting point we’re identifying several trends that are likely to shape this future. We’re looking 10-15 years ahead in the study so it’s perfectly OK to be a little on the wild side.

All and any feedback on the list below is much welcomed:

  • Mobile and nomadic: Laptops and mobile handsets will be connected to the Internet when- and wherever. Bandwidth to mobile devices will continue to increase and as capabilities of mobile handsets improve, mobile usage of online services and applications will become mainstream. Better batteries (see below) will further limit the need for any sort of cabling or otherwise location dependent work. Twisted pair cables will gradually disappear from the office space.
  • Data storage increasingly on the Net: As users get used to working with their documents and data across many different devices, and “always-on” connections become a trusted reality, data and document storage will move largely online. Applications will more and more make use of this fact. Large attachments in email messages will disappear and be replaced with references to online documents. This trend can already be seen as Friday emails point to videos on YouTube instead of including them as attachments. Online storage has many benefits, such as safer backup procedures and simplified collaboration work.
  • Web interfaces for most applications: The rise of alternative operating systems, such as Linux and Mac OS, coupled with increasing usage from mobile devices, leaves the browser, or – more accurately – Web standards as the common ground to write cross platform applications. These standards will increasingly allow rich user interfaces, in line with the rise of AJAX-based web applications in the last 2-3 years. Current office-suite-like applications, such as Google Docs, database apps like DabbleDB and Swivel and photo editing applications like Phixr, provide a glimpse of what is to come. Consequently, the importance of operating systems declines.
  • Net connection as ubiquitous as electricity: “Always on, anywhere, without caring how.” Users’ devices will be connected to the Net anywhere. Moving from one access technology to another will be invisible to the user. No need to think about GSM1800 vs. WiFi vs. UMTS vs. HSDPA vs. EDGE or WiMAX. Devices will support multiple technologies and Software Defined Radio (SDR) will eventually make the same hardware adapt to pretty much any radio transmitted standard we’ll come up with. Wired connections will still connect homes and businesses, but not the actual end-user devices.
  • Revolution in battery lifetime: Whether solved with fuel cells, new chemical battery technologies or some radically new approach, the economic incentive is simply to great for this problem not to be solved. To some extent, the need for power on the devices themselves will not grow as fast as before as more and more of the computation and data handling moves online. Regardless, the battery lifetime of a handheld device will be measured in weeks and the battery lifetime of laptops (or their future equivalents) in days, instead of days and hours respectively.
  • Overall need for computing power continues to rise: Rising electricity prices, ever more need for computing power and environmental issues – such as carbon emissions are already a big concern for data center operations. Regardless if computation moves increasingly to central hubs such as data centers, or will be more distributed by means of peer-to-peer storage and computation, the total electricity demands are rising rapidly. Radically more efficient computers and data center operations are needed to prevent this from becoming a major hurdle to future application possibilities.
  • Ownership of bits, instead of atoms becomes more acceptable: Today’s common perception that in order to “own” something, a physical object is needed, will fade. User’s will have the feeling of “ownership” of movies, music and books as long as they “own” the right to access and use them on any medium at will. The convenience of a fully controlled digital copy of the content will actually make users feel a higher degree of ownership than with today’s – often artifical – limitations of DVDs, CDs and DRM-ed digital content.
  • Usability will dramatically improve: User centric products will kill technology centric ones. As more attention is given to user centric design, user’s will feel more in control and mainstream adoption will finally happen for technologies that may even have been around for decades already. Intuitive, simple user interfaces and innovative new ways to interact with technology (such as multi touch displays, eye-tracking and voice recognition) will make technology feel warmer and more intelligent – and thereby much more widely and easily adopted.
  • Machine to machine communications: The number of devices connected to the Internet will continue to rise. More and more sensors and other small, automated devices will use the Net to share data and access online services that make use of this data and tell the devices what to do. Software will also increasingly interact with other software via the Net, accessing data, synchronizing efforts and fighting for resources.
  • More devices for the “same” tasks: Convergence will happen. We already see our mobile phones acting as our instant camera, our alarm clock, wristwatch, portable music players and what not. The contradictory side-effect is that users will own ever more devices capable of the seemingly same tasks. The phone camera may be good for casual photos, but an SLR is needed for the safari or the family photos. The Walkman phone may be good for playing music while at the gym, but when you’re home you prefer to use the home media center (plus you want to keep the actual phone handy). The Blackberry may be great for email, but it’s less than great as a phone and is far from being a fashion item. Even highly convergant devices like the iPhone won’t change this. As data is more easily shared across devices, people will pick the handset to go with the shoes and the occasion – notice recent developments with Prada and Dolce & Gabbana co-branding recently launched devices.

Visited Countries – Revisited

When I read Bill Bryson’s fantastic book “A Short History of Nearly Everything“, one of the things that stood out, was a reminder that the world is still a really big place.

Even though we feel that we can – with a credit card, and a solid visa – get pretty much anywhere in the world within 72 hours, the world is still HUGE on the ground level. There are large areas where – to our best knowledge – no man has ever set foot; it still takes days or even weeks of trekking to get to much of Earth’s surface; and humans are still to explore even 1% of world’s oceans.

This made me think of Douwe‘s Visited Countries project. You surely know this one – everybody and their grandma’s have been posting these maps on their blogs in the last 3 years, coloring the countries they’ve been to. But that’s not really fair – is it? I’ve been to Hong Kong, so I color China. I’ve been to a dozen cities or so in the US, that gives me half a continent. Looking at the colored map, it really feels like I’ve pretty much covered it – only some minor continents to go :).

Well, think again!

Above is a typical Visited Countries map of the countries I’ve visited. But look closer to see where I’ve REALLY been. The yellow dots are (roughly) the dots I’ve set foot in. I’m even pretty generous, I colored dots that I’ve only zoomed through in a train or on the motorway, (but skipped those I’ve seen out the plane window). And each dot is actually huge. Roughly estimated, a single dot on this map is about 3,000 square kilometers on average!

It now looks like I’ve still got some planes to catch!

P.S. I wonder if anyone will come up with a tool to make this type of map, as easily as Douwe’s original?

The tipping point of long tail services

I couldn’t resist the title…

Just a quick observation that I haven’t seen in the book or any of the online literature on the subject of The Long Tail.

The moment that changed the way I use YouTube was the moment I started to assume that any video I might be looking for would be there. Before, YouTube was just a collection of random, interesting and funny clips and subject of a lot of Friday emails. Now, YouTube is where I go when I want to see videos of events that I missed on the news, or never made it to the mainstream – and I usually find them. And as a result I go there a lot more.

The same is true of all the other typical Long Tail services: Amazon, Netflix, Ebay, … When the offering – in the mind of the consumer – changes from “random things” to “everything”, that’s when they get their mojo.

I come from a small country – nobody want’s my money

The long tail of countries

Iceland has only 300,000 inhabitants. None of the “big guys” on the internet gives a damn about us. Yahoo! doesn’t care about us, neither does MSN. Google at least serves us a translated interface, but by using it we loose access to Google News, Google Maps, Google Video and a few other services that are central to many web citizens’ lives.

iTunes for Iceland – don’t think so. Amazon doesn’t have a translated interface, let alone a tailored store – but at least they accept my credit card and ship stuff over: I’m an avid customer of theirs.

In the last month I’ve gone to great lenghts to order stuff online from two companies: Radioshack and Corel.

Radioshack didn’t want my money. They won’t ship outside the US and even when I had that covered they don’t accept non-US creditcards. Luckily I have good friends in the States that helped me out.

At least that order was for hardware. Corel didn’t have any excuse. When fullfilling an order they list about 8 countries in Europe, and then an option called: “Rest of Europe”. I filled in the details – the site didn’t accept my address. Tried again – no luck. Finally I called them (btw. there is no email address or web form on their site to contact them) and explained my problem. “Oh, yeah – your country is not supported for online transactions – I can take your order on the phone.” So I spelled my details – including my name, address and email – which is hard enough for most non-Icelanders to pronounce, let alone spell over the phone. They didn’t get it right the first time. Charged my creditcard though. Called them again. Receipt came through – but not the license key. Will call them again tomorrow – hopefully that will do it.

Best of all: What I’m ordering in Corel’s case is PaintShopPro X – the downloaded version. They could have allowed me to service myself without me ever speaking to anyone – by now half of their profit from selling me the product is gone down the drain to pay the support staff that took – and corrected, and will correct again – my order.

You don’t have to be as small as Iceland to be ignored online. Denmark (population 5.4 million), Sweden (9 million), The Netherlands (16 million) are often in the same situation – some “international” companies hardly touch France (60 million) or Germany (82 million) because it’s not worth their while. As an example, the search wars between MSN, Yahoo! and Google mainly evolve around the English speaking market and China these days.

Now here’s some news for you guys: 1/4 of your best potential customers live in countries with less than 40 million inhabitants!

The chart below plots the population of the 50 countries in the world with highest GDP per capita, ordered by population:


(click for larger image)

It turns out that countries have a long tail too. “Nah – let’s just rule out these 300 million of the world’s best consumers – they’re not worth the trouble” 😉

Actually – out of the 6.5 billion people in the entire world, about 23% live in the long tail: That’s 1.5 billion people.

Sure enough, there are translations to be made, legal issues to be sorted out and local partners to be signed. But if Google makes say 5 billion (guesstimate) out of their expected 10 billion dollar revenues this year from the US, how can they ignore corresponding 150 million dollar revenues in Sweden? Or even the 5 million dollar revenues in Iceland?

The numbers for iTunes are about 10x smaller – it’s still a lot of money in the long tail markets. Come on guys – you can do it, you might even find someone to make the initial investment for you – and they’d probably already have better connections than you’d make in a year.

If resources are the problem – team up. People stumble over each other for smaller opportunities than these.

New blog

I’ve started a new blog directly under hjalli.com

It will be a bit more general and there will be posts in both English and Icelandic as suits each subject.

It’s still very fresh and immature, but I hope to post some interesting thoughts there on Spurl.net, web search and the internet as well as some “old-fashioned” wetware stuff. The Icelandic posts will probably be more general web and technology discussions as well as some personal stuff.

Hope to see you there…

Successfully implemented CD purchase protection

My girlfriend bought me a CD yesterday. It was one I really wanted so it was a well appreciated gift.

Now, we have our entire 5-600 CD collection ripped and stored on a server in our home. There is no stereo in our living room, only iTunes. So obviously the first thing to do with a new CD is to rip it and store on the server.

But NO, there is this wonderful copy protection mechanism on the disc and I would probably need to go to some lengths if I wanted to surpass it. This means I will probably not listen to the disc a lot – our CD collection is stored away in boxes and I will probably not be keeping this one disc around to be able to play it – and by the way on a lousy custom built player that comes with the CD.

So, for me, this CD is flawed. After all, I’m pretty sure my girlfriend was buying me the music, not a piece of plastic – the bits, not the atoms as Nicholas Negroponte would say. And my bits are flawed. Usually when you buy something that is flawed, you can return it but the store will probably not be accepting my compaints in this case.

From now on we will be checking any disc we’re thinking about buying for signs of copy protection, and if it has one – we won’t buy it. It’s as simple as that.

All of a sudden the intended copy protection has become a successfully implemented purchase protection!

Nice one – music publishers. No wonder you’re going out of business. If we could only buy our bits without hassle, you would be doing great.

So, next time you’re in a CD store – check for a copy protection label. If its there, don’t buy the disc. You want to be buying the bits – not the atoms.

I’m waiting for the Trillian of Social Networking

This morning, the inevitable happened. I got an invitation from people that are starting to use Orkut, the latest fad in the Social Networking world.

I joined, like I have to some 5 or 6 other such systems:

But this time I’d had enough. I joined, and made a very simple profile that says: “I’m bored with maintaining multiple instances of my network on different social networking systems. I maintain my network at LinkedIn.”

In other words, I’ve had it. I’m not going to bother my friends and acquaintances with invitations to yet another social networking system. The reason I choose LinkedIn is that it has proven to be a source of good connections for me and it has the people that I am likely to be seeking contact with via “I know a guy that knows a guy” (“person that knows a person” would probably be more politically correct). But mainly I choose it because that’s where I have spent the most time on my network and profile.
Continue reading