Larry's Notebook

February 13, 2012

The Great Disk Drive in the Sky: How Web giants store big—and we mean

Filed under: networks — larryang @ 11:54 AM

The Great Disk Drive in the Sky: How Web giants store big—and we mean.

Covers what Google, Hadoop DFS, Amazon and Microsoft solutions. It’s a lot like cache design- considerations include size of data, frequency of reads vs. writes. I think is the hardest engineering challenge is avoiding a single point of failure and making the system truly distributed while maintaining coherency in a low overhead and timely manner.

Advertisements

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Create a free website or blog at WordPress.com.

%d bloggers like this: