Friday, March 06, 2009

Over 100 million video views per day -- Ever wondered about How You Tube architecture scales?

YouTube grew incredibly fast, to over 100 million video views per day, with only a handful of people responsible for scaling the site.

How did they manage to deliver all that video to all those users? And how have they evolved since being acquired by Google?

More at:
http://highscalability.com/youtube-architecture

Some amazing stats I learnt:
  • Supports the delivery of over 100 million videos per day.
  • Founded 2/2005
  • 3/2006 30 million video views/day
  • 7/2006 100 million video views/day
  • 2 sysadmins, 2 scalability software architects
  • 2 feature developers, 2 network engineers, 1 DBA

Couple of Key points:

Keep it simple!
Simplicity allows you to re-architect more quickly so you can respond to problems. It's true that nobody really knows what simplicity is, but if you aren't afraid to make changes then that's a good sign simplicity is happening.

Shard! ( http://en.wikipedia.org/wiki/Shard_(database_architecture) )
Sharding helps to isolate and constrain storage, CPU, memory, and IO. It's not just about getting more writes performance.