JMK no matter what

PyCon #8: EC2 scaling and reddit

redditor 로써 안갈 수 없어서 갔다. RabbitMQ 완전 대세 'ㅅ'?

  • Pricing: moving to EC2 saved 30%, as reddit's visitors grow, amazon dropped their prices so the overall bill remains the same
  • Postgre is awesome for key/value storage (against BDB, SimpleDB, Memcached)
  • memcached awesomeness (30G)
    • rendered cache 5GB
    • data cache 15GB -- memoization
    • permacache 10GB -- precomputed queries
  • logged out users -- second class users -- always get cached contents
    • so they just give it to Akamai
    • but they count 80% of the traffic! darn
  • Queues are your friend (they use RabbitMQ)
    • Votes, Comments, Thumbnail scraper, Spam, ...
    • Do not do things asynchronously, but push job in queue
  • Use ctypes to C
    • Filters unncessary whitespace
    • Discount (markdown in C)
    • Memcache
  • Profiling: cprofile
  • Pylons; glue between routing, paste, wsgi, mako, ...
    • we would replace paste
  • package maintainers: don't change your APIs plz
    • or do a major version change
    • sqlalchemy, beautiful soup, routes, pylons
2010-02-21 02:55:31 | JM | /after/conferences/ | 4 Comments
dasony
2010-02-21 03:13:59
reddit 운영자가 지난 몇시간동안 느려져서 며칠째 잠못잤는데 몇시간 후에 발표해야한다고 징징대더니 이거였었나. ㅎㅎㅎ
JM
2010-02-21 08:28:25
lol
이희승
2010-02-22 11:22:21
곧 HornetQ 가 온다 (?) - http://java.dzone.com/articles/hornetq-stings-competition
JM
2010-02-23 13:51:35
RabbitMQ 와의 속도 비교는 어떠려나요. 요즘 뭔가 얼랭 메시지 큐가 대세인듯..

Leave a comment