PFIサマーインターン最終発表で使ったスライド

1. PFI Final Presentation
Masahiro Nakagawa
Thu, September, 30, 2010
…

2. @repeatedly
•
• kzkindle ( )
• GodBull (RedBull )
•
• Sedue

3. Sedue Architecture
User
Distributed
File System
Query Document
Searchar Indexer
Server Repository
Archive Manager Config

5. Realtime Indexing
User
Distributed
File System
Query Document
Searchar Indexer
Server Repository
Archive Manager Config

6. Realtime Indexing
• Numeric Range Index
•
•
•
• C++ ... make … …

7. S3
User
Distributed
File System
Query Document
Searchar Indexer
Server Repository
Archive Manager Config

8. DFS S3
• S3: Amazon
• EC2

9. etc...
•
•
•
• zsh ( )

10. etc...

11. …

12. version 1.6.x nightly

13. MongoDB
• : http://www.mongodb.org/
•
•
•
•

14. Sharding + Replica set

15. MongoDB Sharding
User
Distributed
File System
Query Document
Searchar Indexer
Server Repository
Archive Manager Config

17. …
(2 ) 600insert/s
↓
2 1
↓
(2 ) 3 5000 prz
↓
5000 (500 ) 4
( :4 : 30 )

18. • →
•
• 100QPS
•
• mongoimport

19. Archive Manager

20. Sedue
…( ´Д`)

21. Archive Manager
User
Distributed
File System
Query Document
Searchar Indexer
Server Repository
Archive Manager Config

23. • Heartbeat
• Archive Manager
•
•

24. Heartbeat
Virtual IP
Heartbeat
Active Stanby

25. Heartbeat
×
Virtual IP
Heartbeat
Active Stanby

26. Heartbeat
Virtual IP
Fail Over!
Heartbeat
Active Stanby

27. Connection Pooling
↓
…

28. Connection Pooling
User
Distributed
File System
Query Document
Searchar Indexer
Server Repository
Archive Manager Config

29. • 20%
• No Pooling 117s
•
Pooling 97s
• MessagePack 2
0s 60s 120s

30. Export

31. Red Bull: 58
( : 66)
2
D 0%!!