Yahoo! JAPAN MEETUP #32 / Kubernetes Meetup Tokyo #19にてk8s-cluster-simulatorを紹介しました。

1. Introduction of
k8s-cluster-simulator:
A simulator for evaluating Kubernetes schedulers
Daisuke Taniwaki, Engineer
Preferred Networks, Inc.
2019/5/31 Yahoo! JAPAN MEETUP #32

2. Self Introduction
谷脇 大輔 (Daisuke Taniwaki)
職歴
2008~2012 Trend Micro - Developed a web crawler which looked for undiscovered threats
2012~2014 Kakaku.com - Launched Tabelog US web service
2014~2017 Kaizen Platform - Developed Kaizen Optimization Platform
2017~Present Preferred Networks - Developing tools and systems for GPU clusters
技術領域 dtaniwaki
dtaniwaki
2

3. The GPU Cluster of Preferred Networks
Preferred Networks builds MN-2, a state-of-the-art supercomputer powered with NVIDIA GPUs: https://www.preferred-networks.jp/en/news/pr20190318

4. Our Custom Pod Scheduler
- Concerns for Our Scheduler
- Resource usage efficiency
- Job priorities
- User fairness
Icons by Noto Emoji Smileys Icons by Google http://www.iconarchive.com/show/noto-emoji-smileys-icons-by-google.html
- We should not change the scheduling algorithm so
often.
- Testing new scheduling algorithm in the production
environment is risky.

5. k8s-cluster-simulator
https://github.com/pfnet-research/k8s-cluster-simulator
Shingo Omura Daisuke TaniwakiHidehito Yabuuchi

6. Architecture

7. High-level Class Diagram
Design user
behaviors flexibly.
Test your scheduler w/
minor modifications.

8. Blog post:
https://preferredresearch.jp/2019/04/11/k8s-cluster-simulator-release/

9. Develop a great scheduler for ML jobs!
Hopefully with us!