빠른 성장과 안정적인 운영이라는 두 마리 토끼를 잡기 위해, Cloud Native를 통해 글로벌 서비스를 제공하는 두 스타트업의 이야기를 살펴봅니다. 기계학습 (ML)을 위한 대규모 데이터의 효율적인 관리와 AI 서비스 개발을 도와주는 Superb AI의 클라우드 네이티브 노하우, 그리고 EKS Multi tenancy 기반으로 170개국 팬들에게 커뮤니티 및 이커머스 서비스를 안정적으로 제공하는 비마이프렌즈의 경험담을 전달드립니다.

1. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S E O U L | M A Y 3 , 2 0 2 3

2. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?
Account Manager
AWS
CTO
Superb AI
DevOps Team Lead
bemyfriends

3. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. Managed Service
2. bemyfriends,
“SaaS ?”
3. Superb AI,
?
Superb AI AI
4.
Agenda

4. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Managed Service
Startup ?

5. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Managed Service
, ,
?
Business
Sales (inbound/outbound)
Marketing
Hiring / HR
Raising capital
Customer support
Finding product and market fit
Social / PR
Legal
Accounting
Tech
Product development
Infrastructure / Ops
Security

6. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Managed Services
100
/
/
- 25%
– 47%
Account Team, Solutions Architect,
Specialist

7. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
✓
✓ &
✓ &
FULLY INTEGRATED AWS
PRODUCTS AND
SERVICES
AWS Cloud
,
SLAs
Lock in
(Portability)
AWS Managed Services

8. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
"SaaS ?"
DevOps Team Lead
bemyfriends

9. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• (bemyfriends)
• (b.stage)
• SaaS Multi-Tenancy
Agenda

10. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fans
,
(bemyfriends)
Fans
Creators
Artists
Brands (corporate, personal)
Esports & Gaming, Sports, Entertainment &
Talent, Content & Media, Creators
(SaaS solution)
Fandom
Business
Services

11. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SaaS (b.stage)
.

12. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(b.stage)
2021.11 2022.04 2022.07 2022.08 2022.11 2022.12 2022.12 2023.01 2023.02
5
( · · ·
· / )
( , )

13. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SaaS Multi-Tenancy

14. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy SaaS
Single Tenant
App
DB
Multi Tenant
Tenant
App
DB
App App App
Tenant Tenant
Cluster
✔︎
✔
✔

15. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SaaS
Multi-Tenancy SaaS
OS
Database
Application
Code
Hardware
Runtime
Scaling
Data Configuration

16. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lambda
Network
Load
Balancer
Istio ingress
gateway
ECR
Elastic Kubernetes Cluster
S3
ElastiCache
(Redis)
Amazon Aurora
MySQL
VPC
account content live-streaming
survey shop digital-
item
notificatio
n
MSK
web3
MongoDB

17. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
B Group
A Group
SaaS
Pods Pods Pods Pods Pods
Pods Pods Pods
Isolation Cluster
A Group
B Group
Pods Pods Pods Pods Pods
Shared Cluster
A Group
Pods Pods Pods Pods Pods
Pods Pods Pods Pods Pods
B Group
C Group
✔︎
✔
✔SLA

18. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy
B Group
Network Policy
A Group
ElastiCache
(Redis)
Amazon
Aurora MySQL
Amazon
Aurora MySQL
A
B
Route
X-XXX-
GROUP:A
X-XXX-
GROUP:B
Pods Pods Pods
Pods Pods Pods
MongoDB
MongoDB
ElastiCache
(Redis)

19. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tanancy EKS
Availability Zone 1 Availability Zone 2 Availability Zone 3
Node
Auto Scaling
Node Node
Node Node Node
Auto Scaling
Multi-AZ
Kubernetes nodeAffinity

20. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SaaS On EKS
ExternalSecret
AWS SecretManager
Secret
Kubernetes Operator .
External Secret
SecretManager
EKS
.
SecretStore
ExternalSecret
AWS
SecretManager
Namespace
ExternalSecret
Application
Secret
watch
use
create

21. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SaaS On EKS
Pods
Pods
AWS
SecretManage
r
AWS
SecretManage
r
Pods
Pods
Pods
Pods
external
secret
secret
sync
irsa

22. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy CI/CD
ECR
Push
Build Deploy ArgoCD
Kubernetes
Cluster
Git
Repo
Pull Changes Sync Cluster
Status
Deploy_Tenant_A
Deploy_Tenant_B

23. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Canary Deploy
Primary
v1
Canary
v1 v1
v2 v2 v2
Istio ingress
gateway
Http Header
X-XXX-MATCH-
XXX: 1

24. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Canary Deploy

25. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Monitoring
DATADOG

26. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Spike Traffic

27. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Spike Traffic
SPIKE TRAFFIC!
Contents Notification
Push
Traffic Spike
Scale Out
?

28. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Spike Traffic
Pre
AutoScaling AutoScaling

29. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-Tenancy Spike Traffic
Karpenter
EventTrigger Keda ScaledObject Deployment
Optimized
Capacity
Kapenter
Unschedulable
Pods
✔︎ node
✔ Scale out
✔

30. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SaaS Multi-Tenancy
EKS Multi-Tenancy
Spike Traffic

31. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CTO
Superb AI
?
Superb AI AI

32. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Superb AI
• ?
• Computer Vision
• Superb AI
• AWS Cloud Native
•
Agenda

33. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Superb AI
Machine learning data platform
“Democratize AI to empower humans everywhere in the world”
AI AI
Data
Ingestion
ML
Cloud
Integration
SDK / CLI
Data
Curation
Auto Curate
(Edge / Test Data
Curation)
Data
Labeling
Auto-edit
Auto-label
Custom
Auto-label
Uncertainty
Estimation
Data
Validation
Consensus
Labeling
Mislabel
Detection
Embedding
Store
(Scatter View)
Superb AI Suite

34. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Train
Correct
Data
Deploy
AI
• Fine-tuning GPT model
• AutoML
AI
• Test set, test scenario
• Metrics: accuracy, mAP, MSE

35. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Computer Vision
Training Access
/

36. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Label
Superb ai - Superb Label
AI

37. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Label
Superb ai - Superb Label
AI

38. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Label
Superb ai - Superb Label
AI

39. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Label
Superb ai - Superb Label
AI

40. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Curate
Superb ai - Superb curate
Data, Label, Metadata
Query
Embedding(Feature)
AI Auto-curate

41. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Curate
Superb ai - Superb curate
Data, Label, Metadata
Query
Embedding(Feature)
AI Auto-curate

42. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Curate
Superb ai - Superb curate
Data, Label, Metadata
Query
Embedding(Feature)
AI Auto-curate

43. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data, Label, Metadata
Query
Embedding(Feature)
AI Auto-curate
Curate
Superb ai - Superb curate

44. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI Data Platform
•
•
•
•
•
•
AI
• AI
•
• AI
•
•
•

45. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud Native

46. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
-
Amazon S3
Data
(Region A)
Containers
Databases
Serverless Workflow
Service API
Project
Asset
Label
Tag
Step Functions
Simple Queue Service
Command
History
Validation
Export
Model Inference
MRAP
Data
(Region B)
CloudWatch
( , )

47. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
-
Amazon S3
Data
(Region A)
Containers
Databases
Serverless Workflow
Service API
Project
Asset
Label
Tag
Step Functions
Simple Queue Service
Command
History
Validation
Export
Model Inference
MRAP
Data
(Region B)
CloudWatch
( , )
AWS Step Functions,
AWS Lambda, Fargate
serverless workflow orchestration

48. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
-
Amazon S3
Data
(Region A)
Containers
Databases
Serverless Workflow
Service API
Project
Asset
Label
Tag
Step Functions
Simple Queue Service
Command
History
Validation
Export
Model Inference
MRAP
Data
(Region B)
CloudWatch
AWS Cloudwatch
/

49. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
-
Amazon S3
Data
(Region A)
Containers
Databases
Serverless Workflow
Service API
Project
Asset
Label
Tag
Step Functions
Simple Queue Service
Command
History
Validation
Export
Model Inference
MRAP
Data
(Region B)
Cloudwatch
AWS S3, Multi-Region Access Point
S3 Intelligent-Tiering

50. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI -
Amazon SageMaker
Containers
Service API
AI Task Request
Amazon S3
Simple Queue Service
Training Queue Inference Queue
Worker
Trigger Task
Handler
Data
Label
Trained
Models
Train Inference
ECR
AI
Images
AI
GPU
AI task
AI

51. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI -
Amazon SageMaker
Containers
Service API
AI Task Request
Amazon S3
Simple Queue Service
Training Queue Inference Queue
Worker
Trigger Task
Handler
Data
Label
Trained
Models
Train Inference
ECR
AI
Images
AI
GPU
Amazon SageMaker
GPU (Training / Inference)

52. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI -
Amazon SageMaker
Containers
Service API
AI Task Request
Amazon S3
Simple Queue Service
Training Queue Inference Queue
Worker
Trigger Task
Handler
Data
Label
Trained
Models
Train Inference
ECR
AI
Images
AI task
AI
AWS SQS task lifecycle ,
local utilization
,
S3

53. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Event-driven
Data AI Human
Data
AI
AI
AI
Human
AI
,

54. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Event-driven
Service API
Databases
Dataset
Slice
Label
Kafka Connect
AWS SageMaker
Batch Transform
Embedding Metadata
Indexing Status
Data Embedding
Kafka
(DB change)
Sync Handler
Kafka
(recent state)
Kafka Connect
Search Index
Featurized Data
Query / Search API
AWS EKS
Containerized App Serving
Managed Database
CDC(Change Data Capture)
Event-driven

55. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI / ML :
AI customized feature
Embedding
Anlaysis
Mislabel
Detection
Curate
Edge-cases

56. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI
✓ ,
✓ ,
✓
✓
Cloud Managed Service
Serverless Computing .

57. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.

58. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Advantage of Cloud Native
.
.
,
.
AWS
.

59. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
감사합니다
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.