1.
Database Sharding the Right Way:
Easy, Reliable, and Open source.

2.
•
–
–
–
–
–

3.
Growing in the Wild. The story by
CUBRID Database Developers.
View on Slideshare
http://profyclub.ru/docs/439

4.
•
•
•
•

5.












6.
•
•

7.
=
Big Business Opportunity

8.
- Enterprise
- Vendor dependency
SQL
- Scalability constraints
- Common interface
- Open Source
NoSQL - Scalable
- Non-standard API

9.
•
•
•
•
•
•
•
•
•
•
•
•
•
•

10.
SQL
Transactions
NoSQL => NoACID
Standard Interface
Experts

11.
DBMS Worldwide 21,359 23,252 26,701 11.8%
Market Korea 349 395 478 17%
$MM Ratio 1.6% 1.7% 1.8%
70%
65%
60%
55% Korea
50% Worldwide
45%
40%
2009 2010 2011
Source: Gartner, 2012

12.
RDBMS is still the best choice for
mission-critical data

13.
Database Sharding

14.
Name Type Requirements Interface
DB ETC
DBMS w/
- Hibernate
Hibernate shards AS framework Hibernate Java
- JVM
support
dbShards AS & Middleware MySQL Java, C
Middleware
Gizzard (Twitter) Any storage - JVM Java
Middleware &
Spider for MySQL MySQL Any
Storage Engine
- CUBRID
CUBRID SHARD Middleware - MySQL Any
- Oracle

15.
•
•
•
•
–
–
•
•
•

16.
•
–
–
–
–
–

17.
Is there such RDBMS?

18.
CUBRID 9.0

19.









20.
•

21.
Easy Installation

22.
http://www.cubrid.org/downloads

23.
•
–
•
–
•
–

24.
SHARD_KEY_MODULAR = 256
SHARD_KEY_LIBRARY_NAME = ‘’
SHARD_KEY_FUNCTION_NAME = ‘’

25.
 id
 user_id
=  order_no
 …

26.
int user_get_shard_key(int type, void *val)
{
int mod = 2;
if (val == NULL)
{
return ERROR_ON_ARGUMENT;
}
switch(type)
{
case SHARD_U_TYPE_INT:
{
int ival;
ival = (int) (*(int *)val);
return ival % 2;
}
break;
case SHARD_U_TYPE_STRING:
return ERROR_ON_MAKE_SHARD_KEY;
default:
return ERROR_ON_ARGUMENT;
}
return ERROR_ON_MAKE_SHARD_KEY;
}

27.
Configuring CUBRID SHARD is very easy!

28.
•
$> cubrid createdb shard1
$> csql -S -u dba shard1 -c "create user
shard password 'shard123’”
$> cubrid server start shard1

29.
•
$> csql -C -u shard -p 'shard123'
shard1@localhost -c ”CREATE TABLE users
(id BIGINT PRIMARY KEY, name VARCHAR(20),
age SMALLINT)”

30.
$> cubrid shard start
@ cubrid shard start ++
cubrid shard start: success

31.
connectionURL =
"jdbc:cubrid:localhost:45511:shard1:shard:shard123:";

32.
String query = "SELECT name FROM student WHERE student_no = /*+ shard_key */ ?; ";
PrepareStatement query_stmt = connection.prepareStatement(query);
query_stmt.setInt(1,100);
ResultSet rs = query_stmt.executeQuery();
// fetch resultset
range
key_column (hash result) shard_id
min max
student_no 0 63 0
student_no 64 127 1
student_no 128 191 2
student_no 192 255 3

33.
SELECT name FROM student WHERE
student_no = /*+ shard_key */ ?;
•
•

34.
How did we tackle the
unique ID problem?

35.
•
–
–
–
–
–

36.
CUBRID SHARD Performance

37.
Description Quantity OS (64bit) / CPU / MEM
Agent to generat
load and 8 Centos5.3 / xeon 2G-8core / 8G
NDrive App Simulator
CUBRID Shard 1 Centos5.3 / xeon 2.27G-16core / 24G
CUBRID Broker 1 Centos5.3 / xeon 2.27G-16core / 24G
Meta DB 4 Centos5.x / xeon 2.33G-4core / 8G
User DB 1 Centos5.3 / xeon 2.5G-8core / 8G

38.
Load Generator Performance
100000
80000
60000
RPS
40000
20000
0
32 64 96 128 160 192 256 320 384 448 512
# of concurrent users
Performance trend when load is
increased
60000 70
50000 60
50
40000
40
30000
30
20000
20
10000 10
0 0
64 128 192 256 320
proxy cpu RPS metadb TPS Mean Time(ms)

39.
- Similar performance until 128 Vuser
- When SHARD is not used, 128 Vuser is
maximum
- In SHARD usage case, when # of Vuser is
increase
- maximum performance can be achieved
as well as shorter response time and
lower CPU utilization.
64 128 192 256 320
Vuser

40.
TPC-C Performance Test

41.
• • AWS Xlarge instance
– • 7GB RAM
• 20 EC2 units
–
– • Ubuntu 12.04 64-bit
–
• CUBRID 9.0 (beta) –
– no shrading
– • MySQL 5.5.28
–
• Buffer
– • 2.8GB
– data_buffer_size
• 2.8GB
• innodb_pool_size
• Default configurations

42.
46
44.18
42.66
42
38 MySQL 5.5.28
CUBRID 9.0
34
30
TPC-C Index

43.
 

 
 


 

 


44.
•
–
–
•
–
–
•
–

45.
What’s next for CUBRID?

46.





47.
www.cubrid.org
Esen Sagynov
CUBRID Project Manager
esen@cubrid.org CUBRID Q&A
www.cubrid.org/questions