pc_proctab is a collection of PostgreSQL stored functions that allow you to access the operating system process table using SQL. See examples on how to use these stored functions to collect processor and I/O statistics on SQL statements run against the database.
3. What is pg proctab?
Collection of 4 C stored functions:
pg proctab
◮
pg cputime
◮
pg loadavg
◮
pg memusage
◮
Download it from:
http://git.postgresql.org/gitweb?p=pg_proctab.git
Change it:
git clone git://git.postgresql.org/git/pg_proctab.git
4. What can do you with pg proctab?
Query operating system process table
◮
Query operating system statistics
◮
Processor time
◮
Memory usage
◮
Load averages
◮
Don’t forget you can query the PostgreSQL system catalog tables
for database statistics, i.e. pg stat activity,
pg stat all tables, pg stat all indexes
5. pg cputime() Example
SELECT *
FROM pg_cputime();
user | nice | system | idle | iowait
--------+--------+--------+------------+--------
681317 | 109924 | 395481 | 1466101128 | 462661
(1 row)
6. pg cputime() Column Description
From Linux kernel source code at
Documentation/filesystems/proc.txt:
user: normal processes executing in user mode
nice: niced processes executing in user mode
system: processes executing in kernel mode
idle: twiddling thumbs
iowait: waiting for I/O to complete
8. pg loadavg() Column Description
load1: load average of last minute
load5: load average of last 5 minutes
load15: load average of last 15 minutes
last pid: last pid running
10. pg memusage() Column Description
Paraphrased from Linux kernel source code at
Documentation/filesystems/proc.txt:
memused: Total physical RAM used
memfree: Total physical RAM not used
memshared: Not used, always 0. (I don’t remember why. . . )
membuffers: Temporary storage for raw disk blocks
memcached: In-memory cache for files read from disk
swapused: Total swap space used
swapfree: Memory evicted from RAM that is now temporary on
disk
swapcached: Memory that was swapped out, now swapped in but
still in swap
11. pg proctab() Partial Column Description
Everything from the operating system such as /proc/<pid>/stat,
/proc/<pid>/io and /proc/<pid>/cmdline as well as data
from PostgreSQL system catalog such as pg stat activity table
are available but we’ll only cover some of the fields here:
Informative:
pid
◮
comm - filename of the executable
◮
fullcomm (/proc/<pid>/cmdline)
◮
uid
◮
username
◮
Processor:
utime - user mode jiffies
◮
stime - kernel mode jiffies
◮
...
12. pg proctab() Partial Column Description (cont.)
Memory:
vsize - virtual memory size
◮
rss - resident set memory size
◮
I/O:
syscr - number of read I/O operations
◮
syscw - number of write I/O operations
◮
reads - number of bytes which this process really did cause to
◮
be fetched from the storage layer
writes - number of bytes which this process really did cause to
◮
be sent from the storage layer
cwrites - number of bytes which this process caused to not
◮
happen, by truncating pagecache
18. Identify yourself.
SELECT *
FROM pg_backend_pid();
pg_backend_pid
----------------
4509
(1 row)
Note: The following series of SQL statements are made from the
same psql session. Otherwise the pg backend pid will change. This
is important because stats are collected in the operating system by
process ID (pid).
19. Take a snapshot before the running the query
i ps_procstat-snap.sql
BEGIN
ps_snap_stats
---------------
1
(1 row)
COMMIT
20. Execute the query
Don’t focus too much on the actual query, the idea is that is you
want to collect statistics for a single query:
SELECT nation,
o_year,
Sum(amount) AS sum_profit
FROM (SELECT n_name AS nation,
Extract(YEAR FROM o_orderdate) AS o_year,
l_extendedprice * (1 - l_discount) - ps_supplycost * l_quantity AS amount
FROM part,
supplier,
lineitem,
partsupp,
orders,
nation
WHERE s_suppkey = l_suppkey
AND ps_suppkey = l_suppkey
AND ps_partkey = l_partkey
AND p_partkey = l_partkey
AND o_orderkey = l_orderkey
AND s_nationkey = n_nationkey
AND p_name LIKE ’%white%’) AS profit
GROUP BY nation,
o_year
ORDER BY nation,
o_year DESC;
21. Take a snapshot after the running the query
i ps_procstat-snap.sql
BEGIN
ps_snap_stats
---------------
2
(1 row)
COMMIT
22. Calculate Processor Utilization
$ ./ps-processor-utilization.sh 4590 1 2
Processor Utilization = 1.00 %
Example (partial):
SELECT stime, utime, stime + utime AS total,
extract(epoch FROM time)
FROM ps_snaps a, ps_procstat b
WHERE pid = ${PID}
AND a.snap = b.snap
AND a.snap = ${SNAP1}
TIMEDIFF=‘echo quot;scale = 2; (${TIME2} - ${TIME1}) * ${HZ}quot; | bc -l‘
U=‘echo quot;scale = 2; (${TOTAL2} - ${TOTAL1}) / ${TIMEDIFF} * 100quot; | bc -l‘
23. Calculate Disk Utilization
$ ./ps-io-utilization.sh 4590 1 2
Reads = 276981
Writes = 63803
Reads (Bytes) = 2164604928
Writes (Bytes) = 508166144
Cancelled (Bytes) = 36880384
SELECT syscr, syscw, reads, writes, cwrites
FROM ps_snaps a, ps_procstat b
WHERE pid = ${PID}
AND a.snap = b.snap
AND a.snap = ${SNAP1}
25. Another example from pg proctab contrib
$ ./ps-report.pl 4590 1 2
__ __ /
/ ~~~/ . o O | Warning! Too much data |
,----( oo ) | to fit on the screen! |
/ __ __/ /
/| ( |(
^ /___ / |
|__| |__|-quot;
28. Creating Reports: Section 2 - Falling off the right side...
N Tup Upd
◮
N Tup Del
◮
Last Vacuum
◮
Last Autovacuum
◮
Last Analyze
◮
Last Autoanalyze
◮
30. What else can we do with pg proctab?
Enable pg top to monitor remote databases by providing access to
the database system’s operating system process table.
34. License
This work is licensed under a Creative Commons Attribution 3.0
Unported License. To view a copy of this license, (a) visit
http://creativecommons.org/licenses/by/3.0/us/; or, (b)
send a letter to Creative Commons, 171 2nd Street, Suite 300, San
Francisco, California, 94105, USA.