Admire2011 slides

The Segment Ontology:
Bridging Music-Generic
and Domain-Speciﬁc
Ben Fields Kevin Page, David De Roure
Electronics and Computer Science Oxford e-Research Centre
University of Southampton University of Oxford
United Kingdom United Kingdom
(Now at Musicmetric)

Tim Crawford
Department of Computing
Goldsmiths, University of London
United Kingdom

Friday, July 15, 2011

or
How to make your data
useful?


or
How to make your data
useful?

(for more than the person
at the desk next door)


Overview

• Introduction and background
• Foundations
• Ontology and approach
• Worked examples
• Conclusions


Sorry about an ontology talk at before 10 in the morning, but we’ll
all do our best...

Introduction and
background


Alice

So you've done some research. [Alice]

Say on the latest and greatest in structured segmentation,

current


In some available library. (show libraries)

2,0.66152,0.56679,0.4866,0.45832,0.51859,0.70321,0.038462,0.02381,0.1,9.6469,9.8307,0.15385,0.095238,0.4,9.6469,9.8307
3,0.933,0.4629,0.57765,0.41229,0.96449,0.58075,0.15385,0.13333,0.18182,1.9774,1.9476,0.53846,0.46667,0.63636,1.9774,1.9476
4,0.97791,0.52583,0.6581,0.49102,0.99753,0.62006,0.42105,0.4,0.44444,1.2744,0.28195,0.52632,0.5,0.55556,1.2744,0.28195
5,0.81587,0.67237,0.62963,0.52713,0.78163,0.7697,0.41176,0.33333,0.53846,0.0855,0.0353,0.41176,0.33333,0.53846,0.0855,0.0353
6,0.72994,0.57989,0.60291,0.52291,0.71181,0.72818,0.28571,0.23529,0.36364,1.742,1.7181,0.42857,0.35294,0.54545,1.742,1.7181
7,0.80311,0.79048,0.65858,0.58822,0.74805,0.85078,0.22581,0.13725,0.63636,0.1035,5.6573,0.35484,0.21569,1,0.1035,5.6573
8,0.83249,0.84691,0.91465,0.91906,0.91029,0.91341,0.1,0.071429,0.16667,1.5356,1.6303,0.5,0.35714,0.83333,1.5356,1.6303
9,0.71925,0.72487,0.71622,0.70732,0.72535,0.87263,0.22222,0.15789,0.375,3.1349,3.7239,0.2963,0.21053,0.5,3.1349,3.7239
10,0.80073,0.47061,0.57382,0.4246,0.88475,0.6886,0.12903,0.11765,0.14286,2.7597,2.5612,0.51613,0.47059,0.57143,2.7597,2.5612
11,0.61851,0.73895,0.64422,0.74023,0.57026,0.75954,0.097561,0.064516,0.2,2.1932,3.2631,0.34146,0.22581,0.7,2.1932,3.2631
12,0.74449,0.52717,0.38629,0.27811,0.63223,0.68661,0.2029,0.12069,0.63636,0.028,7.3769,0.31884,0.18966,1,0.028,7.3769
13,0.71727,0.86226,0.76329,0.86093,0.68554,0.91858,0.17778,0.10811,0.5,0.4592,6.7539,0.26667,0.16216,0.75,0.4592,6.7539
14,0.58769,0.41369,0.39533,0.31693,0.52526,0.73385,0.051282,0.034483,0.1,3.7969,3.9955,0.10256,0.068966,0.2,3.7969,3.9955
15,0.5074,0.69885,0.48396,0.65689,0.38311,0.79331,0.086957,0.057143,0.18182,1.5785,3.1578,0.34783,0.22857,0.72727,1.5785,3.1578
16,0.68559,0.59077,0.42409,0.35172,0.53395,0.7233,0.081633,0.054054,0.16667,1.5063,2.2101,0.44898,0.2973,0.91667,1.5063,2.2101
17,0.74139,0.56784,0.46026,0.35487,0.65469,0.78644,0.11111,0.076923,0.2,4.1782,8.4177,0.22222,0.15385,0.4,4.1782,8.4177
18,0.67979,0.58325,0.44566,0.37536,0.54837,0.79474,0.26316,0.17857,0.5,1.1873,5.0093,0.36842,0.25,0.7,1.1873,5.0093
19,0.81253,0.9051,0.91347,0.9581,0.87282,0.92677,0.52632,0.41667,0.71429,0.0434,0.0449,0.52632,0.41667,0.71429,0.0434,0.0449
20,0.83714,0.61209,0.70376,0.57432,0.90854,0.74402,0.068966,0.0625,0.076923,2.9754,2.031,0.48276,0.4375,0.53846,2.9754,2.031
21,0.89376,0.38768,0.56771,0.40344,0.95763,0.62828,0.15385,0.11765,0.22222,1.7314,1.6844,0.38462,0.29412,0.55556,1.7314,1.6844
22,0.73098,0.36994,0.48476,0.34891,0.79386,0.61375,0.074074,0.058824,0.1,4.5337,4.52,0.074074,0.058824,0.1,4.5337,4.52
23,0.81342,0.67385,0.70745,0.62034,0.82302,0.82361,0.33962,0.2093,0.9,0.03645,5.3153,0.37736,0.23256,1,0.03645,5.3153
24,0.96062,0.93876,0.96236,0.93583,0.99045,0.97267,0.56,0.4375,0.77778,0.0217,0.02215,0.72,0.5625,1,0.0217,0.02215
25,0.77459,0.42288,0.51335,0.39122,0.74634,0.64133,0.10526,0.068966,0.22222,1.0076,1.3836,0.47368,0.31034,1,1.0076,1.3836
26,0.95472,0.68849,0.7527,0.61021,0.98201,0.77237,0.5,0.375,0.75,0.0988,0.1003,0.5,0.375,0.75,0.0988,0.1003
27,0.83566,0.25589,0.44943,0.30091,0.88747,0.42936,0.090909,0.090909,0.090909,9.8989,9.4508,0.18182,0.18182,0.18182,9.8989,9.4508
28,0.97914,0.73493,0.80443,0.67377,0.99797,0.81683,0.59259,0.47059,0.8,0.0105,0.0093,0.66667,0.52941,0.9,0.0105,0.0093
29,0.80645,0.61323,0.62251,0.50776,0.80427,0.74071,0.34483,0.29412,0.41667,1.5031,0.8184,0.55172,0.47059,0.66667,1.5031,0.8184
30,0.90923,0.54316,0.55712,0.39344,0.95399,0.72868,0.34783,0.36364,0.33333,8.6931,0.02,0.43478,0.45455,0.41667,8.6931,0.02
31,0.76196,0.54285,0.55984,0.44884,0.74375,0.77388,0.12903,0.10526,0.16667,5.0182,2.9525,0.32258,0.26316,0.41667,5.0182,2.9525
32,0.6294,0.72579,0.61369,0.6906,0.5522,0.76653,0.20408,0.125,0.55556,0.3678,7.5285,0.36735,0.225,1,0.3678,7.5285
33,0.71361,0.49932,0.51377,0.39335,0.74045,0.7069,0.054054,0.045455,0.066667,5.0592,4.6887,0.054054,0.045455,0.066667,5.0592,4.6887
34,0.87812,0.78273,0.8882,0.84875,0.9315,0.90517,0.083333,0.0625,0.125,0.8311,0.8451,0.66667,0.5,1,0.8311,0.8451
35,0.52626,0.59493,0.47072,0.54396,0.41486,0.6781,0.066667,0.05,0.1,5.3513,5.3533,0.26667,0.2,0.4,5.3513,5.3533
36,0.7758,0.668,0.75885,0.69136,0.84094,0.83209,0.055556,0.043478,0.076923,0.6617,0.6695,0.72222,0.56522,1,0.6617,0.6695
37,0.66605,0.84795,0.77282,0.89073,0.68247,0.86527,0.074074,0.045455,0.2,3.782,4.2649,0.14815,0.090909,0.4,3.782,4.2649
38,0.67684,0.67952,0.6022,0.58217,0.62365,0.72183,0.34483,0.22727,0.71429,0.0702,8.7867,0.34483,0.22727,0.71429,0.0702,8.7867
39,0.77119,0.29011,0.42757,0.29287,0.79174,0.52036,0.074074,0.0625,0.090909,6.9544,2.5373,0.2963,0.25,0.36364,6.9544,2.5373
40,0.6686,0.69894,0.66362,0.68884,0.64018,0.77925,0.29412,0.22727,0.41667,1.2845,1.286,0.41176,0.31818,0.58333,1.2845,1.286
41,0.87802,0.42688,0.64649,0.48485,0.96983,0.63325,0.26087,0.27273,0.25,5.752,0.0842,0.34783,0.36364,0.33333,5.752,0.0842
42,0.93217,0.93379,0.97999,0.97809,0.98191,0.96683,0.08,0.0625,0.11111,0.5319,0.5334,0.64,0.5,0.88889,0.5319,0.5334
43,0.85864,0.57822,0.58551,0.4463,0.85095,0.7132,0.36364,0.22857,0.88889,0.0215,3.8896,0.36364,0.22857,0.88889,0.0215,3.8896
44,0.40868,0.54126,0.27701,0.43666,0.20285,0.75368,0.11111,0.060976,0.625,0.19375,7.5337,0.17778,0.097561,1,0.19375,7.5337
45,0.74572,0.64506,0.6383,0.5704,0.72454,0.80094,0.045455,0.030303,0.090909,4.0875,4.5896,0.22727,0.15152,0.45455,4.0875,4.5896
46,0.69984,0.61099,0.52079,0.47485,0.57657,0.72023,0.2069,0.15789,0.3,6.086,4.881,0.34483,0.26316,0.5,6.086,4.881
47,0.73692,0.49052,0.40088,0.28332,0.68519,0.701,0.055556,0.045455,0.071429,8.5364,7.4664,0.22222,0.18182,0.28571,8.5364,7.4664
48,0.61213,0.84237,0.65889,0.91396,0.51513,0.75565,0.38462,0.26316,0.71429,0.2088,0.3753,0.46154,0.31579,0.85714,0.2088,0.3753
49,0.69079,0.21379,0.42485,0.3144,0.65494,0.48125,0.057143,0.041667,0.090909,5.9116,5.9343,0.11429,0.083333,0.18182,5.9116,5.9343
50,0.92411,0.89152,0.95957,0.93934,0.9807,0.96659,0.48276,0.35,0.77778,0.05535,0.058825,0.55172,0.4,0.88889,0.05535,0.058825
51,0.83206,0.71228,0.77986,0.70502,0.87248,0.84714,0.076923,0.0625,0.1,1.0801,1.0818,0.69231,0.5625,0.9,1.0801,1.0818
52,0.87953,0.71423,0.69202,0.57148,0.87701,0.79044,0.38462,0.33333,0.45455,0.6287,0.0634,0.46154,0.4,0.54545,0.6287,0.0634
53,0.78255,0.52888,0.65775,0.52933,0.86844,0.70463,0.095238,0.071429,0.14286,0.7589,0.84535,0.47619,0.35714,0.71429,0.7589,0.84535
54,0.99529,0.99446,0.99567,0.99138,1,0.99408,0.64,0.5,0.88889,0.0222,0.01945,0.64,0.5,0.88889,0.0222,0.01945
55,0.78894,0.44123,0.52507,0.41323,0.7199,0.571,0.47619,0.41667,0.55556,0.05203,0.03985,0.47619,0.41667,0.55556,0.05203,0.03985
56,0.83685,0.74141,0.67786,0.57816,0.81911,0.84006,0.27586,0.21053,0.4,0.7553,2.4216,0.48276,0.36842,0.7,0.7553,2.4216
57,0.85304,0.73158,0.81345,0.74841,0.89086,0.86108,0.32258,0.26316,0.41667,1.1351,1.4749,0.70968,0.57895,0.91667,1.1351,1.4749

So the output of the process perhaps looks like this

But now someone has to use it.

Bob
Like, say, this chap here. ( a musicologist) [Bob]

2,0.66152,0.56679,0.4866,0.45832,0.51859,0.70321,0.038462,0.02381,0.1,9.6469,9.8307,0.15385,0.095238,0.4,9.6469,9.8307
3,0.933,0.4629,0.57765,0.41229,0.96449,0.58075,0.15385,0.13333,0.18182,1.9774,1.9476,0.53846,0.46667,0.63636,1.9774,1.9476
4,0.97791,0.52583,0.6581,0.49102,0.99753,0.62006,0.42105,0.4,0.44444,1.2744,0.28195,0.52632,0.5,0.55556,1.2744,0.28195
5,0.81587,0.67237,0.62963,0.52713,0.78163,0.7697,0.41176,0.33333,0.53846,0.0855,0.0353,0.41176,0.33333,0.53846,0.0855,0.0353
6,0.72994,0.57989,0.60291,0.52291,0.71181,0.72818,0.28571,0.23529,0.36364,1.742,1.7181,0.42857,0.35294,0.54545,1.742,1.7181
7,0.80311,0.79048,0.65858,0.58822,0.74805,0.85078,0.22581,0.13725,0.63636,0.1035,5.6573,0.35484,0.21569,1,0.1035,5.6573
8,0.83249,0.84691,0.91465,0.91906,0.91029,0.91341,0.1,0.071429,0.16667,1.5356,1.6303,0.5,0.35714,0.83333,1.5356,1.6303
9,0.71925,0.72487,0.71622,0.70732,0.72535,0.87263,0.22222,0.15789,0.375,3.1349,3.7239,0.2963,0.21053,0.5,3.1349,3.7239
10,0.80073,0.47061,0.57382,0.4246,0.88475,0.6886,0.12903,0.11765,0.14286,2.7597,2.5612,0.51613,0.47059,0.57143,2.7597,2.5612
11,0.61851,0.73895,0.64422,0.74023,0.57026,0.75954,0.097561,0.064516,0.2,2.1932,3.2631,0.34146,0.22581,0.7,2.1932,3.2631
12,0.74449,0.52717,0.38629,0.27811,0.63223,0.68661,0.2029,0.12069,0.63636,0.028,7.3769,0.31884,0.18966,1,0.028,7.3769
13,0.71727,0.86226,0.76329,0.86093,0.68554,0.91858,0.17778,0.10811,0.5,0.4592,6.7539,0.26667,0.16216,0.75,0.4592,6.7539
14,0.58769,0.41369,0.39533,0.31693,0.52526,0.73385,0.051282,0.034483,0.1,3.7969,3.9955,0.10256,0.068966,0.2,3.7969,3.9955
15,0.5074,0.69885,0.48396,0.65689,0.38311,0.79331,0.086957,0.057143,0.18182,1.5785,3.1578,0.34783,0.22857,0.72727,1.5785,3.1578
16,0.68559,0.59077,0.42409,0.35172,0.53395,0.7233,0.081633,0.054054,0.16667,1.5063,2.2101,0.44898,0.2973,0.91667,1.5063,2.2101
17,0.74139,0.56784,0.46026,0.35487,0.65469,0.78644,0.11111,0.076923,0.2,4.1782,8.4177,0.22222,0.15385,0.4,4.1782,8.4177
18,0.67979,0.58325,0.44566,0.37536,0.54837,0.79474,0.26316,0.17857,0.5,1.1873,5.0093,0.36842,0.25,0.7,1.1873,5.0093
19,0.81253,0.9051,0.91347,0.9581,0.87282,0.92677,0.52632,0.41667,0.71429,0.0434,0.0449,0.52632,0.41667,0.71429,0.0434,0.0449
20,0.83714,0.61209,0.70376,0.57432,0.90854,0.74402,0.068966,0.0625,0.076923,2.9754,2.031,0.48276,0.4375,0.53846,2.9754,2.031
21,0.89376,0.38768,0.56771,0.40344,0.95763,0.62828,0.15385,0.11765,0.22222,1.7314,1.6844,0.38462,0.29412,0.55556,1.7314,1.6844
22,0.73098,0.36994,0.48476,0.34891,0.79386,0.61375,0.074074,0.058824,0.1,4.5337,4.52,0.074074,0.058824,0.1,4.5337,4.52
23,0.81342,0.67385,0.70745,0.62034,0.82302,0.82361,0.33962,0.2093,0.9,0.03645,5.3153,0.37736,0.23256,1,0.03645,5.3153
24,0.96062,0.93876,0.96236,0.93583,0.99045,0.97267,0.56,0.4375,0.77778,0.0217,0.02215,0.72,0.5625,1,0.0217,0.02215
25,0.77459,0.42288,0.51335,0.39122,0.74634,0.64133,0.10526,0.068966,0.22222,1.0076,1.3836,0.47368,0.31034,1,1.0076,1.3836
26,0.95472,0.68849,0.7527,0.61021,0.98201,0.77237,0.5,0.375,0.75,0.0988,0.1003,0.5,0.375,0.75,0.0988,0.1003
27,0.83566,0.25589,0.44943,0.30091,0.88747,0.42936,0.090909,0.090909,0.090909,9.8989,9.4508,0.18182,0.18182,0.18182,9.8989,9.4508
28,0.97914,0.73493,0.80443,0.67377,0.99797,0.81683,0.59259,0.47059,0.8,0.0105,0.0093,0.66667,0.52941,0.9,0.0105,0.0093
29,0.80645,0.61323,0.62251,0.50776,0.80427,0.74071,0.34483,0.29412,0.41667,1.5031,0.8184,0.55172,0.47059,0.66667,1.5031,0.8184
30,0.90923,0.54316,0.55712,0.39344,0.95399,0.72868,0.34783,0.36364,0.33333,8.6931,0.02,0.43478,0.45455,0.41667,8.6931,0.02
31,0.76196,0.54285,0.55984,0.44884,0.74375,0.77388,0.12903,0.10526,0.16667,5.0182,2.9525,0.32258,0.26316,0.41667,5.0182,2.9525
32,0.6294,0.72579,0.61369,0.6906,0.5522,0.76653,0.20408,0.125,0.55556,0.3678,7.5285,0.36735,0.225,1,0.3678,7.5285
33,0.71361,0.49932,0.51377,0.39335,0.74045,0.7069,0.054054,0.045455,0.066667,5.0592,4.6887,0.054054,0.045455,0.066667,5.0592,4.6887
34,0.87812,0.78273,0.8882,0.84875,0.9315,0.90517,0.083333,0.0625,0.125,0.8311,0.8451,0.66667,0.5,1,0.8311,0.8451
35,0.52626,0.59493,0.47072,0.54396,0.41486,0.6781,0.066667,0.05,0.1,5.3513,5.3533,0.26667,0.2,0.4,5.3513,5.3533
36,0.7758,0.668,0.75885,0.69136,0.84094,0.83209,0.055556,0.043478,0.076923,0.6617,0.6695,0.72222,0.56522,1,0.6617,0.6695
37,0.66605,0.84795,0.77282,0.89073,0.68247,0.86527,0.074074,0.045455,0.2,3.782,4.2649,0.14815,0.090909,0.4,3.782,4.2649
38,0.67684,0.67952,0.6022,0.58217,0.62365,0.72183,0.34483,0.22727,0.71429,0.0702,8.7867,0.34483,0.22727,0.71429,0.0702,8.7867
39,0.77119,0.29011,0.42757,0.29287,0.79174,0.52036,0.074074,0.0625,0.090909,6.9544,2.5373,0.2963,0.25,0.36364,6.9544,2.5373
40,0.6686,0.69894,0.66362,0.68884,0.64018,0.77925,0.29412,0.22727,0.41667,1.2845,1.286,0.41176,0.31818,0.58333,1.2845,1.286
41,0.87802,0.42688,0.64649,0.48485,0.96983,0.63325,0.26087,0.27273,0.25,5.752,0.0842,0.34783,0.36364,0.33333,5.752,0.0842
42,0.93217,0.93379,0.97999,0.97809,0.98191,0.96683,0.08,0.0625,0.11111,0.5319,0.5334,0.64,0.5,0.88889,0.5319,0.5334
43,0.85864,0.57822,0.58551,0.4463,0.85095,0.7132,0.36364,0.22857,0.88889,0.0215,3.8896,0.36364,0.22857,0.88889,0.0215,3.8896
44,0.40868,0.54126,0.27701,0.43666,0.20285,0.75368,0.11111,0.060976,0.625,0.19375,7.5337,0.17778,0.097561,1,0.19375,7.5337
45,0.74572,0.64506,0.6383,0.5704,0.72454,0.80094,0.045455,0.030303,0.090909,4.0875,4.5896,0.22727,0.15152,0.45455,4.0875,4.5896
46,0.69984,0.61099,0.52079,0.47485,0.57657,0.72023,0.2069,0.15789,0.3,6.086,4.881,0.34483,0.26316,0.5,6.086,4.881
47,0.73692,0.49052,0.40088,0.28332,0.68519,0.701,0.055556,0.045455,0.071429,8.5364,7.4664,0.22222,0.18182,0.28571,8.5364,7.4664
48,0.61213,0.84237,0.65889,0.91396,0.51513,0.75565,0.38462,0.26316,0.71429,0.2088,0.3753,0.46154,0.31579,0.85714,0.2088,0.3753
49,0.69079,0.21379,0.42485,0.3144,0.65494,0.48125,0.057143,0.041667,0.090909,5.9116,5.9343,0.11429,0.083333,0.18182,5.9116,5.9343
50,0.92411,0.89152,0.95957,0.93934,0.9807,0.96659,0.48276,0.35,0.77778,0.05535,0.058825,0.55172,0.4,0.88889,0.05535,0.058825
51,0.83206,0.71228,0.77986,0.70502,0.87248,0.84714,0.076923,0.0625,0.1,1.0801,1.0818,0.69231,0.5625,0.9,1.0801,1.0818
52,0.87953,0.71423,0.69202,0.57148,0.87701,0.79044,0.38462,0.33333,0.45455,0.6287,0.0634,0.46154,0.4,0.54545,0.6287,0.0634
53,0.78255,0.52888,0.65775,0.52933,0.86844,0.70463,0.095238,0.071429,0.14286,0.7589,0.84535,0.47619,0.35714,0.71429,0.7589,0.84535
54,0.99529,0.99446,0.99567,0.99138,1,0.99408,0.64,0.5,0.88889,0.0222,0.01945,0.64,0.5,0.88889,0.0222,0.01945
55,0.78894,0.44123,0.52507,0.41323,0.7199,0.571,0.47619,0.41667,0.55556,0.05203,0.03985,0.47619,0.41667,0.55556,0.05203,0.03985
56,0.83685,0.74141,0.67786,0.57816,0.81911,0.84006,0.27586,0.21053,0.4,0.7553,2.4216,0.48276,0.36842,0.7,0.7553,2.4216
57,0.85304,0.73158,0.81345,0.74841,0.89086,0.86108,0.32258,0.26316,0.41667,1.1351,1.4749,0.70968,0.57895,0.91667,1.1351,1.4749

Does he know how what to do with your data?

<rdf:Description rdf:about="http://purl.org/ontology/mo/mf/StructuralSegment">
<rdfs:subClassOf rdf:resource="http://purl.org/NET/c4dm/event.owl#Event"/>
</rdf:Description>
<mf:StructuralSegment rdf:about="features.n3s1">
<rdfs:label>Intro</rdfs:label>
<event:time>
<time:TimeInterval>
<timeline:onTimeLine rdf:resource="features.n3timeline"/>
<timeline:beginsAtDuration>PT0S</timeline:beginsAtDuration>
<timeline:durationXSD>PT10.43S</timeline:durationXSD>
</time:TimeInterval>
</event:time>
</mf:StructuralSegment>
<rdfs:label>First verse</rdfs:label>
<event:time>
<time:TimeInterval>
<timeline:beginsAtDuration>PT10.43S</timeline:beginsAtDuration>
</event:time>
<rdfs:label>First chorus</rdfs:label>
<event:time>
<time:TimeInterval>
</event:time>
<rdfs:label>Second verse</rdfs:label>
<event:time>
<time:TimeInterval>
<timeline:beginsAtDuration>PT1M1S</timeline:beginsAtDuration>
</event:time>
<rdfs:label>Second chorus</rdfs:label>
<event:time>
<time:TimeInterval>
<timeline:beginsAtDuration>PT1M21.5S</timeline:beginsAtDuration>
<timeline:durationXSD>PT30S</timeline:durationXSD>

What if your data looked like this:
</event:time>
<rdf:Description rdf:about="http://purl.org/ontology/mo/mf/KeyEvent">
<rdfs:subClassOf rdf:resource="http://purl.org/NET/c4dm/event.owl#Event"/>

Well, that's not actually much better, but
</rdf:Description>
<mf:KeyEvent rdf:about="features.n3k1">
<mf:key rdf:resource="http://purl.org/NET/c4dm/keys.owl#EMinor"/>
<event:time>
<time:TimeInterval>

enable


... the extra structure helps enable ...

tools


...the complexity to be hidden in tools

model


More speciﬁcally, by modelling the relationships and links
between all these disparate things, we make the tools cheap
and easy.

Foundations


Foundations

1. Domain-speciﬁc musicology
2. Domain-speciﬁc MIR tasks
3. Music-generic
4. High-level Relationships


Foundations

1. Domain-speciﬁc musicology: concepts,
in our use case, from musicology, and the
human interpretation of music and sound.


Domain-speciﬁc musicology concepts are elements of form, such as intro, verse, chorus,
bridge; sonata, minuet and trio, fugue. These are likely to be applied to sections of the
signal, for example “this section is a bridge”.
**Mythical music taxonomy**

Foundations

2. Domain-specific MIR tasks: parts of the
model that relate to an MIR task, such as
the elements extracted by a feature
extractor, common labels from a classifier,
or distance metrics.


Domain-specific MIR tasks encompass artifacts of the structural segmentation task, for
example a classifier might identify (and potentially label) sections that are similar; a contributor
task might identify chords. Again, these concepts are likely to be applied to sections of signal.

**Audio Feature ontology or related***

Foundations

3. Music-generic: common concepts that
transcend domain-speciﬁc such as
Intervals, Segments, etc.


Music-generic concepts are common to different tasks and applications. Here the segments would
be those annotated using the domain-speciﬁc concepts and the alignments and relationships
between them (e.g. the segment labelled as a chorus follows the segment labelled as a verse; that
one chord follows another).

Foundations

4. High-level Relationships: the absolute
and relative relationships between music
generic elements, TimeLines and SegmentLines;
and the maps between them.


Finally high-level relationships capture mappings between the musicologically
labelled segments and the MIR task derived segments. We expand upon this
example in Figure 6.

Foundations

1. Domain-speciﬁc musicology
2. Domain-speciﬁc MIR tasks
3. Music-generic
4. High-level Relationships


Our ontology will deal with 3 and 4 so 1 and 2 can interact more easily (hopefully. with tools.)

Ontology and approach



owl:
equivalent SubClassOf
tl:Interval Segment
Class

OWL-time:
tl:onTimeLine onSegmentLine
Interval
RatioMap
SubClassOf
e
tl:TimeLine SegmentLine

to from NonLinearMap
tl:domainTimeLine

SubClassOf isA
tl:TimeLineMap SegmentLineMap NonSequentialMap



owl:
tl:Interval Segment
Class

OWL-time:
Interval
RatioMap
SubClassOf
e

tl:domainTimeLine

SubClassOf isA


a tl Interval with the addition of a “label” expressing an association (SIM) that can be “placed” upon Time-
Lines (TL) and SegmentLines.


owl:
tl:Interval Segment
Class

OWL-time:
Interval
RatioMap
SubClassOf
e

tl:domainTimeLine

SubClassOf isA


SegmentLine: an AbstractTimeLine and a relative complement to the
temporal TimeLine.


owl:
tl:Interval Segment
Class

OWL-time:
Interval
RatioMap
SubClassOf
e

tl:domainTimeLine

SubClassOf isA


SegmentLineMap: a means to express a high-level relation- ship between
SegmentLines or with TimeLines; can imply relationships between Segments
on SegmentLines and TimeLines; similarly a SegmentLineMap can be used to
infer properties between Segments.


StartAtSegment
4/4Bar isA
ContainsSegment ContainsSegment Segment
Beat1 isA Beat2 isA beat3 isA Beat4 isA
EndAtSegment
sim:element !
Segment Segment Segment Segment
sim:element _:Similarity a _:Similarity a
sim:Similarity sim:Similarity
sim:element sim:element

Beat Bar Phrase Tadem
Mythical Music TS4/4 isA

!
Taxonomy SegmentLineMap


How about somethings (a bit) less abstract: 4 beats in 1 bar of 4/4
music.


StartAtSegment
4/4Bar isA
ContainsSegment ContainsSegment Segment
Beat1 isA Beat2 isA beat3 isA Beat4 isA
EndAtSegment
sim:element !
sim:element _:Similarity a _:Similarity a
sim:Similarity sim:Similarity
sim:element sim:element

Beat Bar Phrase Tadem
Mythical Music TS4/4 isA

!
Taxonomy SegmentLineMap


Red for MIR researcher [alice]
Green for Musicologist [bob]

Worked example


Worked example

Labelled structured segmentation
• Bob’s domain knowledge
• Alice’s MIR processes
• Mediated through the segment ontology


(you remember Alice and Bob, yes?)

Worked example
onSegmentLine SL1
isA SegmentLine
R
onSegmentLine
segmentAfter
S0 isA S1 isA S2 isA S3 isA tl:Interval
M a
segmentBefore
mo:Signal

mo:recordedAs
_:Similarity a _:Similarity a _:Similarity a
sim:Similarity sim:Similarity sim:Similarity

D
_:Similarity a _:Similarity a _:Similarity a _:Similarity a
sim:Similarity sim:Similarity sim:Similarity sim:Similarity

"Intro" "Verse" "Refrain"
a label a label a label
"Help"
segmentAfter mo:MusicalWork

Help Intro isA Help Verse1 Help Refrain Help Verse2
Segment isA Segment isA Segment isA Segment

segmentBefore

Intro Verse Refrain Bridge
Mythical Music
Taxonomy


help! I need somebody [to explain linked data]
help! Not just anybody [eloquent speaker prefered]
help! (etc...)
[explain the graph]

Worked example
onSegmentLine SL1
isA SegmentLine
R
onSegmentLine
segmentAfter
M a
segmentBefore
mo:Signal

mo:recordedAs

D

"Help"


segmentBefore

Mythical Music
Taxonomy


Alice’s domain-speciﬁc contribution

Worked example
onSegmentLine SL1
isA SegmentLine
R
onSegmentLine
segmentAfter
M a
segmentBefore
mo:Signal

mo:recordedAs

D

"Help"


segmentBefore

Mythical Music
Taxonomy


Bob’s domain speciﬁc contribution

Conclusions
• The link between MIR researcher and
musicologist user is critical, yet difﬁcult
• By moving complexing to a intermediary
tools to aid this link becomes cheap
• Make more tools!
• And the Mythical Music Taxonomy!


We have presented the Segment Ontology, that uniquely enables post-hoc integration across other datasets and
domain structures through a separation of concerns between segmentation, structure, and musical domains. The next
stage of our research is to deploy the ontology across the collections of ground truth and computational analysis
discussed in section 1, integrated as a part of a Linked Data API through which researchers can access, study, and
manipulate results. Completion of the Mythical Music Taxonomy is left as an exercise for the reader.

The End

Resources and more info:
http://www.linkedmusic.org/segment/
ISMIR Tutorial:
http://ismir2011.linkedmusic.org/


Questions?
Resources and more info:
http://www.linkedmusic.org/segment/
ISMIR Tutorial:
http://ismir2011.linkedmusic.org/
These slides:
http://slideshare.net/bﬁelds


Admire2011 slides

Recommandé

Recommandé

Contenu connexe

Dernier

Dernier (20)

Admire2011 slides