The document discusses the SPECIAL-K architecture for managing personal data processing and consent, which aims to allow users to control their personal data processing and consent through features like logging consent management and processing activities. It describes the building blocks of the architecture including authentication, consent management, transparency, compliance checking and logging. The architecture also utilizes Apache Kafka as a distributed streaming platform to minimize coupling between components and enable real-time data processing.

1. Big Data
Policy Engine
Uroš Milošević | TenForce
BDVe Webinar, 28 Nov 2019

2. SPECIAL-K Architecture | Objectives
• Allow users to manage their own consent
• Control personal data processing
• Low impact access
• Relatively large volumes of consent
• Fast compliance checks
• Historical logging of consent management
• Historical logging of processing activities

3. SPECIAL-K Architecture | Building blocks
• Authentication & Authorization
• Consent management backend
• Transparency and compliance backend
• Logging
• Compliance engine
• Personal data inventory
• Personal data gateway

4. Apache Kafka
• Distributed streaming platform
• Fault-tolerant, append-only log
• Can act as a buffer
• Minimizes coupling between architecture components
• Enables real-time data processing

6. {
"simplePolicies": [
{
"data": "http://www.specialprivacy.eu/vocabs/data#Location",
"processing": "http://www.specialprivacy.eu/langs/usage-policy#AnyProcessing",
"purpose": "http://www.specialprivacy.eu/langs/usage-policy#EventRecommendations",
"recipient": "http://www.specialprivacy.eu/langs/usage-policy#AnyRecipient",
"storage": "http://www.specialprivacy.eu/langs/usage-policy#AnyDuration"
},
{
"data": "http://www.specialprivacy.eu/vocabs/data#AnyData",
"processing": "http://www.specialprivacy.eu/langs/usage-policy#AnyProcessing",
"purpose": "http://www.specialprivacy.eu/langs/usage-policy#Charity",
"recipient": "http://www.specialprivacy.eu/langs/usage-policy#AnyRecipient",
"storage": "http://www.specialprivacy.eu/langs/usage-policy#AnyDuration"
}
]
}

8. {
"timestamp": 1524223395245,
"process": "send-invoice",
"purpose": "http://www.specialprivacy.eu/vocabs/purposes#Payment",
"processing": "http://www.specialprivacy.eu/vocabs/processing#Move",
"recipient": "http://www.specialprivacy.eu/langs/usage-policy#AnyRecipient",
"storage": "http://www.specialprivacy.eu/vocabs/locations#ControllerServers",
"userID": "49d40b22-4337-4652-b463-41b1c23c6b08",
"data": "http://www.specialprivacy.eu/vocabs/data#OnlineActivity"
}

13. Personal Data Inventory
• AI-driven personal
data discovery
• Structured and
unstructured data
• Graph-based
• Identity-aware

14. DATA
DATA SUBJECT