The slides of the try out of my new talk "CQRS & event sourcing in the wild" - held at PHP Amersfoort in September 2016. CQRS & event sourcing are currently very popular topics in the PHP community. However, most blogs and talks focus on the theory, simple applications or introductions to one of the CQRS / event sourcing frameworks currently available for PHP, not necessarily the challenges of a production deployment. In this session we will try to bridge that gap and look at some of the issues that popped up during a real-world deployment of an event sourced application. We’ll discuss a few strategies to deal with these issues and how they would apply to current PHP event sourcing frameworks.

1. CQRS & EVENT SOURCING
IN THE WILD
MICHIEL ROOK

2. ➤ Java, PHP & Scala
developer
➤ Consultant, trainer,
speaker
➤ Dutch Web Alliance
➤ make.io
➤ Maintainer of Phing
➤ @michieltcs

3. YOU

4. RAISE YOUR HAND
IF YOU HAVE

5. heard about CQRS / Event Sourcing
RAISE YOUR HAND
IF YOU HAVE

6. heard about CQRS / Event Sourcing
followed a tutorial, built a hobby project
RAISE YOUR HAND
IF YOU HAVE

7. heard about CQRS / Event Sourcing
followed a tutorial, built a hobby project
used it in production
RAISE YOUR HAND
IF YOU HAVE

8. TOPICS
➤ Quick recap
➤ Replays and rebuilds
➤ Event versioning
➤ Concurrency
➤ Scale

9. QUICK RECAP

10. ' Event Sourcing ensures that all
changes to application state are stored
as a sequence of events.
-Martin Fowler

11. ACTIVE RECORD VS. EVENT SOURCING
Account
number
Balance
12345678 €€ 50,00
... ...
Money Withdrawn
Account number 12345678
Amount €€ 50,00
Money Deposited
Account number 12345678
Amount €€ 100,00
Account Created
Account number 12345678

12. COMMANDS TO EVENTS
Deposit Money
Account number 12345678
Amount €€ 100,00
Money Deposited
Account number 12345678
Amount €€ 100,00
class DepositMoney {
public $accountNumber;
public $amount;
}
class MoneyDeposited {
public $accountNumber;
public $amount;
public $timestamp;
}
function depositMoney(DepositMoney $command) {
$this->apply(new MoneyDeposited($command->accountNumber,
$command->amount, date()));
}

13. AGGREGATES
class BankAccount {
public $accountNumber;
public $balance;
// command handlers...
public function applyAccountCreated(AccountCreated $event) {
$this->accountNumber = $event->accountNumber;
$this->balance = 0;
}
public function applyMoneyDeposited(MoneyDeposited $event) {
$this->balance += $event->amount;
}
public function applyMoneyWithdrawn(MoneyWithdrawn $event) {
$this->balance -= $event->amount;
}
}

14. AGGREGATE STATE
Account
number
Balance
12345678 €€ 0,00
Money Withdrawn
Account number 12345678
Amount €€ 50,00
Money Deposited
Account number 12345678
Amount €€ 100,00
Account Created
Account number 56789012
Account
number
Balance
12345678 €€ 100,00
Account
number
Balance
12345678 €€ 50,00

15. CQRS
➤ Command Query Responsibility Segregation
➤ Separate writes (events) and reads (UI)
➤ Optimize for reads!

16. Domain
Event Bus
Event Handlers
Command
Repository
Data Layer
Database Database
Event
Store
commands
events
events
queries DTOs
Aggregates

17. PROS AND CONS
➤ Domain fit
➤ Testing
➤ Audit trail
➤ Scalability
➤ Complexity
➤ Library support / maturity

18. DISCLAIMER

19. REPLAYS AND REBUILDS

20. PROJECTIONS AND READ MODELS
User Registered
User Registered
User Unregistered Number of active users?

21. PROJECTIONS AND READ MODELS
User Registered
User Deactivated
User Reactivated
Number of active users?
User Registered
User Unregistered

22. PROJECTIONS AND READ MODELS
User Registered Event Handler
Number of
active users
+1
User Unregistered Event Handler
Number of
active users
-1

23. PROJECTIONS AND READ MODELS
Events Event Handler(s) Storage

24. ELASTICSEARCH
class CompanyRegistered {
public $companyId;
public $name;
public $street;
public $city;
}
function handleCompanyRegistered(CompanyRegistered $event) {
$this->elasticsearch->index([
'index' => 'companies',
'type' => 'company',
'id' => $event->companyId,
'body' => [
'name' => $event->name,
'address' => [
'street' => $event->street,
'city' => $event->city
]
]
]);
}

25. READ MODEL UPDATES
➤ New type
➤ New structure
➤ Based on existing events
➤ Generate from scratch?

26. REBUILDING
Stop
application
Remove
old read
model
Loop over
events
Apply to
read model
Start
application

27. ZERO DOWNTIME
Loop over
existing
events
Apply to
new read
model
Apply
queued
events
Start using
new read
model
New events Queue

28. ELASTICSEARCH: MAPPING CHANGE
Create
index with
new
mapping
Reindex
existing
documents
Apply
queued
events
Start using
new index
New events Queue

29. CHALLENGE: LONG RUNNING REBUILDS
➤ Alternatives
➤ Distributed
➤ In memory
➤ Partial
➤ Background

30. CHALLENGE: SIDE EFFECTS
User Registered
User Id 123abc
Email Address test@example.net
Event Handler
Exclude during replays!

31. CHALLENGE: TRANSACTIONS
Event Handler
Event Handler
Event
Event Handler
Event Handler ?

32. CHALLENGE: EVENTUAL CONSISTENCY
➤ Asynchronous event handlers
➤ Reads eventually return the same value
➤ Compare with ACID

33. EVENT VERSIONING

34. DILEMMA
➤ New business requirements
➤ Refactoring
➤ New view on events

35. NEW EVENTS / VERSIONS
➤ No longer relevant
➤ Renamed
➤ Additional or renamed field(s)
➤ Too coarse, too fine

36. SUPPORT YOUR LEGACY?
➤ Events are immutable
➤ Correct (incorrect) old events with new events

37. UPCASTING
Event Store
UserRegistered_V1
Upcaster
UserRegistered_V2
Event Handler

38. UPCASTING
class UserRegistered_V1 {
public $userId;
public $name;
public $timestamp;
}
class UserRegistered_V2 {
public $userId;
public $name;
public $date;
}
function upcast($event): array {
if (!$event instanceof UserRegistered_V1) {
return [];
}
return [
new UserRegistered_V2($event->userId, $event->name,
$event->timestamp->format("Y-m-d"))
];
}

39. REWRITING HISTORY
Load (subset of) events
Deserialize
Modify
Serialize
Save/replace

40. THINGS TO BE AWARE OF
Upcasting
➤ Performance
➤ Complexity
➤ Existing projections not
automatically updated
Rewriting events
➤ Running code that
depends on old structure
➤ Breaking serialization
➤ Changing wrong events

41. CONCURRENCY

42. CONCURRENT COMMANDS
Withdraw Money
Account number 12345678
Amount €€ 50,00
Deposit Money
Account number 12345678
Amount €€ 100,00
?

43. PESSIMISTIC LOCKING
Withdraw Money
Account number 12345678
Amount €€ 50,00
Deposit Money
Account number 12345678
Amount €€ 100,00
Account
number
Balance
12345678 €€ 100,00
Account
number
Balance
12345678 €€ 50,00
wait for lock
lock

44. OPTIMISTIC LOCKING
Withdraw Money
Account number 12345678
Amount €€ 50,00
version 1
Deposit Money
Account number 12345678
Amount €€ 100,00
version 1
Account
number
Balance
12345678 €€ 100,00
version 2
ConcurrencyException

45. SCALE

46. PERFORMANCE
➤ Server
➤ Database
➤ Framework
➤ Language

47. STORAGE
➤ #events
➤ #aggregates
➤ #events_per_aggregate
➤ Serializer
➤ Speed
➤ Payload size
➤ Costs

48. SNAPSHOTS
Events
1 Account Created
2 Money Deposited
3 Money Withdrawn
4 Money Deposited
SNAPSHOT
5 Money Withdrawn
Events
1 Account Created
2 Money Deposited
3 Money Withdrawn
4 Money Deposited
5 Money Withdrawn

49. SHARDING
➤ Aggregate Id, Type, Event Timestamp, ...
➤ Rebalancing
➤ Distribution

50. ARCHIVING EVENTS
➤ Reduce working set
➤ Inactive / deleted aggregates
➤ Historic / irrelevant events
➤ Cheaper storage

51. FRAMEWORK COMPARISON
Framework Upcasting Snapshots Replaying
Broadway
(PHP)
No (PR) No (PR) Not in core
Prooph
(PHP)
MessageFactory
Yes, triggers on
event count
Example code,
off line
Axon
(Java/Scala)
Upcaster /
UpcasterChain
Yes, triggers on
event count
Yes,
ReplayingCluster
Akka
Persistence
(Java/Scala)
Event Adapter
Yes, decided by
actor
Yes

52. BROADWAY VS PROOPH
class TodoItem extends EventSourcedAggregateRoot {
private $itemId;
public function __construct(PostTodo $command) {
$this->apply(new TodoPosted($command->getItemId()));
}
public function getAggregateRootId()
{
return $this->itemId;
}
public function applyTodoPosted(TodoPosted $event) {
echo "Posted: " . $event->getItemId() . "n";
}
}

53. BROADWAY VS PROOPH
class TodoItem extends AggregateRoot {
private $itemId;
public function __construct(PostTodo $command) {
$this->recordThat(new TodoPosted($command->getItemId()));
}
protected function aggregateId() {
return $this->itemId;
}
public function whenTodoPosted(TodoPosted $event) {
echo "Posted: " . $event->getItemId() . "n";
}
}

54. THANK YOU!