apidays LIVE Australia - Building distributed systems on the shoulders of giants by Dasith Wijesiriwardena

Building Distributed
Systems
On the Shoulders of Giants
Dasith Wijes

I am here because
I have a love hate relationship
with distributed systems.
HELLO
!I AM
Dasith Wijes
@dasiths
dasith.me

Modern technology landscape
Unique challenges of distributed
systems
Agenda
Azure Service Fabric
Distributed Application Runtime
(Dapr)Istio Service Mesh
Knative
Recap and Conclusion

Unique
Challenges of
Distributed Systems

var myService = new MyService();
var result = myService.GetProductPrice(“abc123”);

System running in single process
var myService = new MyService();
var result = myService.GetProductPrice(“abc123”);

// var myService = new MyService();
var myRestService = new MyRestService(“192.168.x.x”);
var result = myRestService.GetProductPrice(“abc123”);

System running distributed across multiple nodes
var myRestService = new MyRestService(“192.168.x.x”);

•Network is reliable
•Latency is zero
•Bandwidth is infinite
•Connection is secure
•Network is homogeneous
Did you assume?

•Service discovery
•Load balancing
•Fault tolerance and recovery
•Security
•Scalability
•Telemetry
What about…

““First Law of Distributed Object Design:
don't distribute your objects"

Looking at the
Modern Landscape

Istio Service Mesh
Pick Your Poison
Distributed Application Runtime (Dapr)
Knative

Distributed systems platform
that makes it easy to package,
deploy, and manage scalable
and reliable microservices
and containers.

Cloud On Premise Developer
Machine
Environments

Environments

• Reliable Services
• Stateful & Stateless
• Reliable Actors
• Persisted state options
• Guest Executables
• Containers
• ASP.NET Core
Programming Models

public interface IHelloWorld : IActor
{
Task<string> GetHelloWorldAsync();
}
Actor Example – C#
Interface

[StatePersistence(StatePersistence.Persisted)]
internal class HelloWorld : Actor, IHelloWorld
{
public HelloWorld(ActorService actorService, ActorId actorId)
: base(actorService, actorId)
{
}
public Task<string> GetHelloWorldAsync()
{
return Task.FromResult("Hello from my reliable actor!");
}
}
Actor Example – C#
Implementation

class Program
{
static void Main(string[] args)
{
IHelloWorld actor = ActorProxy.Create<IHelloWorld>(
ActorId.CreateRandom(),
new Uri("fabric:/MyApplication/HelloWorldActorService"));
Task<string> retval = actor.GetHelloWorldAsync();
Console.Write(retval.Result);
Console.ReadLine();
}
}
Actor Invocation – C#
Sample

class Program
{
static void Main(string[] args)
{
IHelloWorld actor = ActorProxy.Create<IHelloWorld>(
ActorId.CreateRandom(),
new Uri("fabric:/MyApplication/HelloWorldActorService"));
Task<string> retval = actor.GetHelloWorldAsync();
Console.Write(retval.Result);
Console.ReadLine();
}
}
Actor Invocation – C#
Sample
• Service discovery and
routing
• Availability
• Reliability
• Fault Tolerance
• Auto scaling

Portable, event-driven
runtime that makes it easy
for developers to build
resilient, microservice
stateless and stateful
applications that run on the
cloud and edge and embraces
the diversity of languages
and developer frameworks.

Building
Blocks
https://github.com/dapr/docs/tree/master/concepts

Component
s

• Service discovery
• State
• Pub/sub
• Bindings
• Middleware
• Secret stores
• Tracing exporters
Component
s
1 or
more

• State
• Pub/sub
• Bindings
• Middleware
• Secret stores
Some Pub/Sub
Implementations
• Redis Streams
• Kafka
• Azure Service Bus
• RabbitMQ
• Azure Event Hubs
• GCP Pub/Sub
• MQTT
https://github.com/dapr/components-
Pluggable
Implementations

• State
• Pub/sub
• Bindings
• Middleware
• Secret stores
Picking a Component
Implementation
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: messagebus
namespace: default
spec:
type: pubsub.redis
metadata:
- name: redisHost
value: <HOST>
- name: redisPassword
value: <PASSWORD>
- name: enableTLS
value: <bool>
pubsub.yaml (Redis
Streams )

• State
• Pub/sub
• Bindings
• Middleware
• Secret stores
Pub/Sub Interface
type PubSub interface {
Init(metadata Metadata) error
Publish(req *PublishRequest) error
Subscribe(req SubscribeRequest,
handler func(msg *NewMessage) error) error
}

Endpoints For Building
Blocks
Building Block Endpoint
Service-to-Service Invocation /v1.0/invoke
State Management /v1.0/state
Publish and Subscribe /v1.0/publish + /v1.0/subscribe
Resource Bindings /v1.0/bindings
Actors /v1.0/actors
Secrets /v1.0/secrets

Example – Node.js
App
app.post('/neworder', (req, res) => {
const data = req.body.data;
const orderId = data.orderId;
console.log("Got a new order! Order ID: " + orderId);
//todo: persist order
res.sendStatus(200);
});

Example – Node.js
App
app.post('/neworder', (req, res) => {
const data = req.body.data;
const orderId = data.orderId;
console.log("Got a new order! Order ID: " + orderId);
//todo: persist order
res.sendStatus(200);
});
dapr run --app-id nodeapp --app-port 3000 --dapr-http-port 3500 node app.js

Service Invocation –
Endpoint

Service Invocation –
Endpoint
http://localhost:3500/v1.0/invoke/nodeapp/method/neworder

Cont. Invocation of Node.js App from a Python
Appdapr_port = os.getenv("DAPR_HTTP_PORT", 3500)
dapr_url =
"http://localhost:{}/v1.0/invoke/nodeapp/method/neworder".format(dapr_port)
n = 0
while True:
n += 1
message = {"data": {"orderId": n}}
try:
response = requests.post(dapr_url, json=message)
except Exception as e:
print(e)
time.sleep(1)

Cont. Invocation of Node.js App from a Python
Appdapr_port = os.getenv("DAPR_HTTP_PORT", 3500)
dapr_url =
"http://localhost:{}/v1.0/invoke/nodeapp/method/neworder".format(dapr_port)
n = 0
while True:
n += 1
message = {"data": {"orderId": n}}
try:
response = requests.post(dapr_url, json=message)
except Exception as e:
print(e)
time.sleep(1)
• Service discovery and
routing
• mTLS
• Retry logic
• Tracing

Side-Car Process
https://cloudblogs.microsoft.com/opensource/2019/10/16/announcing-dapr-open-source-project-build-

Side-Car Container in Kubernetes
Pod
https://cloudblogs.microsoft.com/opensource/2019/10/16/announcing-dapr-open-source-project-build-

Dapr on
Kubernetes
https://itnext.io/simplifying-microservices-on-kubernetes-with-microsofts-dapr-distributed-application-runtime-9aece5723484
Dapr control-plane
components are deployed as
Kubernetes deployments.
Dapr can be easily initialized
on the Kubernetes cluster
using Dapr-CLI or can be
deployed using Helm.
• dapr-operator: Watches for creation,
deletion and updating events of services.
• dapr-sidecar-injector: Injects a Dapr sidecar
to all the services.
• dapr-placement: Connects all the Dapr
sidecars and adds the IP address to route
the communication.

https://github.com/dapr/docs/tree/master/overview

Istio Service Mesh to
Connect, secure, control, and
observe services.
Istio provides behavioural
insights and operational
control over the service
mesh as a whole, offering a
complete solution to satisfy
the diverse requirements of
microservice applications.
Istio Service
Mesh

https://tud-ccc.github.io/yauhau-doc/
Why Do We Need a Service
Mesh?

Istio Service
MeshA
Primer
https://istio.io/latest/docs/ops/deployment/architecture/
• Istiod provides service
discovery,
configuration and
certificate
management.
• Envoy proxies are
deployed as sidecars
to services, logically
augmenting the
services with Envoy’s
many built-in features.

• Developers can focus on adding business value, instead of
connecting services.
• Apps are more resilient to downtime, since a service mesh can
reroute requests away from failed services.
• Performance metrics can suggest ways to optimize communication
Istio Service
MeshElevator
Pitch
https://www.redhat.com/en/topics/microservices/what-is-a-service-mesh

Istio Service
MeshElevator
Pitch
var myRestService = new MyRestService(“svc1.ns.local”);

Istio Service
MeshElevator
Pitch
var myRestService = new MyRestService(“svc1.ns.local”);
• Dynamic service
discovery
• Load balancing
• TLS termination
• HTTP/2 and gRPC

Kubernetes-based platform
to deploy and manage
modern serverless
workloads.
Knative components builds
on top of Kubernetes,
abstracting away the
complex details and
enabling developers to focus
on what matters.
Knative

Knative
• Focused API with higher level abstractions for common app
use-cases.
• Stand up a scalable, secure, stateless service in seconds.
• Knative is portable: run it anywhere Kubernetes runs, never
worry about vendor lock-in.
• Idiomatic developer experience, supporting common patterns
such as GitOps, DockerOps, ManualOps.
https://knative.dev/
Elevator
Pitch

Knative
apiVersion: serving.knative.dev/v1 # Current version of Knative
kind: Service
metadata:
name: helloworld-go # The name of the app
namespace: default # The namespace the app will use
spec:
template:
spec:
containers:
- image: gcr.io/knative-samples/helloworld-go # Reference to the app image
env:
- name: TARGET # The environment variable printed out by the sample app
value: "Go Sample v1"
Sample Configuration -
service.yaml

Knative
Sample - Deploy
# To Deploy services.yaml
kubectl apply --filename service.yaml

Knative
Sample - Deploy
# To Invoke
curl http://helloworld-go.default.svc.cluster.local

Knative
Sample - Deploy
# To Invoke
Hello World: Go Sample v1!

Knative
Sample - Deploy
# To Invoke
Hello World: Go Sample v1!
• Routing
• Load balancing
• TLS termination
• Blue/green
deployments

Service Fabric Dapr Istio Knative
• Distributed
systems platform.
• Any cloud, any
vendor.
• Orchestrate
containers or
executables.
• Windows or Linux
clusters.*
• Small community
• Opinionated
programming
model.
• Support for many
languages and
frameworks.
• Extensible
components.
• Runs as side-car.
• Native support for
• Service mesh with
focus on routing.
• Doesn’t enforce
programming
model.
• Fits nicely with
existing container
workloads.
• Serverless model.
• Developer
productivity.
• Higher level
abstraction of K8s.
• Easily configurable
smart scaling.
Recap

STAND ON
THE
SHOULDE
RS OF
GIANTSWhy reinvent the wheel?

Any questions?
THANKS!
@dasiths
dasith.me
https://www.nationalgeographic.com/travel/destinations
/asia/sri-lanka/

Presentation template designed by powerpointify.com
Special thanks to all people who made and shared these awesome
resources for free:
CREDIT
S
Photographs by unsplash.com
Free Fonts used:
https://www.fontsquirrel.com/fonts/oswald

apidays LIVE Australia - Building distributed systems on the shoulders of giants by Dasith Wijesiriwardena

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to apidays LIVE Australia - Building distributed systems on the shoulders of giants by Dasith Wijesiriwardena

Similar to apidays LIVE Australia - Building distributed systems on the shoulders of giants by Dasith Wijesiriwardena (20)

More from apidays

More from apidays (20)

Recently uploaded

Recently uploaded (20)

apidays LIVE Australia - Building distributed systems on the shoulders of giants by Dasith Wijesiriwardena