I'm covering a new trend in distributed enterprise architecture – microservices. How the leading technology companies like Netflix and Amazon come to use that approach. How does it help them to scale their infrastructure. And how the newest set of tools in the Spring family would help you to apply those design principles in practice. Spring has always been about patterns and Spring Cloud brings you implementation of several widespread ones for distributed apps. And we'll try to show why DevOps should come in front of Microservices approach

1. Spring Cloud
For Microservices Architecture
Igor Khotin
E-mail: khotin@gmx.com

2. Background
● 15+ years in the IT industry
● 10+ years with Java
● Flexible design promoter
● Agile-junkie
Deploying...
After deployment

3. Microservices
Spring Cloud
DevOps

4. Monolith

5. Monolith
One code base, deployed and scaled as a single unit

6. ●
Traditional approach
●
Easy to deploy
Monolithic .war

7. ●
Traditional approach
●
Easy to deploy
●
Availability challenges
●
Hard to scale
●
Centralized release cycle
●
Single Responsibility Principle?
Monolithic .war

8. Infrastructure as a Service

9. Platform as a Service

10. Components

12. Microservice
Small independent component
with well-defined boundaries
that's doing one thing, but doing it well

13. Microservice
Small independent component
with well-defined boundaries
that's doing one thing, but doing it well

14. Microservice
Small independent component
with well-defined boundaries
that's doing one thing, but doing it well

15. Archipelago

18. UNIX Tools

19. It's like UNIX pipes all over again!

20. ●
Best set of tools for each service
●
Inherently loosely coupled
●
Reduced time to market
●
Parallel development
●
Independent and frequent releases
●
Designed to scale
Benefits

21. ●
Distributed are inherently hard
●
Significant operation overhead
●
Service discovery
●
Redundancy
●
Loadbalancing
●
Performance penalty
●
Requires DevOps skills
Challenges

22. Protocol Epoch

23. Microservices
Spring Cloud
DevOps

26. Spring Cloud Promise
It is easy to develop and deploy
JVM application for the cloud

27. Not a single tool

28. Not a single tool

31. Spring Cloud Patterns
● Configuration management
● Service discovery
● Circuit breakers
● Intelligent routing
● Control bus
● Global lock
● Leadership election
● One-time tokens
● Distributed Sessions
● ...

32. @RestController
class ItActuallyWorks {
@RequestMapping(“/”)
String home() {
“Hello Spring Boot!”
}
}
Spring Boot

33. Annotation-driven
@SpringBootApplication
@EnableCircuitBreaker
@EnableDiscoveryClient
public class App extends RepositoryRestMvcConfiguration {
@Override
protected void configure(RepositoryRestConfiguration config) {
config.exposeIdsFor(Customer.class);
}
public static void main(String[] args) {
SpringApplication.run(CustomerApp.class, args);
}
}

34. Annotation-driven
@Autowired(required = false)
DataSource dataSource;
@Autowired(required = false)
RedisConnectionFactory rcf;
@Autowired(required = false)
MongoDbFactory mongoDbFactory;
@Autowired(required = false)
ConnectionFactory rbcf;

35. Config Server
@Configuration
@EnableAutoConfiguration
@EnableDiscoveryClient
@EnableConfigServer
public class ConfigServerApplication {
public static void main(String[] args) {
SpringApplication
.run(ConfigServerApplication.class,
args);
}
}

36. Config Server with Git Backend

37. RESTful Configs
/{application}/{profile}[/{label}]
/{application}-{profile}.yml
/{label}/{application}-{profile}.yml
/{application}-{profile}.properties
/{label}/{application}-{profile}.properties

39. Service Discovery: Eureka Server
@SpringBootApplication
@EnableEurekaServer
public class Application {
public static void main(String[] args) {
SpringApplication.run(Application.class, args);
}
}

40. Service Discovery: Eureka Server
server:
port: ${PORT:8761}
eureka:
client:
registerWithEureka: false
fetchRegistry: false
server:
waitTimeInMsWhenSyncEmpty: 0

41. Service Discovery: Eureka Server
src/main/resources/bootstrap.yml
spring:
application:
name: my-service

42. @Autowired
private DiscoveryClient discoveryClient;
@Override
public void listMyServiceInstances {
discoveryClient.getInstances("my-service")
.forEach((ServiceInstance s) -> {
System.out.println(
ToStringBuilder.reflectionToString(s));
});
}
Service Discovery: Eureka Server

43. Service Discovery: Eureka Server

44. Discovery
● Apache ZooKeeper
● Consul
● Eureka

45. Discovery
● Apache ZooKeeper - CP
● Consul
● Eureka

46. Discovery
● Apache ZooKeeper - CP
● Consul - CP, DNS
● Eureka

47. Discovery
● Apache ZooKeeper - CP
● Consul - CP, DNS
● Eureka - AP

48. Circuit Breaker: Hystrix Client
● Fault tolerance
● Isolate service access
● Prevent cascading failures
● Dashboard

49. Circuit Breaker: Hystrix Client
@SpringBootApplication
@EnableCircuitBreaker
public class Application {
public static void main(String[] args) {
new
SpringApplicationBuilder(Application.class)
.web(true).run(args);
}
}

50. Circuit Breaker: Hystrix Client
@Component
public class Processing {
@HystrixCommand(fallbackMethod = "defaultValue")
public Object doIt(Map<String, Object> args) {
// do stuff that might fail...
}
public Object default(Map<String, Object>args) {
return someUsefulDefaults;
}
}

51. Circuit Breaker: Hystrix Client

52. Circuit Breaker: Hystrix Client

53. Circuit Breaker: Hystrix Client

54. Circuit Breaker: Hystrix Client

55. Circuit Breaker: Hystrix Client

56. Hystrix Dashboard

57. Zuul – The Gatekeeper

59. Write
Spring Cloud

60. Read
Spring Tools for Microservices
Integration

61. Spring Cloud Future
● More services
● Elasticsearch
● Memcache
● Cassandra
● Neo4j
● ...
● More cloud platforms

62. Microservices
Spring Cloud
DevOps

63. ●
100s of services
●
Wide range of tech
●
Legacy apps
Our distributed infrastructure

64. ●
Wide choice of PaaS providers
●
No DevOps team
●
Lack of DevOps experience
●
No established processes
●
...
Challenges

65. Moving to the cloud in small steps

66. Monitor Everything...

68. Chaos Monkey Factor

69. Our DevOps are the key operations
DevOps Team

70. Choose the tools you need for the job
Spring Cloud

71. Choose the tools you need for the job
But it doesn't do Continuous Delivery by itself
Spring Cloud

73. Trends in the Cloud
● Rise and Fall of PaaS providers
● New Tools
● Tools Consolidation
● Shifts in development model
● DevOps at the epicenter

74. Resources
● http://projects.spring.io/spring-cloud/
● http://martinfowler.com
● http://techblog.netflix.com
● The UNIX Philosophy by Mike Gancarz
● The Art of UNIX Programming by Eric Raymond
● The UNIX Programming Environment
by Brian W. Kernighan and Rob Pike

76. Questions?
Igor Khotin
E-mail: khotin@gmx.com
Blog: www.ikhotin.com
Twitter: chaostarter