NissanConnect System Architecture and Microservices Implementation

(C) Copyright NISSAN MOTOR CO., LTD. 2019 All rights reserved.
, . 8 1/ L C
9 2 88 9 2 8 0
/ 8 1 /1 DBL
. 1 8 .
, . 8 8 8 0

n Java 20
Swing UI )
n
Java
n 2019 4
&
n
2

(C) Copyright NISSAN MOTOR CO., LTD. 2019 All rights reserved. 3
e ea N 1
C
..
5
c 4 N3 2

e ea N 1
C
..
5
c 4 N3 2

n “CASE”
– C (Connected)
– A (Autonomous)
– S (Shared & Services)
– E (Electric)

https://www3.nissan.co.jp/connect/service_skyline/service.html

n
n to
n
n
n push
n
n
n
7
https://www3.nissan.co.jp/connect/service_skyline/service.html

https://www.amazon.co.jp/NISSAN-MOTOR-CO-LTD-LEAF/dp/B074KCT1SY
• EV
Alexa Skill
•
Alexa

https://play.google.com/store/apps/details?id=com.aqsmartphone.android.nissan_jp
•
• EV(Electric Vehicle)
EV
• NissanConnect

https://play.google.com/store/apps/details?id=jp.co.nissan.nissanconnect.ice
•
• ICE(Internal
Combustion Engine)
ICE
• NissanConnect (

n Web
n
n
11

n
–
–
– (E2E )
nWeb
–
– validation
12

e ea N 1
C
..
5
c 4 N3 2

System Overview (End to End)
14
Car GatewayService Layer Backends
(IS/IT) Telematics Service Provider

System Overview (Cloud)
15
Car Gateway
GenX
Alliance Service Layer
Backends
( Alliance Platform)
Nissan Service Layer
Backends
Nissan Backend For
Frontend
Car Gateway
GenY
Car Gateway
abstraction
IS/IT TSP
Integration

16
Car Gateway
GenX
Backends
Backends
Nissan Backend For
Frontend
Car Gateway
GenY
Car Gateway
abstraction
IS/IT TSP
Integration
SpringSpring
Spring

17
Car Gateway
GenX
Backends
Backends
Nissan Backend For
Frontend
Car Gateway
GenY
Car Gateway
abstraction
IS/IT TSP
Integration
SpringSpring
Spring

n PaaS
–Microsoft Azure(VM, Database, Monitor, CosmosDB)
–Pivotal Cloud Foundry( PCF)
–RabbitMQ
–Jenkins(Build, Unit Test, Code Check, Deployment…)
n Framework
–Java/Spring Boot
–Node.js/Express
18

Spring
nSpring Boot(Web, JPDA, Redis, RabbitMQ, Security, Actuator)
nSpring Cloud Sleuth
nSpring Cloud Stream
nSpring Cloud Netflix Zuul
nSpring Cloud Config, Spring Cloud Bus( )
nSpring Cloud Circuit Breaker( RC)
19

e ea N 1
C
..
5
c 4 N3 2

NissanConnect
n
– NissanConnect
–
21

NissanConnect ( )
n
–Alliance Platform
–
–NissanConnect EV
23

NissanConnect ( )
n
– Car Gateway Alliance Platform
–Java / Spring Boot
24

NissanConnect ( )
25
Alliance Platform
(many microservices)
Car Gateway
AdaptationModule
Platform Spring Boot Microservices
Car Gateway
EV

NissanConnect ( )
n
–NissanConnect EV Alliance Platform
– CarGateway Alliance Platform
• contribution
• Car Gateway
• breaking change
26

NissanConnect ( )
n
–
–NissanConnect EV
– ( IS/IT ) Integration
– Car Gateway
28

NissanConnect ( )
n
– IS/IT Integration
–Java / Spring Boot
–
–Alliance Platform (bug, breaking change…)
29

NissanConnect ( )
30
Alliance Platform
(many microservices)
Car Gateway
ICE
Nissan Backend
(monolith)
Zuul Proxy
IS/IT
Rest API
Global Zuul Proxy Integration Spring Web
/alliance proxy Spring Web /nissan

NissanConnect ( )
31
IS/IT
Spring Boot Application
HandlerIntercepter Spring Web Controller
ZuulFilter Zuul Proxy
Spring Web
Zuul

NissanConnect ( )
n
– IS/IT backend
– Spring Boot
• Alliance Platform Zuul Proxy
• API Spring Web
32

Spring Cloud Netflix Zuul
n
–
– API Gateway
– https://cloud.spring.io/spring-cloud-netflix/reference/html/#router-and-filter-zuul
n Maven dependency
n application.properties
33
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-starter-netflix-zuul</artifactId>
</dependency>
#
zuul.routes.foo.path=/alliance/foo/v1/**
#
zuul.routes.foo.url=${foo.domain}/v1/**

n Spring Web Spring Cloud Netflix Zuul
n Timeout
34
@EnableZuulProxy // Zuul Proxy
@SpringBootApplication
public class Application {
public static void main(String[] args) {
SpringApplication.run(Application.class, args);
}
}
zuul.host.connect-timeout-millis=5000
zuul.host.socket-timeout-millis=65000

n
– ZuulFilter ErrorController
– “filterZuulException”
35
@RestController
public class ZuulErrorController extends AbstractErrorController {
@Value("${error.path:/error}")
private String errorPath;
@Override
public String getErrorPath() {
return errorPath;
}
@RequestMapping(value = "${error.path:/error}", produces = "application/vnd.api+json;charset=UTF-8")
public ResponseEntity error(HttpServletRequest request) {

n
36
@Component
public class AllianceErrorFilter extends ZuulFilter {
@Override
public String filterType() {
return "post";
}
@Override
public boolean shouldFilter() {
RequestContext ctx = RequestContext.getCurrentContext();
if(ctx.getRequest().getRequestURI().contains("/alliance") && ctx.getResponse().getStatus() != 200) {
return true;
}
return false;
}
@Override
public Object run() {

NissanConnect ( )
n
–
–
38

NissanConnect ( )
n
–
–
– done →PJ
39

NissanConnect ( )
40
Alliance Platform
(many microservices) Car Gateway
Nissan
Backend For Frontend (BFF)
Backends
(divided as microservice)
Nissan Backend
(monolith)
ICE
PJ
IS/IT
backend PJ
microservice Spring Boot
API Gateway Backend For Frontend( BFF)
PJ

NissanConnect ( )
n
– Backend For Frontend
– Microservice
–
–
41

NissanConnect ( )
n
–
–
– Alliance Platform
• Alliance Platform
43

NissanConnect ( )
n
– backend
• IS/IT
• Deploy
• ( RR )
–Microservices
•
•
44

Backends
(divided as microservice)
Nissan
NissanConnect ( )
45
Alliance Platform
(many microservices) Car Gateway
Nissan
Nissan
Backend for IS/IT
ICE
PJ
IS/IT
Backend
IS/IT BFF
ICE BFF

NissanConnect ( )
n
– RR Microservice
–
–Microservice
• Spring Cloud Config
• Spring Cloud Circuit Breaker + Rejilience4J
46

n
n
n
47

e ea N 1
C
..
48
5
c 4 N3 2

n
– Microservices
–
•
•
• (on going)
• PCF / Spring Boot Actuator
49

n
– Spring Boot slf4j + logback
– Spring Boot Profile
– Profile logback-spring.xml
n
–
•
• ( 1 )
– Azure Log Analytics
• JSON
• 1 ( 1 )
50

n logback-spring.xml
– logback.xml
– springProfile Profile
51
<?xml version="1.0"?>
<configuration>
<springProfile name = "prod">

</springProfile>
<springProfile name="!(prod | local)">
<!– prod, local -->
</springProfile>
<springProfile name="local">
<!– local -->
</springProfile>
</configuration>

n Microservice
52

n Microservice
53
HTTP
HTTP
ServletFilter AutoConfiguration
HTTP
HTTP
RestTemplate ClientInterceptor AutoConfiguration
RabbitMQ RabbitTemplate Aspect AutoConfiguration
RabbitMQ SimpleRabbitListenerContainerFactory
Advice
RabbitListener
JavaConfig

n
– Microservice
– Spring Cloud Sleuth
– https://cloud.spring.io/spring-cloud-static/spring-cloud-sleuth/2.2.0.RELEASE/reference/html/
n Maven dependency
n Sample (logging)
– traceId: The ID of the latency graph that contains the span. ( )
– spanId: The ID of a specific operation that took place. ( )
54
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-starter-sleuth</artifactId>
</dependency>
2019-12-18 14:30:56.901 INFO [bar,6bfd228dc00d216b,6bfd228dc00d216b,false] 23031 --- [nio-8081-exec-3] ...
2019-12-18 14:30:59.373 ERROR [bar,6bfd228dc00d216b,6bfd228dc00d216b,false] 23031 --- [nio-8081-exec-3] ...
2016-12-18 14:31:02.939 INFO [bar,46ab0d418373cbc9,46ab0d418373cbc9,false] 23031 --- [nio-8081-exec-4] ...

n
– Azure Monitor
• Top10
–
• micrometer(https://micrometer.io/)
• Microsoft app insight(Alliance Platform )

PCF / Spring Boot Actuator
n
– PCF deploy Spring Boot Spring Boot Actuator PCF App Manager UI
–
– PCF /cloudfoundryapplication
– /${service-context}/actuator/${endpoint} PCF
n
– https://docs.spring.io/spring-boot/docs/current/reference/html/production-ready-features.html
– https://docs.pivotal.io/platform/application-service/2-7/console/spring-boot-actuators.html
56

n Tips
– spring-boot-maven-plugin build-info target jar
– PCF App Manager UI deploy
57
<build>
<plugins>
<plugin>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-maven-plugin</artifactId>
<version>1.4.2.RELEASE</version>
<executions>
<execution>
<goals>
<goal>build-info</goal> <!– -->
</goals>
</execution>
</executions>
</plugin>
</plugins>
</build>

n Tips
– Deploy Spring Boot Servlet Context /cloudfoundryapplication servlet context
– https://docs.spring.io/spring-boot/docs/current/reference/html/production-ready-features.html#production-ready-cloudfoundry
58
@Bean
public TomcatServletWebServerFactory servletWebServerFactory() {
return new TomcatServletWebServerFactory() {
@Override
protected void prepareContext(Host host, ServletContextInitializer[] initializers) {
super.prepareContext(host, initializers);
StandardContext child = new StandardContext();
child.addLifecycleListener(new Tomcat.FixContextListener());
child.setPath("/cloudfoundryapplication");
ServletContainerInitializer initializer =
getServletContextInitializer(getContextPath());
child.addServletContainerInitializer(initializer, Collections.emptySet());
child.setCrossContext(true);
host.addChild(child);
}
};
}
private ServletContainerInitializer getServletContextInitializer(String contextPath) {
return (c, context) -> {
Servlet servlet = new GenericServlet() {
@Override
public void service(ServletRequest req, ServletResponse res) throws ServletException,
IOException {
ServletContext context = req.getServletContext().getContext(contextPath);
context.getRequestDispatcher("/cloudfoundryapplication").forward(req, res);
}
};
context.addServlet("cloudfoundry", servlet).addMapping("/*");
};
}

n
n
n PCF + Actuator
59

e ea N 1
C
..
60
5
c 4 N3 2

n
– Microservices Microservice
–
61

Auto Reconfiguration by Java Buildpack
n
–Spring Boot PCF deploy DB Datasource
– Spring Boot
62

Auto Reconfiguration by Java Buildpack
63
@Profile("cloud")
@Configuration
public class CloudFoundryConfig {
@Bean
public Cloud cloud() {
return new CloudFactory().getCloud();
}
@Bean
@ConfigurationProperties(prefix = "spring.datasource")
public DataSource dataSource() {
DataSource ds = cloud().getSingletonServiceConnector(DataSource.class, null);
return (ds instanceof DelegatingDataSource) ? ((DelegatingDataSource) ds).getTargetDataSource() : ds;
}
}
n
– Java Buildpack Auto Reconfiguration Datasource
– Cloud JavaConfig
– Datasource @ConfigurationProperties
– return

RestTemplate with Apache HttpClient
64
n
– RestTemplate java.net.HttpUrlConnection
HTTP
– HttpClient RestTemplate HttpClient

n
– HttpClient (PoolingHttpClientConnectionManager)
65
maxConnPerRoute
2
maxConnTotal
20

n LoadBalancer
– LB
(Azure LB 4min(240sec) )
– TCP/IP FIN HttpClient
Timeout
66
Spring Boot
Application LB
FIN
FIN

n
– HttpClientBuilder JavaConfig
– LB TimeToLive
– HTTP (Redis )
67
public ClosableHttpClient httpClient() {
return HttpClients.custom()
.setMaxConnPerRoute(routeMaxConnection) // set max connection
.setMaxConnTotal(totalMaxConnection) // set max connection
.setConnectionTimeToLive(180, TimeUnit.SECONDS) // set connection ttl to 180s
.evictExpiredConnections() // enable evict expired connection
.build();
}

n DB
n RedisTemaplate
68

n Microservices
n
n HTTP
n PCF Auto Reconfiguration
69

n Spring Boot Microservices
n Microservices
n
n
71

!
Wantedly
https://www.wantedly.com/projects/333155

! !

NissanConnect System Architecture and Microservices Implementation

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à NissanConnect System Architecture and Microservices Implementation

Similaire à NissanConnect System Architecture and Microservices Implementation (20)

Dernier

Dernier (20)

NissanConnect System Architecture and Microservices Implementation