Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.






Clustering
K-Means
Clustering
LSH Pair-wise
Clustering
DBSCAN
Algorithm
EM Clustering
Using GMM
Query
Answer
Input Data
Hy...
GRU
1 2Cell Bi-directional LSTM + Highway Network
4 Embedding Sharing
!"#$ … !"#&
!'#$
…!'#$<go>
…!'#(
1
5
3 4
4
62
7
8
LS...
POS정보Token Index EOMI 정보
[밥 을 먹다] [N, JOSA, VERB] [0, 0, 다]
∑
Hidde
n=128
Token one-hot
d=# of vocabulary
POS tag one-hot
...
Chatbot Builder
Chatbot Engine
Chatbot Service Serving
Deep Learning
Application
Resource
Manager
Node
Manager
Node
Manage...
Data Input Data Output
1
1.5
2
2.5
3
3.5
4
0.2
0.22
0.24
0.26
0.28
0.3
12000 14000 16000 18000 20000 22000
Cluster	K	갯수
카페 고객센터 챗봇
자동평가 사람평가 기존점수...
unfold
Table
Lookup
Table
Lookup
xi<latexit sha1_base64="L5Jbg0+FKUx4KVFoOIz15XfEJNA=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmY...
Type Default Value Type Default Value
Max Epoch 100000 Dropout Input Keep Probability 0.8
Batch Size 1024 Dropout Intra Ke...
0.00241 0.00373 0.00236 0.00977 0.00598 0.00325 0.01231 0.02275 0.00433 0.00562 0.00681 0.00646 0.00762 0.00821 0.00945 0....
( )
(*
76 32 * ,( . , *
76 (, -0( * ( * ,
76 32 ( 00* 0 * *
76 () . *. (
76 32 -. (0 ) ,
76 ) , ) .-0 *
) )) P , (* *( ,
C...
)( - (
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
[211] 인공지능이 인공지능 챗봇을 만든다
Prochain SlideShare
Chargement dans…5
×

[211] 인공지능이 인공지능 챗봇을 만든다

4 980 vues

Publié le

[211] 인공지능이 인공지능 챗봇을 만든다

Publié dans : Technologie
  • Soyez le premier à commenter

[211] 인공지능이 인공지능 챗봇을 만든다

  1. 1. 

  2. 2. 
 

  3. 3. Clustering K-Means Clustering LSH Pair-wise Clustering DBSCAN Algorithm EM Clustering Using GMM Query Answer Input Data Hyper-parameter Tuning Dropout Input Keep Probability Dropout Output Keep Probability Dropout Intra Keep Probability Dropout State Keep Probability Max Epoch Target Perplexity Batch Size Unknown Count Learning Rate Unknown Ratio Maximum Gradient Norm Unknown Percent Encoder Hidden sizes Decoder Hidden sizes Buckets Minimum Vocab Count Bidirectional Bottleneck Validation Score Validation Score Onehot Seq2Seq Embed Seq2Seq Global Embedding Model Validation Score AutoML Pipeline Ensemble Weights
  4. 4. GRU 1 2Cell Bi-directional LSTM + Highway Network 4 Embedding Sharing !"#$ … !"#& !'#$ …!'#$<go> …!'#( 1 5 3 4 4 62 7 8 LSTM Bi-LSTM Residual Block 6 Query Encoding Vector 7 Query Encoder 8 Answer Decoder 5 N-hot representation Additional Model Convolutional S2S DSSMAdditive Multiplicative Attention Mechanism3
  5. 5. POS정보Token Index EOMI 정보 [밥 을 먹다] [N, JOSA, VERB] [0, 0, 다] ∑ Hidde n=128 Token one-hot d=# of vocabulary POS tag one-hot d=# of tag Token endingone-hot d=# of ending Token EmbeddingMatrix POS tag EmbeddingMatrix Token ending EmbeddingMatrix
  6. 6. Chatbot Builder Chatbot Engine Chatbot Service Serving Deep Learning Application Resource Manager Node Manager Node Manager Node Manager Docker RegistryZoo keeper Training Data Pre-Processing … Multi model version management and deploy
  7. 7. Data Input Data Output
  8. 8. 1 1.5 2 2.5 3 3.5 4 0.2 0.22 0.24 0.26 0.28 0.3 12000 14000 16000 18000 20000 22000 Cluster K 갯수 카페 고객센터 챗봇 자동평가 사람평가 기존점수 1 1.5 2 2.5 3 3.5 4 0.2 0.22 0.24 0.26 0.28 0.3 0.32 0.34 0.36 0.38 0.4 90 92 94 96 98 100 102 104 106 Cluster K 갯수 XX 통운 고객센터 챗봇 자동평가 사람평가 기존점수 1 1.5 2 2.5 3 3.5 4 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 80000 90000 100000 110000 120000 130000 140000 Cluster K 갯수 클로바 한국어 대화 자동평가 사람평가 기존점수
  9. 9. unfold Table Lookup Table Lookup xi<latexit sha1_base64="L5Jbg0+FKUx4KVFoOIz15XfEJNA=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7vJsrOCVnDnuVuAkpkATVbt5Kt3sBi3yQyATVuuU6IXZiqpAzAdNsO9IQUjaiA2gZKqkPuhPPb53aRaP07H6gTEm05+rfiZj6Wk98z3T6FIf6vzcTf73i0irsX3RiLsMIQbLFpn4kbAzs2ed2jytgKCaGUKa4OdZmQ6ooQ5PP0poxVG7vzB8a0BCfcjm7Nb4KQwHXAQ45m2ZNbO7/kFZJ/bTkOiX3/qxQvkwCzJAjckxOiEvOSZnckCqpEUYG5Jm8kFfrzXq3PqzPRWvKSmYOyRKsrx8sQaB7</latexit><latexit sha1_base64="L5Jbg0+FKUx4KVFoOIz15XfEJNA=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7vJsrOCVnDnuVuAkpkATVbt5Kt3sBi3yQyATVuuU6IXZiqpAzAdNsO9IQUjaiA2gZKqkPuhPPb53aRaP07H6gTEm05+rfiZj6Wk98z3T6FIf6vzcTf73i0irsX3RiLsMIQbLFpn4kbAzs2ed2jytgKCaGUKa4OdZmQ6ooQ5PP0poxVG7vzB8a0BCfcjm7Nb4KQwHXAQ45m2ZNbO7/kFZJ/bTkOiX3/qxQvkwCzJAjckxOiEvOSZnckCqpEUYG5Jm8kFfrzXq3PqzPRWvKSmYOyRKsrx8sQaB7</latexit><latexit sha1_base64="L5Jbg0+FKUx4KVFoOIz15XfEJNA=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7vJsrOCVnDnuVuAkpkATVbt5Kt3sBi3yQyATVuuU6IXZiqpAzAdNsO9IQUjaiA2gZKqkPuhPPb53aRaP07H6gTEm05+rfiZj6Wk98z3T6FIf6vzcTf73i0irsX3RiLsMIQbLFpn4kbAzs2ed2jytgKCaGUKa4OdZmQ6ooQ5PP0poxVG7vzB8a0BCfcjm7Nb4KQwHXAQ45m2ZNbO7/kFZJ/bTkOiX3/qxQvkwCzJAjckxOiEvOSZnckCqpEUYG5Jm8kFfrzXq3PqzPRWvKSmYOyRKsrx8sQaB7</latexit><latexit sha1_base64="L5Jbg0+FKUx4KVFoOIz15XfEJNA=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7vJsrOCVnDnuVuAkpkATVbt5Kt3sBi3yQyATVuuU6IXZiqpAzAdNsO9IQUjaiA2gZKqkPuhPPb53aRaP07H6gTEm05+rfiZj6Wk98z3T6FIf6vzcTf73i0irsX3RiLsMIQbLFpn4kbAzs2ed2jytgKCaGUKa4OdZmQ6ooQ5PP0poxVG7vzB8a0BCfcjm7Nb4KQwHXAQ45m2ZNbO7/kFZJ/bTkOiX3/qxQvkwCzJAjckxOiEvOSZnckCqpEUYG5Jm8kFfrzXq3PqzPRWvKSmYOyRKsrx8sQaB7</latexit> xj<latexit sha1_base64="FDE9N3W1eOOecCXy5xv6mKp6JoY=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHNA5IQZiedZMzs7DLTKwlLPsGr3vwab+JV8G+cPBCTFDQUVd10d3mh4Bod58dKJNfWNzZTW+ntnd29/Uz2oKqDSDGosEAEqu5RDYJLqCBHAfVQAfU9ATVvUJr4tWdQmgfyEUchtHzak7zLGUUjPQzbT+1Mzik4U9irxJ2THJmj3M5ayWYnYJEPEpmgWjdcJ8RWTBVyJmCcbkYaQsoGtAcNQyX1Qbfi6a1jO2+Ujt0NlCmJ9lT9PxFTX+uR75lOn2JfL3sT8c/LL6zC7kUr5jKMECSbbepGwsbAnnxud7gChmJkCGWKm2Nt1qeKMjT5LKwZQun2zvyhAQ3xKZeTW+OrMBRwHWCfs3HaxOYuh7RKqqcF1ym492e54uU8wBQ5IsfkhLjknBTJDSmTCmGkR17IK3mz3q0P69P6mrUmrPnMIVmA9f0LLfegfA==</latexit><latexit sha1_base64="FDE9N3W1eOOecCXy5xv6mKp6JoY=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHNA5IQZiedZMzs7DLTKwlLPsGr3vwab+JV8G+cPBCTFDQUVd10d3mh4Bod58dKJNfWNzZTW+ntnd29/Uz2oKqDSDGosEAEqu5RDYJLqCBHAfVQAfU9ATVvUJr4tWdQmgfyEUchtHzak7zLGUUjPQzbT+1Mzik4U9irxJ2THJmj3M5ayWYnYJEPEpmgWjdcJ8RWTBVyJmCcbkYaQsoGtAcNQyX1Qbfi6a1jO2+Ujt0NlCmJ9lT9PxFTX+uR75lOn2JfL3sT8c/LL6zC7kUr5jKMECSbbepGwsbAnnxud7gChmJkCGWKm2Nt1qeKMjT5LKwZQun2zvyhAQ3xKZeTW+OrMBRwHWCfs3HaxOYuh7RKqqcF1ym492e54uU8wBQ5IsfkhLjknBTJDSmTCmGkR17IK3mz3q0P69P6mrUmrPnMIVmA9f0LLfegfA==</latexit><latexit sha1_base64="FDE9N3W1eOOecCXy5xv6mKp6JoY=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHNA5IQZiedZMzs7DLTKwlLPsGr3vwab+JV8G+cPBCTFDQUVd10d3mh4Bod58dKJNfWNzZTW+ntnd29/Uz2oKqDSDGosEAEqu5RDYJLqCBHAfVQAfU9ATVvUJr4tWdQmgfyEUchtHzak7zLGUUjPQzbT+1Mzik4U9irxJ2THJmj3M5ayWYnYJEPEpmgWjdcJ8RWTBVyJmCcbkYaQsoGtAcNQyX1Qbfi6a1jO2+Ujt0NlCmJ9lT9PxFTX+uR75lOn2JfL3sT8c/LL6zC7kUr5jKMECSbbepGwsbAnnxud7gChmJkCGWKm2Nt1qeKMjT5LKwZQun2zvyhAQ3xKZeTW+OrMBRwHWCfs3HaxOYuh7RKqqcF1ym492e54uU8wBQ5IsfkhLjknBTJDSmTCmGkR17IK3mz3q0P69P6mrUmrPnMIVmA9f0LLfegfA==</latexit><latexit sha1_base64="FDE9N3W1eOOecCXy5xv6mKp6JoY=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHNA5IQZiedZMzs7DLTKwlLPsGr3vwab+JV8G+cPBCTFDQUVd10d3mh4Bod58dKJNfWNzZTW+ntnd29/Uz2oKqDSDGosEAEqu5RDYJLqCBHAfVQAfU9ATVvUJr4tWdQmgfyEUchtHzak7zLGUUjPQzbT+1Mzik4U9irxJ2THJmj3M5ayWYnYJEPEpmgWjdcJ8RWTBVyJmCcbkYaQsoGtAcNQyX1Qbfi6a1jO2+Ujt0NlCmJ9lT9PxFTX+uR75lOn2JfL3sT8c/LL6zC7kUr5jKMECSbbepGwsbAnnxud7gChmJkCGWKm2Nt1qeKMjT5LKwZQun2zvyhAQ3xKZeTW+OrMBRwHWCfs3HaxOYuh7RKqqcF1ym492e54uU8wBQ5IsfkhLjknBTJDSmTCmGkR17IK3mz3q0P69P6mrUmrPnMIVmA9f0LLfegfA==</latexit> MatMul MatMul +<latexit sha1_base64="OAMqxJcx/hJCJ2QEV8Tpa6NiMwM=">AAACGnicZVDLSgNBEJw1PmJ8JXr0shgCghB2JaDHSA6KXhIwD0hCmJ30JkNmZ5eZXjEs+QKvevNrvIlXL/6NkwdikoKGoqqb7i4vElyj4/xYG6nNre2d9G5mb//g8CibO27oMFYM6iwUoWp5VIPgEurIUUArUkADT0DTG1WmfvMJlOahfMRxBN2ADiT3OaNopNpFL5t3is4M9jpxFyRPFqj2claq0w9ZHIBEJqjWbdeJsJtQhZwJmGQ6sYaIshEdQNtQSQPQ3WR26cQuGKVv+6EyJdGeqf8nEhpoPQ480xlQHOpVbyr+eYWlVehfdxMuoxhBsvkmPxY2hvb0b7vPFTAUY0MoU9wca7MhVZShSWdpzTNU7h/MHxrQkIByOb01uYkiAbchDjmbZExs7mpI66RxWXSdolsr5culRYBpckrOyDlxyRUpkztSJXXCCJAX8krerHfrw/q0vuatG9Zi5oQswfr+BQU3n00=</latexit><latexit sha1_base64="OAMqxJcx/hJCJ2QEV8Tpa6NiMwM=">AAACGnicZVDLSgNBEJw1PmJ8JXr0shgCghB2JaDHSA6KXhIwD0hCmJ30JkNmZ5eZXjEs+QKvevNrvIlXL/6NkwdikoKGoqqb7i4vElyj4/xYG6nNre2d9G5mb//g8CibO27oMFYM6iwUoWp5VIPgEurIUUArUkADT0DTG1WmfvMJlOahfMRxBN2ADiT3OaNopNpFL5t3is4M9jpxFyRPFqj2claq0w9ZHIBEJqjWbdeJsJtQhZwJmGQ6sYaIshEdQNtQSQPQ3WR26cQuGKVv+6EyJdGeqf8nEhpoPQ480xlQHOpVbyr+eYWlVehfdxMuoxhBsvkmPxY2hvb0b7vPFTAUY0MoU9wca7MhVZShSWdpzTNU7h/MHxrQkIByOb01uYkiAbchDjmbZExs7mpI66RxWXSdolsr5culRYBpckrOyDlxyRUpkztSJXXCCJAX8krerHfrw/q0vuatG9Zi5oQswfr+BQU3n00=</latexit><latexit sha1_base64="OAMqxJcx/hJCJ2QEV8Tpa6NiMwM=">AAACGnicZVDLSgNBEJw1PmJ8JXr0shgCghB2JaDHSA6KXhIwD0hCmJ30JkNmZ5eZXjEs+QKvevNrvIlXL/6NkwdikoKGoqqb7i4vElyj4/xYG6nNre2d9G5mb//g8CibO27oMFYM6iwUoWp5VIPgEurIUUArUkADT0DTG1WmfvMJlOahfMRxBN2ADiT3OaNopNpFL5t3is4M9jpxFyRPFqj2claq0w9ZHIBEJqjWbdeJsJtQhZwJmGQ6sYaIshEdQNtQSQPQ3WR26cQuGKVv+6EyJdGeqf8nEhpoPQ480xlQHOpVbyr+eYWlVehfdxMuoxhBsvkmPxY2hvb0b7vPFTAUY0MoU9wca7MhVZShSWdpzTNU7h/MHxrQkIByOb01uYkiAbchDjmbZExs7mpI66RxWXSdolsr5culRYBpckrOyDlxyRUpkztSJXXCCJAX8krerHfrw/q0vuatG9Zi5oQswfr+BQU3n00=</latexit><latexit sha1_base64="OAMqxJcx/hJCJ2QEV8Tpa6NiMwM=">AAACGnicZVDLSgNBEJw1PmJ8JXr0shgCghB2JaDHSA6KXhIwD0hCmJ30JkNmZ5eZXjEs+QKvevNrvIlXL/6NkwdikoKGoqqb7i4vElyj4/xYG6nNre2d9G5mb//g8CibO27oMFYM6iwUoWp5VIPgEurIUUArUkADT0DTG1WmfvMJlOahfMRxBN2ADiT3OaNopNpFL5t3is4M9jpxFyRPFqj2claq0w9ZHIBEJqjWbdeJsJtQhZwJmGQ6sYaIshEdQNtQSQPQ3WR26cQuGKVv+6EyJdGeqf8nEhpoPQ480xlQHOpVbyr+eYWlVehfdxMuoxhBsvkmPxY2hvb0b7vPFTAUY0MoU9wca7MhVZShSWdpzTNU7h/MHxrQkIByOb01uYkiAbchDjmbZExs7mpI66RxWXSdolsr5culRYBpckrOyDlxyRUpkztSJXXCCJAX8krerHfrw/q0vuatG9Zi5oQswfr+BQU3n00=</latexit> <latexit sha1_base64="cRGagh9+0RnvKHp6ysia8nkrAP8=">AAACHXicZVBNS8NAEN20ftT6VfXoJVgETyURQb1VPCh6UbAf0AbZbKdmcbNZdidiCf0LXvXmr/EmXsV/46YGsfbBwOO9GWbmhUpwg5735ZTKc/MLi5Wl6vLK6tp6bWOzbZJUM2ixRCS6G1IDgktoIUcBXaWBxqGATnh/mvudB9CGJ/IGRwqCmN5JPuSMYi71VcRva3Wv4U3gzhK/IHVS4Op2wyn3BwlLY5DIBDWm53sKg4xq5EzAuNpPDSjK7ukd9CyVNAYTZJNjx+6uVQbuMNG2JLoT9e9ERmNjRnFoO2OKkfnv5eKvtzu1CodHQcalShEk+9k0TIWLiZu/7g64BoZiZAllmttjXRZRTRnagKbWPMLpxaX9wwBaElMu81uzE6UEnCUYcTau2tj8/yHNkvZ+w/ca/vVBvXlcBFgh22SH7BGfHJImOSdXpEUYicgTeSYvzqvz5rw7Hz+tJaeY2SJTcD6/AfGGoOI=</latexit><latexit sha1_base64="cRGagh9+0RnvKHp6ysia8nkrAP8=">AAACHXicZVBNS8NAEN20ftT6VfXoJVgETyURQb1VPCh6UbAf0AbZbKdmcbNZdidiCf0LXvXmr/EmXsV/46YGsfbBwOO9GWbmhUpwg5735ZTKc/MLi5Wl6vLK6tp6bWOzbZJUM2ixRCS6G1IDgktoIUcBXaWBxqGATnh/mvudB9CGJ/IGRwqCmN5JPuSMYi71VcRva3Wv4U3gzhK/IHVS4Op2wyn3BwlLY5DIBDWm53sKg4xq5EzAuNpPDSjK7ukd9CyVNAYTZJNjx+6uVQbuMNG2JLoT9e9ERmNjRnFoO2OKkfnv5eKvtzu1CodHQcalShEk+9k0TIWLiZu/7g64BoZiZAllmttjXRZRTRnagKbWPMLpxaX9wwBaElMu81uzE6UEnCUYcTau2tj8/yHNkvZ+w/ca/vVBvXlcBFgh22SH7BGfHJImOSdXpEUYicgTeSYvzqvz5rw7Hz+tJaeY2SJTcD6/AfGGoOI=</latexit><latexit sha1_base64="cRGagh9+0RnvKHp6ysia8nkrAP8=">AAACHXicZVBNS8NAEN20ftT6VfXoJVgETyURQb1VPCh6UbAf0AbZbKdmcbNZdidiCf0LXvXmr/EmXsV/46YGsfbBwOO9GWbmhUpwg5735ZTKc/MLi5Wl6vLK6tp6bWOzbZJUM2ixRCS6G1IDgktoIUcBXaWBxqGATnh/mvudB9CGJ/IGRwqCmN5JPuSMYi71VcRva3Wv4U3gzhK/IHVS4Op2wyn3BwlLY5DIBDWm53sKg4xq5EzAuNpPDSjK7ukd9CyVNAYTZJNjx+6uVQbuMNG2JLoT9e9ERmNjRnFoO2OKkfnv5eKvtzu1CodHQcalShEk+9k0TIWLiZu/7g64BoZiZAllmttjXRZRTRnagKbWPMLpxaX9wwBaElMu81uzE6UEnCUYcTau2tj8/yHNkvZ+w/ca/vVBvXlcBFgh22SH7BGfHJImOSdXpEUYicgTeSYvzqvz5rw7Hz+tJaeY2SJTcD6/AfGGoOI=</latexit><latexit sha1_base64="cRGagh9+0RnvKHp6ysia8nkrAP8=">AAACHXicZVBNS8NAEN20ftT6VfXoJVgETyURQb1VPCh6UbAf0AbZbKdmcbNZdidiCf0LXvXmr/EmXsV/46YGsfbBwOO9GWbmhUpwg5735ZTKc/MLi5Wl6vLK6tp6bWOzbZJUM2ixRCS6G1IDgktoIUcBXaWBxqGATnh/mvudB9CGJ/IGRwqCmN5JPuSMYi71VcRva3Wv4U3gzhK/IHVS4Op2wyn3BwlLY5DIBDWm53sKg4xq5EzAuNpPDSjK7ukd9CyVNAYTZJNjx+6uVQbuMNG2JLoT9e9ERmNjRnFoO2OKkfnv5eKvtzu1CodHQcalShEk+9k0TIWLiZu/7g64BoZiZAllmttjXRZRTRnagKbWPMLpxaX9wwBaElMu81uzE6UEnCUYcTau2tj8/yHNkvZ+w/ca/vVBvXlcBFgh22SH7BGfHJImOSdXpEUYicgTeSYvzqvz5rw7Hz+tJaeY2SJTcD6/AfGGoOI=</latexit> MatMul Weighting Function ↵<latexit sha1_base64="Zp4VLrVWNPDm0sLggOD2KANdtmU=">AAACH3icZVDLSgNBEJw1PmJ8JXr0shgET2FXBD1GclD0EsFEwQTpnXTM6OzsMNMrhiX/4FVvfo038Zq/cRIXMVrQUFR1090VaSksBcHYmyvMLywuFZdLK6tr6xvlymbbJqnh2OKJTMx1BBalUNgiQRKvtUGII4lX0UNj4l89orEiUZc01NiN4U6JvuBATmp3QOoB3JarQS2Ywv9PwpxUWY7mbcUrdHoJT2NUxCVYexMGmroZGBJc4qjUSS1q4A9whzeOKojRdrPpuSN/1yk9v58YV4r8qfp7IoPY2mEcuc4YaGD/ehPxx9udWUX9o24mlE4JFf/e1E+lT4k/ed7vCYOc5NAR4Ea4Y30+AAOcXEQza56wcXbu/rBIjsQg1OTW7FhriScJDQQflVxs4d+Q/pP2fi0MauHFQbV+kAdYZNtsh+2xkB2yOjtlTdZinN2zZ/bCXr0379378D6/W+e8fGaLzcAbfwGO66G2</latexit><latexit sha1_base64="Zp4VLrVWNPDm0sLggOD2KANdtmU=">AAACH3icZVDLSgNBEJw1PmJ8JXr0shgET2FXBD1GclD0EsFEwQTpnXTM6OzsMNMrhiX/4FVvfo038Zq/cRIXMVrQUFR1090VaSksBcHYmyvMLywuFZdLK6tr6xvlymbbJqnh2OKJTMx1BBalUNgiQRKvtUGII4lX0UNj4l89orEiUZc01NiN4U6JvuBATmp3QOoB3JarQS2Ywv9PwpxUWY7mbcUrdHoJT2NUxCVYexMGmroZGBJc4qjUSS1q4A9whzeOKojRdrPpuSN/1yk9v58YV4r8qfp7IoPY2mEcuc4YaGD/ehPxx9udWUX9o24mlE4JFf/e1E+lT4k/ed7vCYOc5NAR4Ea4Y30+AAOcXEQza56wcXbu/rBIjsQg1OTW7FhriScJDQQflVxs4d+Q/pP2fi0MauHFQbV+kAdYZNtsh+2xkB2yOjtlTdZinN2zZ/bCXr0379378D6/W+e8fGaLzcAbfwGO66G2</latexit><latexit sha1_base64="Zp4VLrVWNPDm0sLggOD2KANdtmU=">AAACH3icZVDLSgNBEJw1PmJ8JXr0shgET2FXBD1GclD0EsFEwQTpnXTM6OzsMNMrhiX/4FVvfo038Zq/cRIXMVrQUFR1090VaSksBcHYmyvMLywuFZdLK6tr6xvlymbbJqnh2OKJTMx1BBalUNgiQRKvtUGII4lX0UNj4l89orEiUZc01NiN4U6JvuBATmp3QOoB3JarQS2Ywv9PwpxUWY7mbcUrdHoJT2NUxCVYexMGmroZGBJc4qjUSS1q4A9whzeOKojRdrPpuSN/1yk9v58YV4r8qfp7IoPY2mEcuc4YaGD/ehPxx9udWUX9o24mlE4JFf/e1E+lT4k/ed7vCYOc5NAR4Ea4Y30+AAOcXEQza56wcXbu/rBIjsQg1OTW7FhriScJDQQflVxs4d+Q/pP2fi0MauHFQbV+kAdYZNtsh+2xkB2yOjtlTdZinN2zZ/bCXr0379378D6/W+e8fGaLzcAbfwGO66G2</latexit><latexit sha1_base64="Zp4VLrVWNPDm0sLggOD2KANdtmU=">AAACH3icZVDLSgNBEJw1PmJ8JXr0shgET2FXBD1GclD0EsFEwQTpnXTM6OzsMNMrhiX/4FVvfo038Zq/cRIXMVrQUFR1090VaSksBcHYmyvMLywuFZdLK6tr6xvlymbbJqnh2OKJTMx1BBalUNgiQRKvtUGII4lX0UNj4l89orEiUZc01NiN4U6JvuBATmp3QOoB3JarQS2Ywv9PwpxUWY7mbcUrdHoJT2NUxCVYexMGmroZGBJc4qjUSS1q4A9whzeOKojRdrPpuSN/1yk9v58YV4r8qfp7IoPY2mEcuc4YaGD/ehPxx9udWUX9o24mlE4JFf/e1E+lT4k/ed7vCYOc5NAR4Ea4Y30+AAOcXEQza56wcXbu/rBIjsQg1OTW7FhriScJDQQflVxs4d+Q/pP2fi0MauHFQbV+kAdYZNtsh+2xkB2yOjtlTdZinN2zZ/bCXr0379378D6/W+e8fGaLzcAbfwGO66G2</latexit> RN Summation ⇥<latexit sha1_base64="4Fb9A5QAQZYCkPKTtzP6rGQNJTc=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXlmzfDe3ciGfwPbWvXr2kXbf03PXWI1AsXDufeyzn3eKHgGh1nZqXSW9s7u5m97P7B4dFxLn/S0EGkGNRZIALV8qgGwSXUkaOAVqiA+p6ApjeuzufNF1CaB/IJJyF0fTqUfMAZRUM1Osh90L1cwSk5i7I3gZuAAkmq1stb6U4/YJEPEpmgWrddJ8RuTBVyJmCa7UQaQsrGdAhtAyU1Kt14YXdqFw3TtweBMi3RXrD/L2Lqaz3xPbPpUxzp9dmc/JsVV6RwcN2NuQwjBMmWSoNI2BjY8+ftPlfAUEwMoExxY9ZmI6ooQxPRiswrVO8fzB8a0ACfcjn3Gt+EoYDbAEecTbMmNnc9pE3QuCy5Tsl9LBcq5STADDkj5+SCuOSKVMgdqZE6YeSZvJF38mF9Wl/Wt/WzXE1Zyc0pWSlr9gu/DaHS</latexit><latexit sha1_base64="4Fb9A5QAQZYCkPKTtzP6rGQNJTc=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXlmzfDe3ciGfwPbWvXr2kXbf03PXWI1AsXDufeyzn3eKHgGh1nZqXSW9s7u5m97P7B4dFxLn/S0EGkGNRZIALV8qgGwSXUkaOAVqiA+p6ApjeuzufNF1CaB/IJJyF0fTqUfMAZRUM1Osh90L1cwSk5i7I3gZuAAkmq1stb6U4/YJEPEpmgWrddJ8RuTBVyJmCa7UQaQsrGdAhtAyU1Kt14YXdqFw3TtweBMi3RXrD/L2Lqaz3xPbPpUxzp9dmc/JsVV6RwcN2NuQwjBMmWSoNI2BjY8+ftPlfAUEwMoExxY9ZmI6ooQxPRiswrVO8fzB8a0ACfcjn3Gt+EoYDbAEecTbMmNnc9pE3QuCy5Tsl9LBcq5STADDkj5+SCuOSKVMgdqZE6YeSZvJF38mF9Wl/Wt/WzXE1Zyc0pWSlr9gu/DaHS</latexit><latexit sha1_base64="4Fb9A5QAQZYCkPKTtzP6rGQNJTc=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXlmzfDe3ciGfwPbWvXr2kXbf03PXWI1AsXDufeyzn3eKHgGh1nZqXSW9s7u5m97P7B4dFxLn/S0EGkGNRZIALV8qgGwSXUkaOAVqiA+p6ApjeuzufNF1CaB/IJJyF0fTqUfMAZRUM1Osh90L1cwSk5i7I3gZuAAkmq1stb6U4/YJEPEpmgWrddJ8RuTBVyJmCa7UQaQsrGdAhtAyU1Kt14YXdqFw3TtweBMi3RXrD/L2Lqaz3xPbPpUxzp9dmc/JsVV6RwcN2NuQwjBMmWSoNI2BjY8+ftPlfAUEwMoExxY9ZmI6ooQxPRiswrVO8fzB8a0ACfcjn3Gt+EoYDbAEecTbMmNnc9pE3QuCy5Tsl9LBcq5STADDkj5+SCuOSKVMgdqZE6YeSZvJF38mF9Wl/Wt/WzXE1Zyc0pWSlr9gu/DaHS</latexit><latexit sha1_base64="4Fb9A5QAQZYCkPKTtzP6rGQNJTc=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXlmzfDe3ciGfwPbWvXr2kXbf03PXWI1AsXDufeyzn3eKHgGh1nZqXSW9s7u5m97P7B4dFxLn/S0EGkGNRZIALV8qgGwSXUkaOAVqiA+p6ApjeuzufNF1CaB/IJJyF0fTqUfMAZRUM1Osh90L1cwSk5i7I3gZuAAkmq1stb6U4/YJEPEpmgWrddJ8RuTBVyJmCa7UQaQsrGdAhtAyU1Kt14YXdqFw3TtweBMi3RXrD/L2Lqaz3xPbPpUxzp9dmc/JsVV6RwcN2NuQwjBMmWSoNI2BjY8+ftPlfAUEwMoExxY9ZmI6ooQxPRiswrVO8fzB8a0ACfcjn3Gt+EoYDbAEecTbMmNnc9pE3QuCy5Tsl9LBcq5STADDkj5+SCuOSKVMgdqZE6YeSZvJF38mF9Wl/Wt/WzXE1Zyc0pWSlr9gu/DaHS</latexit> An arbitrary sub-graph <latexit sha1_base64="6O8l3m0jAPTtFPUg7uyLhsP+li4=">AAACHXicZVBNSwMxEE38rPVbj14Wi+Cp7Iqgx4oHRS8VrC20pWTTqRvMZkMyKy1L/4JXvflrvIlX8d+YrYtY+2Dg8d4MM/NCLYVF3/+ic/MLi0vLpZXy6tr6xubW9s6dTVLDocETmZhWyCxIoaCBAiW0tAEWhxKa4cN57jcfwViRqFscaejG7F6JgeAMc6kDQ93bqvhVfwJvlgQFqZAC9d42ne/0E57GoJBLZm078DV2M2ZQcAnjcie1oBl/YPfQdlSxGGw3mxw79g6c0vcGiXGl0JuofycyFls7ikPXGTOM7H8vF3+9g6lVODjtZkLpFEHxn02DVHqYePnrXl8Y4ChHjjBuhDvW4xEzjKMLaGrNEM6vrt0fFtCRmAmV35qdaS3hIsFI8HHZxRb8D2mW3B1VA78a3BxXasdFgCWyR/bJIQnICamRS1InDcJJRJ7IM3mhr/SNvtOPn9Y5WszskinQz28ElqDp</latexit><latexit sha1_base64="6O8l3m0jAPTtFPUg7uyLhsP+li4=">AAACHXicZVBNSwMxEE38rPVbj14Wi+Cp7Iqgx4oHRS8VrC20pWTTqRvMZkMyKy1L/4JXvflrvIlX8d+YrYtY+2Dg8d4MM/NCLYVF3/+ic/MLi0vLpZXy6tr6xubW9s6dTVLDocETmZhWyCxIoaCBAiW0tAEWhxKa4cN57jcfwViRqFscaejG7F6JgeAMc6kDQ93bqvhVfwJvlgQFqZAC9d42ne/0E57GoJBLZm078DV2M2ZQcAnjcie1oBl/YPfQdlSxGGw3mxw79g6c0vcGiXGl0JuofycyFls7ikPXGTOM7H8vF3+9g6lVODjtZkLpFEHxn02DVHqYePnrXl8Y4ChHjjBuhDvW4xEzjKMLaGrNEM6vrt0fFtCRmAmV35qdaS3hIsFI8HHZxRb8D2mW3B1VA78a3BxXasdFgCWyR/bJIQnICamRS1InDcJJRJ7IM3mhr/SNvtOPn9Y5WszskinQz28ElqDp</latexit><latexit sha1_base64="6O8l3m0jAPTtFPUg7uyLhsP+li4=">AAACHXicZVBNSwMxEE38rPVbj14Wi+Cp7Iqgx4oHRS8VrC20pWTTqRvMZkMyKy1L/4JXvflrvIlX8d+YrYtY+2Dg8d4MM/NCLYVF3/+ic/MLi0vLpZXy6tr6xubW9s6dTVLDocETmZhWyCxIoaCBAiW0tAEWhxKa4cN57jcfwViRqFscaejG7F6JgeAMc6kDQ93bqvhVfwJvlgQFqZAC9d42ne/0E57GoJBLZm078DV2M2ZQcAnjcie1oBl/YPfQdlSxGGw3mxw79g6c0vcGiXGl0JuofycyFls7ikPXGTOM7H8vF3+9g6lVODjtZkLpFEHxn02DVHqYePnrXl8Y4ChHjjBuhDvW4xEzjKMLaGrNEM6vrt0fFtCRmAmV35qdaS3hIsFI8HHZxRb8D2mW3B1VA78a3BxXasdFgCWyR/bJIQnICamRS1InDcJJRJ7IM3mhr/SNvtOPn9Y5WszskinQz28ElqDp</latexit><latexit sha1_base64="6O8l3m0jAPTtFPUg7uyLhsP+li4=">AAACHXicZVBNSwMxEE38rPVbj14Wi+Cp7Iqgx4oHRS8VrC20pWTTqRvMZkMyKy1L/4JXvflrvIlX8d+YrYtY+2Dg8d4MM/NCLYVF3/+ic/MLi0vLpZXy6tr6xubW9s6dTVLDocETmZhWyCxIoaCBAiW0tAEWhxKa4cN57jcfwViRqFscaejG7F6JgeAMc6kDQ93bqvhVfwJvlgQFqZAC9d42ne/0E57GoJBLZm078DV2M2ZQcAnjcie1oBl/YPfQdlSxGGw3mxw79g6c0vcGiXGl0JuofycyFls7ikPXGTOM7H8vF3+9g6lVODjtZkLpFEHxn02DVHqYePnrXl8Y4ChHjjBuhDvW4xEzjKMLaGrNEM6vrt0fFtCRmAmV35qdaS3hIsFI8HHZxRb8D2mW3B1VA78a3BxXasdFgCWyR/bJIQnICamRS1InDcJJRJ7IM3mhr/SNvtOPn9Y5WszskinQz28ElqDp</latexit> X <latexit sha1_base64="ZkCrS01otTzEoklXjZfiTDl2a4c=">AAACHXicZVBNS8NAEN20ftbP6tFLsBQ8lUQEPVY8KHpRsFWwoWy2k2bp7ibsTsQS+he86s1f4028iv/GTVvE1gcDj/dmmJkXpoIb9Lxvp1ReWFxaXlmtrK1vbG5tV3faJsk0gxZLRKLvQ2pAcAUt5CjgPtVAZSjgLhycFf7dI2jDE3WLwxQCSfuKR5xRLKSOyWR3u+Y1vDHc/8SfkhqZ4rpbdcqdXsIyCQqZoMY8+F6KQU41ciZgVOlkBlLKBrQPD5YqKsEE+fjYkVu3Ss+NEm1LoTtW/07kVBozlKHtlBRjM+8V4q9Xn1mF0UmQc5VmCIpNNkWZcDFxi9fdHtfAUAwtoUxze6zLYqopQxvQzJonOLu8sn8YQEsk5aq4NT9NUwHnCcacjSo2Nn8+pP+kfdjwvYZ/c1RrHk0DXCF7ZJ8cEJ8ckya5INekRRiJyTN5Ia/Om/PufDifk9aSM53ZJTNwvn4AEl+g8Q==</latexit><latexit sha1_base64="ZkCrS01otTzEoklXjZfiTDl2a4c=">AAACHXicZVBNS8NAEN20ftbP6tFLsBQ8lUQEPVY8KHpRsFWwoWy2k2bp7ibsTsQS+he86s1f4028iv/GTVvE1gcDj/dmmJkXpoIb9Lxvp1ReWFxaXlmtrK1vbG5tV3faJsk0gxZLRKLvQ2pAcAUt5CjgPtVAZSjgLhycFf7dI2jDE3WLwxQCSfuKR5xRLKSOyWR3u+Y1vDHc/8SfkhqZ4rpbdcqdXsIyCQqZoMY8+F6KQU41ciZgVOlkBlLKBrQPD5YqKsEE+fjYkVu3Ss+NEm1LoTtW/07kVBozlKHtlBRjM+8V4q9Xn1mF0UmQc5VmCIpNNkWZcDFxi9fdHtfAUAwtoUxze6zLYqopQxvQzJonOLu8sn8YQEsk5aq4NT9NUwHnCcacjSo2Nn8+pP+kfdjwvYZ/c1RrHk0DXCF7ZJ8cEJ8ckya5INekRRiJyTN5Ia/Om/PufDifk9aSM53ZJTNwvn4AEl+g8Q==</latexit><latexit sha1_base64="ZkCrS01otTzEoklXjZfiTDl2a4c=">AAACHXicZVBNS8NAEN20ftbP6tFLsBQ8lUQEPVY8KHpRsFWwoWy2k2bp7ibsTsQS+he86s1f4028iv/GTVvE1gcDj/dmmJkXpoIb9Lxvp1ReWFxaXlmtrK1vbG5tV3faJsk0gxZLRKLvQ2pAcAUt5CjgPtVAZSjgLhycFf7dI2jDE3WLwxQCSfuKR5xRLKSOyWR3u+Y1vDHc/8SfkhqZ4rpbdcqdXsIyCQqZoMY8+F6KQU41ciZgVOlkBlLKBrQPD5YqKsEE+fjYkVu3Ss+NEm1LoTtW/07kVBozlKHtlBRjM+8V4q9Xn1mF0UmQc5VmCIpNNkWZcDFxi9fdHtfAUAwtoUxze6zLYqopQxvQzJonOLu8sn8YQEsk5aq4NT9NUwHnCcacjSo2Nn8+pP+kfdjwvYZ/c1RrHk0DXCF7ZJ8cEJ8ckya5INekRRiJyTN5Ia/Om/PufDifk9aSM53ZJTNwvn4AEl+g8Q==</latexit><latexit sha1_base64="ZkCrS01otTzEoklXjZfiTDl2a4c=">AAACHXicZVBNS8NAEN20ftbP6tFLsBQ8lUQEPVY8KHpRsFWwoWy2k2bp7ibsTsQS+he86s1f4028iv/GTVvE1gcDj/dmmJkXpoIb9Lxvp1ReWFxaXlmtrK1vbG5tV3faJsk0gxZLRKLvQ2pAcAUt5CjgPtVAZSjgLhycFf7dI2jDE3WLwxQCSfuKR5xRLKSOyWR3u+Y1vDHc/8SfkhqZ4rpbdcqdXsIyCQqZoMY8+F6KQU41ciZgVOlkBlLKBrQPD5YqKsEE+fjYkVu3Ss+NEm1LoTtW/07kVBozlKHtlBRjM+8V4q9Xn1mF0UmQc5VmCIpNNkWZcDFxi9fdHtfAUAwtoUxze6zLYqopQxvQzJonOLu8sn8YQEsk5aq4NT9NUwHnCcacjSo2Nn8+pP+kfdjwvYZ/c1RrHk0DXCF7ZJ8cEJ8ckya5INekRRiJyTN5Ia/Om/PufDifk9aSM53ZJTNwvn4AEl+g8Q==</latexit> ÷<latexit sha1_base64="ivvOIjwmR6gFxz4TmhkpvPiGK5k=">AAACHXicZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXhmzfDe3ckGfwLbWvXr2kXbaN/0xuVSD1w4XDOvdx7jxcKrtFxfqxUemt7Zzezl90/ODw6zuVPGjqIFIM6C0SgWh7VILiEOnIU0AoVUN8T0PTG1cRvTkBpHsgnnIbQ9elQ8gFnFBOp0+eTXq7glJw57E3iLkmBLFHr5a10px+wyAeJTFCt264TYjemCjkTMMt2Ig0hZWM6hLahkvqgu/H82JldNErfHgTKlER7rv6fiKmv9dT3TKdPcaTXvUT884orq3Bw3Y25DCMEyRabBpGwMbCT1+0+V8BQTA2hTHFzrM1GVFGGJqCVNc9QvX8wf2hAQ3zKZXJrfBOGAm4DHHE2y5rY3PWQNknjsuQ6JfexXKiUlwFmyBk5JxfEJVekQu5IjdQJIyPyQl7Jm/VufVif1teiNWUtZ07JCqzvX/NaoN8=</latexit><latexit sha1_base64="ivvOIjwmR6gFxz4TmhkpvPiGK5k=">AAACHXicZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXhmzfDe3ckGfwLbWvXr2kXbaN/0xuVSD1w4XDOvdx7jxcKrtFxfqxUemt7Zzezl90/ODw6zuVPGjqIFIM6C0SgWh7VILiEOnIU0AoVUN8T0PTG1cRvTkBpHsgnnIbQ9elQ8gFnFBOp0+eTXq7glJw57E3iLkmBLFHr5a10px+wyAeJTFCt264TYjemCjkTMMt2Ig0hZWM6hLahkvqgu/H82JldNErfHgTKlER7rv6fiKmv9dT3TKdPcaTXvUT884orq3Bw3Y25DCMEyRabBpGwMbCT1+0+V8BQTA2hTHFzrM1GVFGGJqCVNc9QvX8wf2hAQ3zKZXJrfBOGAm4DHHE2y5rY3PWQNknjsuQ6JfexXKiUlwFmyBk5JxfEJVekQu5IjdQJIyPyQl7Jm/VufVif1teiNWUtZ07JCqzvX/NaoN8=</latexit><latexit sha1_base64="ivvOIjwmR6gFxz4TmhkpvPiGK5k=">AAACHXicZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXhmzfDe3ckGfwLbWvXr2kXbaN/0xuVSD1w4XDOvdx7jxcKrtFxfqxUemt7Zzezl90/ODw6zuVPGjqIFIM6C0SgWh7VILiEOnIU0AoVUN8T0PTG1cRvTkBpHsgnnIbQ9elQ8gFnFBOp0+eTXq7glJw57E3iLkmBLFHr5a10px+wyAeJTFCt264TYjemCjkTMMt2Ig0hZWM6hLahkvqgu/H82JldNErfHgTKlER7rv6fiKmv9dT3TKdPcaTXvUT884orq3Bw3Y25DCMEyRabBpGwMbCT1+0+V8BQTA2hTHFzrM1GVFGGJqCVNc9QvX8wf2hAQ3zKZXJrfBOGAm4DHHE2y5rY3PWQNknjsuQ6JfexXKiUlwFmyBk5JxfEJVekQu5IjdQJIyPyQl7Jm/VufVif1teiNWUtZ07JCqzvX/NaoN8=</latexit><latexit sha1_base64="ivvOIjwmR6gFxz4TmhkpvPiGK5k=">AAACHXicZVBNSwJRFH2jfZh9aS3bDInQSmZCqKXhoqiNQX6Airx5XvXhmzfDe3ckGfwLbWvXr2kXbaN/0xuVSD1w4XDOvdx7jxcKrtFxfqxUemt7Zzezl90/ODw6zuVPGjqIFIM6C0SgWh7VILiEOnIU0AoVUN8T0PTG1cRvTkBpHsgnnIbQ9elQ8gFnFBOp0+eTXq7glJw57E3iLkmBLFHr5a10px+wyAeJTFCt264TYjemCjkTMMt2Ig0hZWM6hLahkvqgu/H82JldNErfHgTKlER7rv6fiKmv9dT3TKdPcaTXvUT884orq3Bw3Y25DCMEyRabBpGwMbCT1+0+V8BQTA2hTHFzrM1GVFGGJqCVNc9QvX8wf2hAQ3zKZXJrfBOGAm4DHHE2y5rY3PWQNknjsuQ6JfexXKiUlwFmyBk5JxfEJVekQu5IjdQJIyPyQl7Jm/VufVif1teiNWUtZ07JCqzvX/NaoN8=</latexit> x1<latexit sha1_base64="5JZDHL9WNUkSX3mdLTalEXoMydc=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7bjdXcErOHPYqcRNSIAmq3byVbvcCFvkgkQmqdct1QuzEVCFnAqbZdqQhpGxEB9AyVFIfdCee3zq1i0bp2f1AmZJoz9W/EzH1tZ74nun0KQ71f28m/nrFpVXYv+jEXIYRgmSLTf1I2BjYs8/tHlfAUEwMoUxxc6zNhlRRhiafpTVjqNzemT80oCE+5XJ2a3wVhgKuAxxyNs2a2Nz/Ia2S+mnJdUru/VmhfJkEmCFH5JicEJeckzK5IVVSI4wMyDN5Ia/Wm/VufVifi9aUlcwckiVYXz/MYqBD</latexit><latexit sha1_base64="5JZDHL9WNUkSX3mdLTalEXoMydc=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7bjdXcErOHPYqcRNSIAmq3byVbvcCFvkgkQmqdct1QuzEVCFnAqbZdqQhpGxEB9AyVFIfdCee3zq1i0bp2f1AmZJoz9W/EzH1tZ74nun0KQ71f28m/nrFpVXYv+jEXIYRgmSLTf1I2BjYs8/tHlfAUEwMoUxxc6zNhlRRhiafpTVjqNzemT80oCE+5XJ2a3wVhgKuAxxyNs2a2Nz/Ia2S+mnJdUru/VmhfJkEmCFH5JicEJeckzK5IVVSI4wMyDN5Ia/Wm/VufVifi9aUlcwckiVYXz/MYqBD</latexit><latexit sha1_base64="5JZDHL9WNUkSX3mdLTalEXoMydc=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7bjdXcErOHPYqcRNSIAmq3byVbvcCFvkgkQmqdct1QuzEVCFnAqbZdqQhpGxEB9AyVFIfdCee3zq1i0bp2f1AmZJoz9W/EzH1tZ74nun0KQ71f28m/nrFpVXYv+jEXIYRgmSLTf1I2BjYs8/tHlfAUEwMoUxxc6zNhlRRhiafpTVjqNzemT80oCE+5XJ2a3wVhgKuAxxyNs2a2Nz/Ia2S+mnJdUru/VmhfJkEmCFH5JicEJeckzK5IVVSI4wMyDN5Ia/Wm/VufVifi9aUlcwckiVYXz/MYqBD</latexit><latexit sha1_base64="5JZDHL9WNUkSX3mdLTalEXoMydc=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz11iMwDFw7n3Mu993ih4Bod59tKpdfWNzYzW9ntnd29/Vz+oK6DSDGosUAEqulRDYJLqCFHAc1QAfU9AQ1vVJn5jSdQmgfyESchdHw6kLzPGUUjPYy7bjdXcErOHPYqcRNSIAmq3byVbvcCFvkgkQmqdct1QuzEVCFnAqbZdqQhpGxEB9AyVFIfdCee3zq1i0bp2f1AmZJoz9W/EzH1tZ74nun0KQ71f28m/nrFpVXYv+jEXIYRgmSLTf1I2BjYs8/tHlfAUEwMoUxxc6zNhlRRhiafpTVjqNzemT80oCE+5XJ2a3wVhgKuAxxyNs2a2Nz/Ia2S+mnJdUru/VmhfJkEmCFH5JicEJeckzK5IVVSI4wMyDN5Ia/Wm/VufVifi9aUlcwckiVYXz/MYqBD</latexit> x2<latexit sha1_base64="dPTqLlh8IztTplbJvHjOUlUD+TQ=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYkqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz0/iNQDFw7n3Mu993ih4Bod58dKJDc2t7ZTO+ndvf2Dw0z2qKaDSDGoskAEquFRDYJLqCJHAY1QAfU9AXVvWJ769WdQmgfyCcchtH3al7zHGUUjPY46xU4m5xScGex14i5IjixQ6WStZKsbsMgHiUxQrZuuE2I7pgo5EzBJtyINIWVD2oemoZL6oNvx7NaJnTdK1+4FypREe6b+n4ipr/XY90ynT3GgV72p+Ofll1Zh77IdcxlGCJLNN/UiYWNgTz+3u1wBQzE2hDLFzbE2G1BFGZp8ltaMoHx3b/7QgIb4lMvprfF1GAq4CXDA2SRtYnNXQ1ontWLBdQruw3mudLUIMEVOyCk5Iy65ICVySyqkShjpkxfySt6sd+vD+rS+5q0JazFzTJZgff8CzhigRA==</latexit><latexit sha1_base64="dPTqLlh8IztTplbJvHjOUlUD+TQ=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYkqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz0/iNQDFw7n3Mu993ih4Bod58dKJDc2t7ZTO+ndvf2Dw0z2qKaDSDGoskAEquFRDYJLqCJHAY1QAfU9AXVvWJ769WdQmgfyCcchtH3al7zHGUUjPY46xU4m5xScGex14i5IjixQ6WStZKsbsMgHiUxQrZuuE2I7pgo5EzBJtyINIWVD2oemoZL6oNvx7NaJnTdK1+4FypREe6b+n4ipr/XY90ynT3GgV72p+Ofll1Zh77IdcxlGCJLNN/UiYWNgTz+3u1wBQzE2hDLFzbE2G1BFGZp8ltaMoHx3b/7QgIb4lMvprfF1GAq4CXDA2SRtYnNXQ1ontWLBdQruw3mudLUIMEVOyCk5Iy65ICVySyqkShjpkxfySt6sd+vD+rS+5q0JazFzTJZgff8CzhigRA==</latexit><latexit sha1_base64="dPTqLlh8IztTplbJvHjOUlUD+TQ=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYkqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz0/iNQDFw7n3Mu993ih4Bod58dKJDc2t7ZTO+ndvf2Dw0z2qKaDSDGoskAEquFRDYJLqCJHAY1QAfU9AXVvWJ769WdQmgfyCcchtH3al7zHGUUjPY46xU4m5xScGex14i5IjixQ6WStZKsbsMgHiUxQrZuuE2I7pgo5EzBJtyINIWVD2oemoZL6oNvx7NaJnTdK1+4FypREe6b+n4ipr/XY90ynT3GgV72p+Ofll1Zh77IdcxlGCJLNN/UiYWNgTz+3u1wBQzE2hDLFzbE2G1BFGZp8ltaMoHx3b/7QgIb4lMvprfF1GAq4CXDA2SRtYnNXQ1ontWLBdQruw3mudLUIMEVOyCk5Iy65ICVySyqkShjpkxfySt6sd+vD+rS+5q0JazFzTJZgff8CzhigRA==</latexit><latexit sha1_base64="dPTqLlh8IztTplbJvHjOUlUD+TQ=">AAACHHicZVBNSwJRFH2jfZh9aS3bDInQSmYkqHaGi6I2RvkBKvLmedWHb94M790JZfAntK1dv6ZdtA36Nz0/iNQDFw7n3Mu993ih4Bod58dKJDc2t7ZTO+ndvf2Dw0z2qKaDSDGoskAEquFRDYJLqCJHAY1QAfU9AXVvWJ769WdQmgfyCcchtH3al7zHGUUjPY46xU4m5xScGex14i5IjixQ6WStZKsbsMgHiUxQrZuuE2I7pgo5EzBJtyINIWVD2oemoZL6oNvx7NaJnTdK1+4FypREe6b+n4ipr/XY90ynT3GgV72p+Ofll1Zh77IdcxlGCJLNN/UiYWNgTz+3u1wBQzE2hDLFzbE2G1BFGZp8ltaMoHx3b/7QgIb4lMvprfF1GAq4CXDA2SRtYnNXQ1ontWLBdQruw3mudLUIMEVOyCk5Iy65ICVySyqkShjpkxfySt6sd+vD+rS+5q0JazFzTJZgff8CzhigRA==</latexit> xT<latexit sha1_base64="/9ZF0l+9BDz4Zgjman+1h2deJxo=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHzgiSE2UknGTI7u8z0SsKST/CqN7/Gm3gV/BsnD8QkBQ1FVTfdXV4ouEbH+bESyY3Nre3UTnp3b//gMJM9qukgUgyqLBCBanhUg+ASqshRQCNUQH1PQN0blqZ+/RmU5oGs4DiEtk/7kvc4o2ikp1Gn0snknIIzg71O3AXJkQXKnayVbHUDFvkgkQmqddN1QmzHVCFnAibpVqQhpGxI+9A0VFIfdDue3Tqx80bp2r1AmZJoz9T/EzH1tR77nun0KQ70qjcV/7z80irsXbVjLsMIQbL5pl4kbAzs6ed2lytgKMaGUKa4OdZmA6ooQ5PP0poRlO4fzB8a0BCfcjm9Nb4JQwG3AQ44m6RNbO5qSOukdl5wnYL7eJErXi8CTJETckrOiEsuSZHckTKpEkb65IW8kjfr3fqwPq2veWvCWswckyVY378IU6Bm</latexit><latexit sha1_base64="/9ZF0l+9BDz4Zgjman+1h2deJxo=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHzgiSE2UknGTI7u8z0SsKST/CqN7/Gm3gV/BsnD8QkBQ1FVTfdXV4ouEbH+bESyY3Nre3UTnp3b//gMJM9qukgUgyqLBCBanhUg+ASqshRQCNUQH1PQN0blqZ+/RmU5oGs4DiEtk/7kvc4o2ikp1Gn0snknIIzg71O3AXJkQXKnayVbHUDFvkgkQmqddN1QmzHVCFnAibpVqQhpGxI+9A0VFIfdDue3Tqx80bp2r1AmZJoz9T/EzH1tR77nun0KQ70qjcV/7z80irsXbVjLsMIQbL5pl4kbAzs6ed2lytgKMaGUKa4OdZmA6ooQ5PP0poRlO4fzB8a0BCfcjm9Nb4JQwG3AQ44m6RNbO5qSOukdl5wnYL7eJErXi8CTJETckrOiEsuSZHckTKpEkb65IW8kjfr3fqwPq2veWvCWswckyVY378IU6Bm</latexit><latexit sha1_base64="/9ZF0l+9BDz4Zgjman+1h2deJxo=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHzgiSE2UknGTI7u8z0SsKST/CqN7/Gm3gV/BsnD8QkBQ1FVTfdXV4ouEbH+bESyY3Nre3UTnp3b//gMJM9qukgUgyqLBCBanhUg+ASqshRQCNUQH1PQN0blqZ+/RmU5oGs4DiEtk/7kvc4o2ikp1Gn0snknIIzg71O3AXJkQXKnayVbHUDFvkgkQmqddN1QmzHVCFnAibpVqQhpGxI+9A0VFIfdDue3Tqx80bp2r1AmZJoz9T/EzH1tR77nun0KQ70qjcV/7z80irsXbVjLsMIQbL5pl4kbAzs6ed2lytgKMaGUKa4OdZmA6ooQ5PP0poRlO4fzB8a0BCfcjm9Nb4JQwG3AQ44m6RNbO5qSOukdl5wnYL7eJErXi8CTJETckrOiEsuSZHckTKpEkb65IW8kjfr3fqwPq2veWvCWswckyVY378IU6Bm</latexit><latexit sha1_base64="/9ZF0l+9BDz4Zgjman+1h2deJxo=">AAACHHicZVDLSgNBEJxNfMT4SvToZTEEPIVdEdRbJAdFLxHzgiSE2UknGTI7u8z0SsKST/CqN7/Gm3gV/BsnD8QkBQ1FVTfdXV4ouEbH+bESyY3Nre3UTnp3b//gMJM9qukgUgyqLBCBanhUg+ASqshRQCNUQH1PQN0blqZ+/RmU5oGs4DiEtk/7kvc4o2ikp1Gn0snknIIzg71O3AXJkQXKnayVbHUDFvkgkQmqddN1QmzHVCFnAibpVqQhpGxI+9A0VFIfdDue3Tqx80bp2r1AmZJoz9T/EzH1tR77nun0KQ70qjcV/7z80irsXbVjLsMIQbL5pl4kbAzs6ed2lytgKMaGUKa4OdZmA6ooQ5PP0poRlO4fzB8a0BCfcjm9Nb4JQwG3AQ44m6RNbO5qSOukdl5wnYL7eJErXi8CTJETckrOiEsuSZHckTKpEkb65IW8kjfr3fqwPq2veWvCWswckyVY378IU6Bm</latexit> <latexit sha1_base64="pW5gb1X+z4Mok3NTFuPlytDVYa4=">AAACH3icZVBNS8NAEN3U7/rV6tFLsAieSiKCeqv0oOilgm0FG2SzndrVzW7YnRRL6H/wqjd/jTfx2n/jpg1i7YOBx3szzMwLY8ENet7YKSwsLi2vrK4V1zc2t7ZL5Z2WUYlm0GRKKH0XUgOCS2giRwF3sQYahQLa4XM989sD0IYreYvDGIKIPkre44yilVqdQVeheShVvKo3gTtP/JxUSI7GQ9lZ6HQVSyKQyAQ15t73YgxSqpEzAaNiJzEQU/ZMH+HeUkkjMEE6OXfkHlil6/aUtiXRnah/J1IaGTOMQtsZUeyb/14m/noHM6uwdxqkXMYJgmTTTb1EuKjc7Hm3yzUwFENLKNPcHuuyPtWUoY1oZs0L1K+u7R8G0JKIcpndmp7HsYALhX3ORkUbm/8/pHnSOqr6XtW/Oa7UzvIAV8ke2SeHxCcnpEYuSYM0CSNP5JW8kXfnw/l0vpzvaWvByWd2yQyc8Q/YjqHl</latexit><latexit sha1_base64="pW5gb1X+z4Mok3NTFuPlytDVYa4=">AAACH3icZVBNS8NAEN3U7/rV6tFLsAieSiKCeqv0oOilgm0FG2SzndrVzW7YnRRL6H/wqjd/jTfx2n/jpg1i7YOBx3szzMwLY8ENet7YKSwsLi2vrK4V1zc2t7ZL5Z2WUYlm0GRKKH0XUgOCS2giRwF3sQYahQLa4XM989sD0IYreYvDGIKIPkre44yilVqdQVeheShVvKo3gTtP/JxUSI7GQ9lZ6HQVSyKQyAQ15t73YgxSqpEzAaNiJzEQU/ZMH+HeUkkjMEE6OXfkHlil6/aUtiXRnah/J1IaGTOMQtsZUeyb/14m/noHM6uwdxqkXMYJgmTTTb1EuKjc7Hm3yzUwFENLKNPcHuuyPtWUoY1oZs0L1K+u7R8G0JKIcpndmp7HsYALhX3ORkUbm/8/pHnSOqr6XtW/Oa7UzvIAV8ke2SeHxCcnpEYuSYM0CSNP5JW8kXfnw/l0vpzvaWvByWd2yQyc8Q/YjqHl</latexit><latexit sha1_base64="pW5gb1X+z4Mok3NTFuPlytDVYa4=">AAACH3icZVBNS8NAEN3U7/rV6tFLsAieSiKCeqv0oOilgm0FG2SzndrVzW7YnRRL6H/wqjd/jTfx2n/jpg1i7YOBx3szzMwLY8ENet7YKSwsLi2vrK4V1zc2t7ZL5Z2WUYlm0GRKKH0XUgOCS2giRwF3sQYahQLa4XM989sD0IYreYvDGIKIPkre44yilVqdQVeheShVvKo3gTtP/JxUSI7GQ9lZ6HQVSyKQyAQ15t73YgxSqpEzAaNiJzEQU/ZMH+HeUkkjMEE6OXfkHlil6/aUtiXRnah/J1IaGTOMQtsZUeyb/14m/noHM6uwdxqkXMYJgmTTTb1EuKjc7Hm3yzUwFENLKNPcHuuyPtWUoY1oZs0L1K+u7R8G0JKIcpndmp7HsYALhX3ORkUbm/8/pHnSOqr6XtW/Oa7UzvIAV8ke2SeHxCcnpEYuSYM0CSNP5JW8kXfnw/l0vpzvaWvByWd2yQyc8Q/YjqHl</latexit><latexit sha1_base64="pW5gb1X+z4Mok3NTFuPlytDVYa4=">AAACH3icZVBNS8NAEN3U7/rV6tFLsAieSiKCeqv0oOilgm0FG2SzndrVzW7YnRRL6H/wqjd/jTfx2n/jpg1i7YOBx3szzMwLY8ENet7YKSwsLi2vrK4V1zc2t7ZL5Z2WUYlm0GRKKH0XUgOCS2giRwF3sQYahQLa4XM989sD0IYreYvDGIKIPkre44yilVqdQVeheShVvKo3gTtP/JxUSI7GQ9lZ6HQVSyKQyAQ15t73YgxSqpEzAaNiJzEQU/ZMH+HeUkkjMEE6OXfkHlil6/aUtiXRnah/J1IaGTOMQtsZUeyb/14m/noHM6uwdxqkXMYJgmTTTb1EuKjc7Hm3yzUwFENLKNPcHuuyPtWUoY1oZs0L1K+u7R8G0JKIcpndmp7HsYALhX3ORkUbm/8/pHnSOqr6XtW/Oa7UzvIAV8ke2SeHxCcnpEYuSYM0CSNP5JW8kXfnw/l0vpzvaWvByWd2yQyc8Q/YjqHl</latexit> Table Lookup Table Lookup Table Lookup W<latexit sha1_base64="qXd0nsQcWREj5NaFiDsuNIpFW6A=">AAACGnicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2CvkBKvLmedWHb94M792JZPAXtK1dv6ZdtG3Tv+mpQ6QeuHA4517uvccLBdfoOD9WKr2xubWd2cnu7u0fHObyRw0dRIpBnQUiUC2PahBcQh05CmiFCqjvCWh648rMbz6B0jyQjzgJoevToeQDzigaqdbs5QpOyZnDXiduQgokQbWXt9KdfsAiHyQyQbVuu06I3Zgq5EzANNuJNISUjekQ2oZK6oPuxvNLp3bRKH17EChTEu25+n8ipr7WE98znT7FkV71ZuKfV1xahYOrbsxlGCFIttg0iISNgT372+5zBQzFxBDKFDfH2mxEFWVo0lla8wyV+wfzhwY0xKdczm6Nb8JQwG2AI86mWRObuxrSOmmcl1yn5NYuCuXrJMAMOSGn5Iy45JKUyR2pkjphBMgLeSVv1rv1YX1aX4vWlJXMHJMlWN+/UgCffg==</latexit><latexit sha1_base64="qXd0nsQcWREj5NaFiDsuNIpFW6A=">AAACGnicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2CvkBKvLmedWHb94M792JZPAXtK1dv6ZdtG3Tv+mpQ6QeuHA4517uvccLBdfoOD9WKr2xubWd2cnu7u0fHObyRw0dRIpBnQUiUC2PahBcQh05CmiFCqjvCWh648rMbz6B0jyQjzgJoevToeQDzigaqdbs5QpOyZnDXiduQgokQbWXt9KdfsAiHyQyQbVuu06I3Zgq5EzANNuJNISUjekQ2oZK6oPuxvNLp3bRKH17EChTEu25+n8ipr7WE98znT7FkV71ZuKfV1xahYOrbsxlGCFIttg0iISNgT372+5zBQzFxBDKFDfH2mxEFWVo0lla8wyV+wfzhwY0xKdczm6Nb8JQwG2AI86mWRObuxrSOmmcl1yn5NYuCuXrJMAMOSGn5Iy45JKUyR2pkjphBMgLeSVv1rv1YX1aX4vWlJXMHJMlWN+/UgCffg==</latexit><latexit sha1_base64="qXd0nsQcWREj5NaFiDsuNIpFW6A=">AAACGnicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2CvkBKvLmedWHb94M792JZPAXtK1dv6ZdtG3Tv+mpQ6QeuHA4517uvccLBdfoOD9WKr2xubWd2cnu7u0fHObyRw0dRIpBnQUiUC2PahBcQh05CmiFCqjvCWh648rMbz6B0jyQjzgJoevToeQDzigaqdbs5QpOyZnDXiduQgokQbWXt9KdfsAiHyQyQbVuu06I3Zgq5EzANNuJNISUjekQ2oZK6oPuxvNLp3bRKH17EChTEu25+n8ipr7WE98znT7FkV71ZuKfV1xahYOrbsxlGCFIttg0iISNgT372+5zBQzFxBDKFDfH2mxEFWVo0lla8wyV+wfzhwY0xKdczm6Nb8JQwG2AI86mWRObuxrSOmmcl1yn5NYuCuXrJMAMOSGn5Iy45JKUyR2pkjphBMgLeSVv1rv1YX1aX4vWlJXMHJMlWN+/UgCffg==</latexit><latexit sha1_base64="qXd0nsQcWREj5NaFiDsuNIpFW6A=">AAACGnicZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2CvkBKvLmedWHb94M792JZPAXtK1dv6ZdtG3Tv+mpQ6QeuHA4517uvccLBdfoOD9WKr2xubWd2cnu7u0fHObyRw0dRIpBnQUiUC2PahBcQh05CmiFCqjvCWh648rMbz6B0jyQjzgJoevToeQDzigaqdbs5QpOyZnDXiduQgokQbWXt9KdfsAiHyQyQbVuu06I3Zgq5EzANNuJNISUjekQ2oZK6oPuxvNLp3bRKH17EChTEu25+n8ipr7WE98znT7FkV71ZuKfV1xahYOrbsxlGCFIttg0iISNgT372+5zBQzFxBDKFDfH2mxEFWVo0lla8wyV+wfzhwY0xKdczm6Nb8JQwG2AI86mWRObuxrSOmmcl1yn5NYuCuXrJMAMOSGn5Iy45JKUyR2pkjphBMgLeSVv1rv1YX1aX4vWlJXMHJMlWN+/UgCffg==</latexit> Average ✓<latexit sha1_base64="hZLkpJDvmmUR8jVbSvY6z636d44=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2BvkBKvLmedWXb94M792JZPA/tK1dv6ZdtPXf9NQhUg9cOJxzL/fe44WCa3ScqZVKb2xubWd2srt7+weHufxRXQeRYlBjgQhU06MaBJdQQ44CmqEC6nsCGt6oMvMbL6A0D+QTjkPo+HQgeZ8zikaqt3EISLu5glNy5rDXiZuQAklQ7eatdLsXsMgHiUxQrVuuE2Inpgo5EzDJtiMNIWUjOoCWoZL6oDvx/NyJXTRKz+4HypREe67+n4ipr/XY90ynT3GoV72Z+OcVl1Zh/6oTcxlGCJItNvUjYWNgz563e1wBQzE2hDLFzbE2G1JFGZqIlta8QuX+wfyhAQ3xKZezW+ObMBRwG+CQs0nWxOauhrRO6ucl1ym5jxeF8nUSYIackFNyRlxyScrkjlRJjTDyTN7IO/mwPq0v69v6WbSmrGTmmCzBmv4CrAKhyw==</latexit><latexit sha1_base64="hZLkpJDvmmUR8jVbSvY6z636d44=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2BvkBKvLmedWXb94M792JZPA/tK1dv6ZdtPXf9NQhUg9cOJxzL/fe44WCa3ScqZVKb2xubWd2srt7+weHufxRXQeRYlBjgQhU06MaBJdQQ44CmqEC6nsCGt6oMvMbL6A0D+QTjkPo+HQgeZ8zikaqt3EISLu5glNy5rDXiZuQAklQ7eatdLsXsMgHiUxQrVuuE2Inpgo5EzDJtiMNIWUjOoCWoZL6oDvx/NyJXTRKz+4HypREe67+n4ipr/XY90ynT3GoV72Z+OcVl1Zh/6oTcxlGCJItNvUjYWNgz563e1wBQzE2hDLFzbE2G1JFGZqIlta8QuX+wfyhAQ3xKZezW+ObMBRwG+CQs0nWxOauhrRO6ucl1ym5jxeF8nUSYIackFNyRlxyScrkjlRJjTDyTN7IO/mwPq0v69v6WbSmrGTmmCzBmv4CrAKhyw==</latexit><latexit sha1_base64="hZLkpJDvmmUR8jVbSvY6z636d44=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2BvkBKvLmedWXb94M792JZPA/tK1dv6ZdtPXf9NQhUg9cOJxzL/fe44WCa3ScqZVKb2xubWd2srt7+weHufxRXQeRYlBjgQhU06MaBJdQQ44CmqEC6nsCGt6oMvMbL6A0D+QTjkPo+HQgeZ8zikaqt3EISLu5glNy5rDXiZuQAklQ7eatdLsXsMgHiUxQrVuuE2Inpgo5EzDJtiMNIWUjOoCWoZL6oDvx/NyJXTRKz+4HypREe67+n4ipr/XY90ynT3GoV72Z+OcVl1Zh/6oTcxlGCJItNvUjYWNgz563e1wBQzE2hDLFzbE2G1JFGZqIlta8QuX+wfyhAQ3xKZezW+ObMBRwG+CQs0nWxOauhrRO6ucl1ym5jxeF8nUSYIackFNyRlxyScrkjlRJjTDyTN7IO/mwPq0v69v6WbSmrGTmmCzBmv4CrAKhyw==</latexit><latexit sha1_base64="hZLkpJDvmmUR8jVbSvY6z636d44=">AAACH3icZVBNSwJRFH2jfZh9aS3bDInQSmYiqHaGi6I2BvkBKvLmedWXb94M792JZPA/tK1dv6ZdtPXf9NQhUg9cOJxzL/fe44WCa3ScqZVKb2xubWd2srt7+weHufxRXQeRYlBjgQhU06MaBJdQQ44CmqEC6nsCGt6oMvMbL6A0D+QTjkPo+HQgeZ8zikaqt3EISLu5glNy5rDXiZuQAklQ7eatdLsXsMgHiUxQrVuuE2Inpgo5EzDJtiMNIWUjOoCWoZL6oDvx/NyJXTRKz+4HypREe67+n4ipr/XY90ynT3GoV72Z+OcVl1Zh/6oTcxlGCJItNvUjYWNgz563e1wBQzE2hDLFzbE2G1JFGZqIlta8QuX+wfyhAQ3xKZezW+ObMBRwG+CQs0nWxOauhrRO6ucl1ym5jxeF8nUSYIackFNyRlxyScrkjlRJjTDyTN7IO/mwPq0v69v6WbSmrGTmmCzBmv4CrAKhyw==</latexit> Softmax
  10. 10. Type Default Value Type Default Value Max Epoch 100000 Dropout Input Keep Probability 0.8 Batch Size 1024 Dropout Intra Keep Probability 0.5 Unknown Count 3 Dropout Output Keep Probability 0.8 Target Perplexity 6.5 Dropout State Keep Probability 0.75 Threshold 0.963 Buckets [8, 13] Unk Ratio 0.333 Hidden Sizes [64, 64, 32] & [32, 64, 128] Learning Rate 0.0005 Bottleneck FALSE Unknown Percent 0.33 Bidirectional TRUE Max Gradient Norm 5 Min Vocab Count 2
  11. 11. 0.00241 0.00373 0.00236 0.00977 0.00598 0.00325 0.01231 0.02275 0.00433 0.00562 0.00681 0.00646 0.00762 0.00821 0.00945 0.01089 0.00809 0.01020 0.01464
  12. 12. ( ) (* 76 32 * ,( . , * 76 (, -0( * ( * , 76 32 ( 00* 0 * * 76 () . *. ( 76 32 -. (0 ) , 76 ) , ) .-0 * ) )) P , (* *( , C ), ( . ( , 76 5 1 9 : 8 4
  13. 13. )( - (

×