7. Variational Autoencoder
! o e v u
y td n o Qd
a o " d o
e o bd
– f: 9B: A B e o e b e
o
– s e f o b o bT
243i QN
( n V b ! dcpe ic ea A9B: A A9 T
! T d Qd o o V
• df xT d ea l f e
b o h bor g
– /G B 1A9B: A 6 BA 0 E E. B 8E ( )
– 5G B BA 6 BA /G B A9B: E E. B 8E - ,
7
8. Conditional VAE
• !(#) V
% &('|%) N. I M S
e T A
, 1 g e
• S & )|% A
0 E
E+(,|-,/) log
! 3 #, 4 ! #|4
5 # 3, 4
= E+(,|-,/) log ! 3 #, 4 − D9:[5 # 3, 4 ||! #|4 ]
8
#, 4 =33, 4 Generation
!(3|#, 4)
Inference
5(#|3, 4)
Prior
5(#|4) #
KL
9. Conditional VAE
Q
Q ! N G A :
– G : e "#
$..&
e '#
$..&
R
– "#
(
G W e '#
(
)(+,|./..0, +/..0, .,)
• A D D MN
A A
– ( )
9
10. DRAW
•
• R D
• ! E n e Q
W
" ! # = %
&'(
)
"&(!&|#, !-&)
• i D ng D G A
AV D ! AE
D A G
ng D N
10
14. GQN
for $ = 1 to (
Prior Distribution 01 21 231 = 45 21 ℎ7
Encoder RNN ℎ> = ?@@>AB CD, FD, G, H1, ℎ>, ℎ7
Posterior Sample 21 ~ O1 21 CD
, FD
, G, 231 = 4D
2 ℎ>
Decoder RNN ℎ7 = ?@@7>B FD, G, 21, ℎ7
KL Divergence DTU[O1 21 C, 231 ||01 21|231 ]
Canvas H1 = H1 + Δ ℎ7
Likelihood ^(CD
|4`
(Ha))
• AW FD, G C
• D A D A N
R () ) 14
15. • N ,10 n N
r !
– ( 2 )21, 20 1 l
!" = $(&", (")
! = *
"+,
-
!"
– ,10 u x
– P ,10 o 8
. tPe o
– ((N R N t ,10 Nu c
N R
– G g s Pa 8
15
16. ( ) GQN
G N
– L 2 M 2 s
l N GL 2 a
c2 G
– ( M c u a c2 r
G
• c L e2 M L
c u G
c u PL
– ( ) M
• M ( L c
e2 o LQ L M
A e2 G M 16
17. . 12
– R
–
–
– ) N MP GT
– LS C )
– ( A VQ
–
–
–
– D W
17
18. GQN
. /
– n
– v T
– a P
– a
. . / /
– . a
–
– :gfhk wu e:l sp
– ro cmib t
. - / /
–
– qy
P
18
19. Pixyz
• an E P to
vr Klb T an d
P e F P K P
• )() ( L T v
sw E P g i EL c D
19
20. • P
• z P E
L E
P co s T P
s
l a i hc
E
• Pr m a yE I T
, L
( PAA m x I
20
21. • r zu Ras N W p
– ! 10 26 4 D D D
– -,, nb ", ℎ 10 26 4 D D D
– - . 20 0 Wa % 10 26 4 D D D
–
• -,, gehdwc a 3 0: 4 A 0: 4
ki l
– R 1 0 vW x t x d m gehN-,, nb
Wa_ Ra 260 4 W
4 o 84 4 4 D 34 D 033 x d
-,, Ra
21
31. train.py
• loh R d G R G
( - ruG N : y ip s
G d
2:
p 12
c _ G cf
:21. 8:2
p )) FU F 12 2
fGnt P P a R G : 2 _ G cf
_ 2 T G eT R e
31
32. 2
1 , 0
– [ r a _ T
– t _P > r Ti g P _ a
_
– lho zx 9 0 . TP T T_ ]T >
a _ _
0 r _ TP >
_
– < -1T] -1 - , _
1 , 0 . 1
0 , 0
– cm r y s _
– t T [> ]ep npd _ i g P
– < >9, T >9, , a
32