SlideShare une entreprise Scribd logo
1  sur  22
Télécharger pour lire hors ligne
(
5LU 4Z P H HZ U HUK 4UK L :V KVU EPS VU
6V ULSS CUP L PZ_
( -
k f l
k y e f l
P
• y
• LUZHPSTLUZ y
•
•
• LUZHPSTLUZ
• V ZWL MV T
n
• >P VSV ( )
• A: A
•
• eLUZHPSTLUZ y
• y
• j k il
• HUN ( (
• LLSH HUZHU (
• BPHU (
• y
• DPSUP HUK > 6HSS T ( + (N
•
• LUZHPSTLUZ
• y
A: A
HUN n
(N n
n
• >P VSV ( )
• A: A
•
• eLUZHPSTLUZ y
• y
• j k il
• HUN ( (
• LLSH HUZHU (
• BPHU (
• y
• DPSUP HUK > 6HSS T ( + (N
•
• LUZHPSTLUZ
• y
A: A
HUN n
(N n
2 m
j
n m D E
kx l
(N
y x
• b d 1u
• d p
g ZZW / ZLU V MSV V N Z ZV PHS V K( L g ZZW / LU P PWLKPH V N P P 7P H GKLSZHGM U ZPVU
o dip ]x
• M <
• <g
• ag k l
• W/ h
e lg r
• M N
• j L WL ZLK SP LSP VVK L ULS
• =(
•
e lg r
• W vL W 8
• LUL N_ H LK
• W j 8
• /A: A 8
• W
• 0 W 0
• wW K 1 k F 8 yl
• F k l
s r
• TH TH NPU HU PUN V L ZP L
) 2 2
•
• V
• r
• k7 l
• s
• M P Z M P N Z N dMP dN
• ao
• =c
• 8c k =co l e
• dMP dN o k y l
• a y k dMP dN l
2
•
• Z eM
• ULNHZP L HTWSPUN
• (
u W S aM
t
• s
EV K APTPSH PZ_
( EV K APTPSH PZ_ MV VS_ LTV EV K
• j
• g
) EV K 8UZHPSTLUZ
• LUZHPSTLUZ KHZH LZ 5H VUP ( (
• g4 L HNL L P PVU
• K 1 + V (
• VUZL Z PUKV 1 V +
• < 1rV )
• j kLS
• T
• j TL
• ” j y
( / NU (N (N <1(
•
• j gEV KAPT )+)
• m ZVW V K y
y y
D E
• j gA6EA
• y
p W b S aM
•
• V e (N2 (NT
• (N/ ,+
• TH y
• (NT/ .(
• y
• y
• j g5H VUP ( (
• WV PZP L WHP ULNHZP L WHP
• PTPSH PZ_ TLH L
• V PT <=
• ” <= ” y
• <= LUZHPSTLUZ
• (N
y
(
[
• LUZHPSTLUZ
•
• y

Contenu connexe

Plus de Makoto Takenaka

Lpixel論文読み会資料 "Interpretation of neural network is fragile"
Lpixel論文読み会資料 "Interpretation of neural network is fragile"Lpixel論文読み会資料 "Interpretation of neural network is fragile"
Lpixel論文読み会資料 "Interpretation of neural network is fragile"Makoto Takenaka
 
Understanding the origin of bias in word embeddings
Understanding the origin of bias in word embeddingsUnderstanding the origin of bias in word embeddings
Understanding the origin of bias in word embeddingsMakoto Takenaka
 
[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding
[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding
[NeurIPS2018読み会@PFN] On the Dimensionality of Word EmbeddingMakoto Takenaka
 
[研究室論文紹介用スライド] Adversarial Contrastive Estimation
[研究室論文紹介用スライド] Adversarial Contrastive Estimation[研究室論文紹介用スライド] Adversarial Contrastive Estimation
[研究室論文紹介用スライド] Adversarial Contrastive EstimationMakoto Takenaka
 
Probabilistic fasttext for multi sense word embeddings
 Probabilistic fasttext for multi sense word embeddings Probabilistic fasttext for multi sense word embeddings
Probabilistic fasttext for multi sense word embeddingsMakoto Takenaka
 
Deep neural models of semantic shift
Deep neural models of semantic shiftDeep neural models of semantic shift
Deep neural models of semantic shiftMakoto Takenaka
 
All-but-the-Top: Simple and Effective Postprocessing for Word Representations
All-but-the-Top: Simple and Effective Postprocessing for Word RepresentationsAll-but-the-Top: Simple and Effective Postprocessing for Word Representations
All-but-the-Top: Simple and Effective Postprocessing for Word RepresentationsMakoto Takenaka
 
Adversarial Multi-task Learning for Text Classification
Adversarial Multi-task Learning for Text ClassificationAdversarial Multi-task Learning for Text Classification
Adversarial Multi-task Learning for Text ClassificationMakoto Takenaka
 

Plus de Makoto Takenaka (8)

Lpixel論文読み会資料 "Interpretation of neural network is fragile"
Lpixel論文読み会資料 "Interpretation of neural network is fragile"Lpixel論文読み会資料 "Interpretation of neural network is fragile"
Lpixel論文読み会資料 "Interpretation of neural network is fragile"
 
Understanding the origin of bias in word embeddings
Understanding the origin of bias in word embeddingsUnderstanding the origin of bias in word embeddings
Understanding the origin of bias in word embeddings
 
[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding
[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding
[NeurIPS2018読み会@PFN] On the Dimensionality of Word Embedding
 
[研究室論文紹介用スライド] Adversarial Contrastive Estimation
[研究室論文紹介用スライド] Adversarial Contrastive Estimation[研究室論文紹介用スライド] Adversarial Contrastive Estimation
[研究室論文紹介用スライド] Adversarial Contrastive Estimation
 
Probabilistic fasttext for multi sense word embeddings
 Probabilistic fasttext for multi sense word embeddings Probabilistic fasttext for multi sense word embeddings
Probabilistic fasttext for multi sense word embeddings
 
Deep neural models of semantic shift
Deep neural models of semantic shiftDeep neural models of semantic shift
Deep neural models of semantic shift
 
All-but-the-Top: Simple and Effective Postprocessing for Word Representations
All-but-the-Top: Simple and Effective Postprocessing for Word RepresentationsAll-but-the-Top: Simple and Effective Postprocessing for Word Representations
All-but-the-Top: Simple and Effective Postprocessing for Word Representations
 
Adversarial Multi-task Learning for Text Classification
Adversarial Multi-task Learning for Text ClassificationAdversarial Multi-task Learning for Text Classification
Adversarial Multi-task Learning for Text Classification
 

multimodal word distributions

  • 1. ( 5LU 4Z P H HZ U HUK 4UK L :V KVU EPS VU 6V ULSS CUP L PZ_ ( - k f l k y e f l
  • 4. n • >P VSV ( ) • A: A • • eLUZHPSTLUZ y • y • j k il • HUN ( ( • LLSH HUZHU ( • BPHU ( • y • DPSUP HUK > 6HSS T ( + (N • • LUZHPSTLUZ • y A: A HUN n (N n
  • 5. n • >P VSV ( ) • A: A • • eLUZHPSTLUZ y • y • j k il • HUN ( ( • LLSH HUZHU ( • BPHU ( • y • DPSUP HUK > 6HSS T ( + (N • • LUZHPSTLUZ • y A: A HUN n (N n 2 m j
  • 6. n m D E kx l (N
  • 7. y x • b d 1u • d p g ZZW / ZLU V MSV V N Z ZV PHS V K( L g ZZW / LU P PWLKPH V N P P 7P H GKLSZHGM U ZPVU
  • 8. o dip ]x • M < • <g • ag k l • W/ h
  • 9. e lg r • M N • j L WL ZLK SP LSP VVK L ULS • =( •
  • 10. e lg r • W vL W 8 • LUL N_ H LK • W j 8 • /A: A 8 • W • 0 W 0 • wW K 1 k F 8 yl • F k l
  • 11. s r • TH TH NPU HU PUN V L ZP L
  • 12. ) 2 2 • • V • r • k7 l • s • M P Z M P N Z N dMP dN • ao • =c • 8c k =co l e • dMP dN o k y l • a y k dMP dN l
  • 13. 2 • • Z eM • ULNHZP L HTWSPUN • (
  • 14. u W S aM
  • 15. t • s EV K APTPSH PZ_ ( EV K APTPSH PZ_ MV VS_ LTV EV K • j • g ) EV K 8UZHPSTLUZ • LUZHPSTLUZ KHZH LZ 5H VUP ( ( • g4 L HNL L P PVU • K 1 + V ( • VUZL Z PUKV 1 V + • < 1rV )
  • 16. • j kLS • T • j TL
  • 17. • ” j y ( / NU (N (N <1(
  • 18. • • j gEV KAPT )+) • m ZVW V K y y y
  • 19. D E • j gA6EA • y
  • 20. p W b S aM • • V e (N2 (NT • (N/ ,+ • TH y • (NT/ .( • y • y
  • 21. • j g5H VUP ( ( • WV PZP L WHP ULNHZP L WHP • PTPSH PZ_ TLH L • V PT <= • ” <= ” y • <= LUZHPSTLUZ • (N y (