ujava.org forum workshop, RNN (Recurrent Neural Network), Fractal for Deep Learning, speaker is Shindong Kang, CEO of www.idosi.com

1. Recurrent Neural Network, Fractal
for Deep Learning
ujava.org Workshop
2015-05-17
www.idosi.com
CEO 강신동
Shindong KANG
(주)지능도시

2. www.idosi.comujava.org

3. www.idosi.comspaceapi.org

4. www.idosi.comRecurrent Stream

5. www.idosi.comFunction
y = f(x)
y = x
x
y

6. www.idosi.comx = f(x)
y = 2x
y = x
x
y

7. www.idosi.comConvergence & Attractor

8. www.idosi.comDivergence (발산)

9. www.idosi.comCobweb (거미줄망)

10. www.idosi.comCobweb Plot (Cobweb Diagram)

11. www.idosi.comSRN (Simple Recurrent Network)

12. www.idosi.comElman Recurrent Neural Network
Elastic
ElmanA ?

13. www.idosi.comJordan Recurrent Neural Network
Jordan
결과?

14. www.idosi.comJordan & Elman Recurrent Neural Network

15. www.idosi.comESN (Echo State Network)

16. www.idosi.comESN (Echo State Network)

17. www.idosi.comESN (Echo State Network)

18. www.idosi.comSecond Order RNN

19. www.idosi.comLSTM (Long Short Term Memory) Cell
n-th layer
K-th cell
1 : step delay
Learn if input gate
and output gate ON

20. www.idosi.comLSTM (Long Short Term Memory) Network

21. www.idosi.comLSTM Real-time Streaming Recognition

22. www.idosi.comBi-directional RNN
Hopfield Neural Network

23. www.idosi.comOrdinary Differential Equation (상미분 방정식)
One variable differential equation
f'(x) = 0

24. www.idosi.comContinuous-time RNN
Real neuron simulation
Ordinary differntial Eq.

25. www.idosi.comContinuous-time RNN

26. www.idosi.comMultiple Timescales RNN (MTRNN)
Brain Activity Imitation

27. www.idosi.comBAM (Bidirectional Associative Memory, 양방향 연상 메모리)
Image → Name
Name → Image

28. www.idosi.comRestricted Boltzmann Machine (RBM)

29. www.idosi.comFractal (프랙탈)

30. www.idosi.comInfinity & Cantor (무한, 칸토어)
Cantor 1845-1918
Mathematical Set Creator
German, Jewish
Psychiatric hospital
{1,2,3,4, … }
{2,4,6,8, ...)

31. www.idosi.comCantor Set (칸토어 집합)

32. www.idosi.comCantor Set (칸토어 집합)

33. www.idosi.comHausdorff Dimension (하우스도르프 차원)

34. www.idosi.comFractal

35. www.idosi.comCoastline Length

36. www.idosi.comCoastline Length

37. www.idosi.comKoch Snowflake Curve, Koch Island (코흐눈송이곡선, 코흐섬)
D=1.26...

38. www.idosi.comSierpinski Triangle (시에르핀스키 삼각형)

39. www.idosi.comFractal Tree (프랙탈 나무)

40. www.idosi.comCobweb Plot

41. www.idosi.comAttractor (끌개)

42. www.idosi.comLogistic Map

43. www.idosi.comMandelbrot Set (만델브로 집합)

44. www.idosi.comMandelbrot Set (만델브로 집합)

45. www.idosi.comRabbit Island Population with Chaos

46. www.idosi.comRabbit Island Population with Chaos
X = a X (1 - X)

47. www.idosi.comRabbit Island Population with Chaos

48. www.idosi.comRabbit Island Population with Chaos
Chaos Code Demo

49. www.idosi.comBifurcation

50. www.idosi.comBifurcation Sound

51. www.idosi.comFractal & Bifurcation

52. Thank you !
(주)지능도시
Intelligent City Ltd.
강신동
Shindong KANG
www.idosi.com
ceo@idosi.com