SlideShare une entreprise Scribd logo
1  sur  114
Télécharger pour lire hors ligne
1
۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬
‫ﺻﺪﯾﻘﯽ‬ ‫ﺍاﻣﯿﺮ‬
‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
@amirsedighi :‫ﺗﻮ4ﺘﺮ‬
:‫ﺍاﯾﻤﯿﻞ‬sedighi@gmail.com
‫‌ﻫﺎ‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ،‫ﺩدﺍاﺩدﻩه‬ ‫‌ﻫﺎﯼی‬‫ﻥن‬‫ﺟﺮﯾﺎ‬ ،(‫‌ﺩدﺍاﺩدﻩه‬‫ﻪ‬ ِ‫)ﻣ‬ ‫‌ﺑﺰﺭرﮒگ‬‫ﯼی‬‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬ - ‫ﺳﻮﻡم‬ ‫ﺭرﻭوﺯز‬
‫ﺻﺪﯾﻘﯽ‬ ‫ﺍاﻣﯿﺮ‬
:‫ﻣﻮﺳﺲ‬
2
‫ﻣﻌﺮﻓﯽ‬
http://recommender.ir
http://helio.ir
http://commentum.ir
@amirsedighi :‫ﺗﻮ4ﺘﺮ‬
:‫ﺍاﯾﻤﯿﻞ‬sedighi@gmail.com
3
‫‌ﺁآﻣﻮﺯزﯾﻢ‬‫ﯽ‬‫ﻣ‬ ‫ﺍاﻣﺮﻭوﺯز‬ ‫ﺁآﻧﭽﻪ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(BigData Processing) (‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫‌ﺩدﺍاﺩدﻩه/ﺩدﺍاﺩد‬‫ﻥن‬‫‌ﺩدﯾﺘﺎ/ﮐﻼ‬‫ﮓ‬‫)ﺑﯿ‬ ‫‌ﺩدﺍاﺩدﻩه‬‫ﻪ‬ ِ‫ﻣ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬
(Data Streaming) ‫ﺩدﺍاﺩدﻩه‬ ‫‌ﻫﺎﯼی‬‫ﻥن‬‫ﺟﺮﯾﺎ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬
‫ﺩدﺍاﺩدﻩه‬ ‫‌ﻫﺎﯼی‬‫ﻥن‬‫ﺟﺮﯾﺎ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﺣﻮﺯزﻩه‬ ‫ﺩدﺭر‬ ‫ﺻﻨﻌﺖ‬ ‫ﻭو‬ ‫‌ﮐﺎﺭر‬‫ﻭو‬‌‫ﺐ‬‫ﮐﺴ‬ ‫‌ﻫﺎﯼی‬‫ﺯز‬‫ﻧﯿﺎ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬
‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‌‫ﺵش‬‫ﭘﺮﺩدﺍاﺯز‬ ‫ﺯزﯾﺮﺳﺎﺧﺖ‬ ‫‌ﺗﺮﯾﻦ‬‫ﺭر‬‫ﻣﺸﻬﻮ‬ ‫ﺑﮑﺎﺭرﮔﯿﺮﯼی‬ ‫ﻧﻤﻮﻧﻪ‬ ‫ﯾﮏ‬
‫‌ﺷﯿﻢ‬‫ﯽ‬‫ﻣ‬ ‫ﺁآﺷﻨﺎ‬ ‫ﺣﻮﺯزﻩه‬ ‫ﺍاﯾﻦ‬ ‫ﭘﺮﮐﺎﺭرﺑﺮﺩد‬ ‫‌ﺑﺎﺯز‬‫ﻦ‬‫ﻣﺘ‬ ‫ﺍاﺑﺰﺍاﺭرﻫﺎﯼی‬ ‫ﺑﺎ‬
4
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﭘﺎﯾﻪ‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﻭو‬ ‫ﺗﺎﺭرﯾﺨﭽﻪ‬
‫ﺳﺮﻓﺼﻞ‬
‫‌ﻫﺎ‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﺵش‬‫ﺭرﻭو‬
5
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻭوﺍاﻗﻌﯿﺖ‬ ‫ﺗﺎ‬ ‫ﺗﺼﻮﺭرﺍاﺕت‬ ‫ﺍاﺯز‬
6
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬
‫‌ﺩدﺍاﺩدﻩه‬‫ﻪ‬ ِ‫ﻣ‬
‫‌ﺩدﺍاﺩدﻩه‬‫ﻥن‬‫ﮐﻼ‬
‫‌ﺩدﯾﺘﺎ‬‫ﮓ‬‫ﺑﯿ‬
Big-Data
‫ﻣﻘﺪﻣﻪ‬
7
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
:‫ﭘﯿﺶ‬ ‫ﺳﺎﻝل‬ ‫ﭼﻨﺪ‬ ‫ﻫﻤﯿﻦ‬
‫ﺩدﯾﺮﻭوﺯز‬
8
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺩدﯾﺮﻭوﺯز‬
9
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺩدﯾﺮﻭوﺯز‬
10
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺩدﯾﺮﻭوﺯز‬
11
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺩدﯾﺮﻭوﺯز‬
640KB
1.2MB
12
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ‬‫ﺭر‬‫ﻫﻨﺠﺎ‬ ‫ﺮ‬K‫ﺗﻐ‬
13
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
14
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
15
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
16
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
17
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
18
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
19
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
20
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺩدﺍاﺩدﻩه‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﻭو‬ ‫ﺗﮑﺜﯿﺮ‬ ،‫ﺗﻮﻟﯿﺪ‬ ‫‌ﻫﺎﯼی‬‫ﺵش‬‫ﺭرﻭو‬ ‫ﺗﮑﺎﻣﻞ‬
21
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫ﺗﻨﻮﻉع‬ ‫ﻭو‬ ‫ﺗﻌﺪﺍاﺩد‬ ‫ﺭرﺷﺪ‬ ‫ﺍاﺯز‬ ‫ﻧﺎﺷﯽ‬ ‫ﺍاﺛﺮﺍاﺕت‬
22
Welcome to the Machine‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
23
(‫)ﺧﻮﺩدﻣﺎﻧﯽ‬ ‫ﺗﻌﺮﯾﻒ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﺷﻮﻧﺪ‬‫ﯽ‬‫ﻣ‬ ‫ﻣﺴﺌﻠﻪ‬ ‫ﺍاﺯز‬ ‫ﺑﺨﺸﯽ‬ ‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬
(… SQL-Server ،MySQL ،‫)ﺍاﮐﺴﻞ‬ ‫ﻣﺘﺪﺍاﻭوﻝل‬ ‫‌ﻫﺎﯼی‬‫ﺵش‬‫ﺭرﻭو‬ ‫ﻧﺎﺗﻮﺍاﻧﯽ‬
24
‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﺍاﺯز‬ ‫ﮔﺎﺭرﻧﺘﺮ‬ ‫ﺗﻌﺮﯾﻒ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
25
‫ﺍاﻧﺪﺍاﺯزﻩه‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
26
‫ﺳﺮﻋﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
27
‫ﺗﻨﻮﻉع‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
28
‫ﺻﺤﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
29
‫ﺛﺎﻧﯿﻪ‬ ‫ﯾﮏ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
30
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻣﻘﺪﻡم‬ ‫ﺧﻂ‬
31
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻣﻘﺪﻡم‬ ‫ﺧﻂ‬
Data Scientist
Data Engineer
32
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻣﻘﺪﻡم‬ ‫ﺧﻂ‬
33
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻭوﺏب‬ ‫ﺻﻔﺤﺎﺕت‬
34
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
!‫ﭘﺴﻨﺪﯾﺪﻡم‬
35
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
(‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫)ﻧﻈﺮ‬ ‫‌ﻫﺎ‬‫ﺖ‬‫ﮐﺎﻣﻨ‬
36
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‌‫ﻮ‬‫ﻭوﯾﺪﺋ‬
37
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻣﺎﻟﯽ‬ ‫‌ﻫﺎﯼی‬‫ﺶ‬‫ﺗﺮﺍاﮐﻨ‬
38
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫‌ﻫﺎ‬‫ﺖ‬4‫ﺗﻮ‬
39
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﺗﺼﻮﯾﺮ‬
40
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻻﮒگ‬
41
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻻﮒگ‬
‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬
42
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻻﮒگ‬
‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬
‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬
43
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻻﮒگ‬
‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬
‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬
‫ﺍاﭘﻠﯿﮑﯿﺸﻦ‬ ‫ﻻﮒگ‬
44
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻻﮒگ‬
‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬
‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬
‫ﺍاﭘﻠﯿﮑﯿﺸﻦ‬ ‫ﻻﮒگ‬
‫ﺳﯿﺴﺘﻢ‬ ‫ﻻﮒگ‬
45
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬
‫ﻻﮒگ‬
‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬
‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬
‫ﺍاﭘﻠﯿﮑﯿﺸﻦ‬ ‫ﻻﮒگ‬
‫ﺳﯿﺴﺘﻢ‬ ‫ﻻﮒگ‬
(‫‌ﻫﺎ‬‫ﺰ‬‫‌ﭼﯿ‬‫ﺖ‬‫)ﺍاﯾﻨﺘﺮﻧ‬ ‫ﺯزﻧﺪﮔﯽ‬ ‫ﻻﮒگ‬
46
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺍاﺻﻠﯽ‬ ‫ﻣﻨﺒﻊ‬
47
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺍاﺻﻠﯽ‬ ‫ﻣﻨﺒﻊ‬
http://hadoopilluminated.com/hadoop_illuminated
48
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﻫﺎ‬‫ﺖ‬‫ﻣﺤﺪﻭوﺩدﯾ‬
‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﺑﺮﺍاﯼی‬ (Platform) ‫‌ﺳﺎﺯزﻩه‬‫ﻦ‬‫ﺑ‬ ‫ﯾﮏ‬ ‫ﺩدﺳﺘﺮﺱس‬ ‫ﺩدﺭر‬ ‫ﻭو‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﺗﺠﻬﯿﺰﺍاﺕت‬ ‫ﺗﻮﺳﻂ‬ ‫ﭼﮕﻮﻧﻪ‬
‫ﺑﺒﯿﻨﯿﻢ؟‬ ‫ﺗﻬﯿﻪ‬ ‫‌ﺑﺰﺭرﮒگ‬‫ﯼی‬‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬
49
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
50
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
51
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
Scale-Up
52
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
Scale-Out
Scale-Up
53
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
54
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
55
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺮﺁآﻏﺎﺯز‬
56
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺮﺁآﻏﺎﺯز‬
1999
57
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺮﺁآﻏﺎﺯز‬
1999
2002
58
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺮﺁآﻏﺎﺯز‬
1999
2002
59
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﭼﮕﻮﻧﻪ؟‬
Q!‫‌ﻭوﺭرﯾﻢ؟‬‫ﺎ‬‫ﺑﯿ‬ ‫ﺑﺪﺳﺖ‬ ‫ﺧﻄﯽ‬ ‫ﭘﺬﯾﺮﯼی‬ ‫ﻣﻘﯿﺎﺱس‬ ‫ﻗﯿﻤﺖ‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﻣﺎﺷﯿﻦ‬ ‫ﺯزﯾﺎﺩدﯼی‬ ‫ﺗﻌﺪﺍاﺩد‬ ‫ﮐﻤﮏ‬ ‫ﺑﻪ‬ ‫ﭼﮕﻮﻧﻪ‬
60
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
Q!‫‌ﻭوﺭرﯾﻢ؟‬‫ﺎ‬‫ﺑﯿ‬ ‫ﺑﺪﺳﺖ‬ ‫ﺧﻄﯽ‬ ‫ﭘﺬﯾﺮﯼی‬ ‫ﻣﻘﯿﺎﺱس‬ ‫ﻗﯿﻤﺖ‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﻣﺎﺷﯿﻦ‬ ‫ﺯزﯾﺎﺩدﯼی‬ ‫ﺗﻌﺪﺍاﺩد‬ ‫ﮐﻤﮏ‬ ‫ﺑﻪ‬ ‫ﭼﮕﻮﻧﻪ‬
A(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
61
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺮﺁآﻏﺎﺯز‬
1999
2002
2003 ..
62
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺮﺁآﻏﺎﺯز‬
1999
2002
2006200
63
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﭘﺎﯾﻪ‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﻭو‬ ‫ﺗﺎﺭرﯾﺨﭽﻪ‬
‫‌ﻫﺎ‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﺵش‬‫ﺭرﻭو‬
64
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﺗﻮﺍاﻥن‬ ‫ﺍاﻓﺰﺍاﯾﺶ‬ - ‫ﭘﺮﺳﺶ‬
Q‫ﺍاﯾﺸﺎﻥن‬ ‫ﺍاﺯز‬ .‫ﺍاﺳﺖ‬ ‫ﮔﺮﻓﺘﻪ‬ ‫ﻗﺮﺍاﺭر‬ ‫ﻋﻠﯽ‬ ‫ﻭو‬ ‫ﺳﺎﺳﺎﻥن‬ ،‫ﭘﯿﺎﻡم‬ ‫ﺍاﺧﺘﯿﺎﺭر‬ ‫ﺩدﺭر‬ ‫ﻓﺮﺩدﻭوﺳﯽ‬ ‫ﺷﺎﻫﻨﺎﻣﻪ‬ ‫ﺟﻠﺪ‬ ‫ﯾﮏ‬
.‫ﺑﺸﻤﺎﺭرﻧﺪ‬ ‫ﺭرﺍا‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺍاﺳﺎﻣﯽ‬ ‫ﻣﻤﮑﻦ‬ ‫ﺭرﻭوﺵش‬ ‫‌ﺗﺮﯾﻦ‬‫ﻊ‬‫ﺳﺮﯾ‬ ‫ﺑﻪ‬ ‫‌ﺍاﻧﺪ‬‫ﻪ‬‫ﺧﻮﺍاﺳﺘ‬
‫‌ﮐﻨﯿﺪ؟‬‫ﯽ‬‫ﻣ‬ ‫ﭘﯿﺸﻨﻬﺎﺩد‬ ‫ﺭرﻭوﺷﯽ‬ ‫ﭼﻪ‬
65
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
66
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
67
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
68
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
69
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
70
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
71
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
72
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
73
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﺎﺳﺎﻥن‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
74
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺳﺎﺳﺎﻥن‬
75
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺳﺎﺳﺎﻥن‬
map() shuffle() reduce()splitting()
76
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﭘﯿﺎﻡم‬
‫ﺳﺎﺳﺎﻥن‬
‫ﻋﻠﯽ‬
‫ﺭرﻭوﺩدﺍاﺑﻪ‬
‫ﺭرﺳﺘﻢ‬
‫ﺳﻬﺮﺍاﺏب‬
‫ﺳﺎﺳﺎﻥن‬
map() shuffle() reduce()
[k1,v1] by k1 [k1,[v1, v2, v3 …]]
77
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
78
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺍاﻃﻤﯿﻨﺎﻥن‬ ‫ﺿﺮﯾﺐ‬ ‫ﺍاﻓﺰﺍاﯾﺶ‬ - ‫ﭘﺮﺳﺶ‬
Q‫ﮐﺎﻣﭙﯿﻮﺗﺮ‬ ‫ﻫﺮ‬ ‫ﺍاﯾﻨﮑﻪ‬ ‫ﺑﻔﺮﺽض‬ .‫‌ﺍاﯾﻢ‬‫ﻩه‬‫ﮐﺮﺩد‬ ‫ﺗﻬﯿﻪ‬ ‫ﻗﯿﻤﺖ‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﮐﺎﻣﭙﯿﻮﺗﺮ‬ ۳۶۵ ‫ﺑﺎ‬ ‫ﺧﻮﺷﻪ‬ ‫ﯾﮏ‬
‫ﯾﮏ‬ ‫ﺭرﻭوﺯزﺍاﻧﻪ‬ ‫ﻣﺘﻮﺳﻂ‬ ‫ﻃﻮﺭر‬ ‫ﺑﻪ‬ (‫ﺧﺮﺍاﺑﯽ‬ ‫ﻧﻮﻉع‬ ‫)ﻫﺮ‬ ‫ﺷﻮﺩد‬ ‫ﺧﺮﺍاﺏب‬ ‫ﯾﮑﺒﺎﺭر‬ ‫ﺳﺎﻟﯽ‬ ‫ﺗﻨﻬﺎ‬ ،‫‌ﻗﯿﻤﺖ‬‫ﻥن‬‫ﺍاﺭرﺯزﺍا‬
‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﺳﻼﻣﺖ‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﺳﻼﻣﺖ‬ ‫ﭼﮕﻮﻧﻪ‬ ‫ﺷﺮﺍاﯾﻄﯽ‬ ‫ﭼﻨﯿﻦ‬ ‫ﺩدﺭر‬ .‫ﺩدﺍاﺷﺖ‬ ‫ﺧﻮﺍاﻫﯿﻢ‬ ‫ﺧﺮﺍاﺑﯽ‬
‫ﮐﻨﯿﻢ؟‬ ‫ﺗﻀﻤﯿﻦ‬ ‫ﺭرﺍا‬ (‫ﻣﺤﺴﺒﺎﺗﯽ‬ ‫ﻋﻤﻠﯿﺎﺕت‬ ‫)ﺗﮑﺮﺍاﺭرﭘﺬﯾﺮﯼی‬
79
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(DFS) ‫ﺷﺪﻩه‬ ‫ﺗﻮﺯزﯾﻊ‬ ‫ﻓﺎﯾﻞ‬ ‫ﺳﺎﻣﺎﻧﻪ‬
80
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
(DFS) ‫ﺷﺪﻩه‬ ‫ﺗﻮﺯزﯾﻊ‬ ‫ﻓﺎﯾﻞ‬ ‫ﺳﺎﻣﺎﻧﻪ‬
81
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﺰ‬‫ﺳﺎﯾ‬ ‫ﺑﻼﮎک‬
82
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﺷﺪﻩه‬‫ﻊ‬‫‌ﺗﻮﺯزﯾ‬‫ﻞ‬‫‌ﻓﺎﯾ‬+ ‫‌ﺷﺪﻩه‬‫ﻊ‬‫ﺗﻮﺯزﯾ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ = ‫ﻫﺪﻭوﭖپ‬
Hadoop = HDFS + MapReduce
83
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺭرﻋﯿﺘﯽ‬ /‫ﺍاﺭرﺑﺎﺏب‬
84
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺭرﻋﯿﺘﯽ‬ /‫ﺍاﺭرﺑﺎﺏب‬
85
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻫﺪﻭوﭖپ‬
86
‫ﺩدﯾﮕﺮ‬ ‫‌ﻫﺎﯼی‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫‌ﺑﺎﺯز‬‫ﻦ‬‫ﻣﺘ‬ ‫ﻗﺪﺭرﺗﻤﻨﺪ‬ ‫ﺍاﺑﺰﺍاﺭر‬ ‫ﭼﻨﺪ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬
(Transfer) ‫ﺟﺎﺑﺠﺎﯾﯽ‬
‫‌ﺳﺎﺯزﯼی‬‫ﻩه‬‫ﺫذﺧﯿﺮ‬
(Join) ‫ﺍاﺭرﺗﺒﺎﻁط‬ ‫ﺑﺮﻗﺮﺍاﺭرﯼی‬
(Index) ‫‌ﮔﺬﺍاﺭرﯼی‬‫ﺲ‬‫ﺍاﻧﺪﯾ‬
(Analytics) ‫ﺗﺤﻠﯿﻞ‬
(Aggregate) ‫ﺗﺠﻤﯿﻊ‬
(Visualize) ‫‌ﺳﺎﺯزﯼی‬‫ﻪ‬‫ﻧﻤﺎﯾ‬
87
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻣﺎ‬ ‫‌ﻫﺎﯼی‬‫ﯼی‬‫ﻧﯿﺎﺯزﻣﻨﺪ‬
Image ref: http://supplychaininsightsglobalsummit.com/steps-4-5-to-regain-manufacturing-prowess/
88
‫‌ﺩدﺍاﺩدﻩه‬‫ﻩه‬‫ﭘﺎﯾﮕﺎ‬ ‫ﺍاﻧﻮﺍاﻉع‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
89
SQL ‫ﻭوﺍاﺳﻂ‬ ‫ﺍاﻧﻮﺍاﻉع‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
• Hive
• Drill
• Impala
90
‫ﺩدﺍاﺩدﻩه‬ ‫ﺍاﻧﺘﻘﺎﻝل‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
91
‫ﮔﺬﺍاﺭرﯼی‬ ‫ﺍاﻧﺪﯾﺲ‬ ‫ﻭو‬ ‫ﺟﺴﺘﺠﻮ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
92
‫ﺻﻒ‬ ‫ﻣﺪﯾﺮﯾﺖ‬ ‫ﻭو‬ ‫ﺭرﺳﺎﻧﯽ‬ ‫ﭘﯿﺎﻡم‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
93
‫ﻓﺎﯾﻞ‬ ‫ﻻﮒگ‬ ‫ﻣﺪﯾﺮﯾﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
94
‫ﺩدﺍاﺩدﻩه‬ ‫ﺟﺮﯾﺎﻥن‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Apache Flink
95
‫ﻣﺎﺷﯿﻦ‬ ‫ﯾﺎﺩدﮔﯿﺮﯼی‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Apache Hama
TensorFlow
SystemML
96
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬
‫ﺑﻨﻮﯾﺴﯿﻢ‬ ‫ﮐﺪ‬
97
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬
.‫ﮐﻨﯿﺪ‬ ‫ﻣﺮﺗﺐ‬ ‫ﻓﺮﺍاﻭوﺍاﻧﯽ‬ ‫ﺍاﺳﺎﺱس‬ ‫ﺑﺮ‬ ‫ﻭو‬ ‫ﺑﺸﻤﺎﺭرﯾﺪ‬ ‫ﺭرﺍا‬ ‫ﺷﺎﻫﻨﺎﻣﻪ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﻭوﺍاﮊژ‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﮐﻤﮏ‬ ‫ﺑﻪ‬
98
‫ﻣﻠﺰﻭوﻣﺎﺕت‬ - ‫ﻧﮕﺎﺷﺖ‬ ‫ﮐﺎﻫﺶ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Prerequisites:
• Windows, Linux or Mac
• Java 1.7
• Apache Maven 3
99
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻫﺪﻭوﭖپ‬ ‫ﺩدﺭرﯾﺎﻓﺖ‬
‫ﻫﺎﯼی‬ ‫ﻧﺴﺨﻪ‬ ‫ﯾﺎ‬ ‫ﮐﻨﯿﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﻭو‬ ‫ﺑﮕﯿﺮﯾﺪ‬ ‫ﺭرﺍا‬ ‫ﮐﺪ‬ ‫ﺳﻮﺭرﺱس‬ ‫ﻣﯿﺘﻮﺍاﻧﯿﺪ‬ .‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﺭرﺍا‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﺑﺎﯾﺪ‬ ‫ﺍاﺑﺘﺪﺍا‬
.‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﻭو‬ ‫ﺩدﺍاﻧﻠﻮﺩد‬ ‫ﺭرﺍا‬ ‫ﺑﺎﯾﻨﺮﯼی‬
100
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻫﺪﻭوﭖپ‬ ‫ﺩدﺭرﯾﺎﻓﺖ‬
‫ﻫﺎﯼی‬ ‫ﻧﺴﺨﻪ‬ ‫ﯾﺎ‬ ‫ﮐﻨﯿﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﻭو‬ ‫ﺑﮕﯿﺮﯾﺪ‬ ‫ﺭرﺍا‬ ‫ﮐﺪ‬ ‫ﺳﻮﺭرﺱس‬ ‫ﻣﯿﺘﻮﺍاﻧﯿﺪ‬ .‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﺭرﺍا‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﺑﺎﯾﺪ‬ ‫ﺍاﺑﺘﺪﺍا‬
.‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﻭو‬ ‫ﺩدﺍاﻧﻠﻮﺩد‬ ‫ﺭرﺍا‬ ‫ﺑﺎﯾﻨﺮﯼی‬
101
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﻫﺪﻭوﭖپ‬ ‫ﮐﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬
‫ﮐﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﻭو‬ ‫ﺩدﺭرﯾﺎﻓﺖ‬
102
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺑﺎﯾﻨﺮﯼی‬ ‫ﻧﺼﺐ‬
(OS X) ‫ﺑﺎﯾﻨﺮﯼی‬ ‫‌ﻫﺎﯼی‬‫ﻪ‬‫ﻧﺴﺨ‬ ‫ﻧﺼﺐ‬
brew install hadoop
103
‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬
:‫ﺷﻮﺩد‬ ‫ﻓﺮﻣﺖ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺑﺮﺍاﯼی‬ ‫ﺑﺎﯾﺪ‬ ‫ﺩدﯾﮕﺮ‬ ‫ﺩدﯾﺴﮏ‬ ‫ﻫﺮ‬ ‫ﻣﺜﻞ‬ HDFS
bin/hdfs namenode -format
:‫ﮐﻨﯿﺪ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺯزﯾﺮ‬ ‫ﺩدﺳﺘﻮﺭر‬ ‫ﺍاﺯز‬ HDFS ‫ﮐﺮﺩدﻥن‬ ‫ﺭرﻭوﺷﻦ‬ ‫ﺑﺮﺍاﯼی‬
sbin/start-dfs.sh
:‫ﺑﺴﺎﺯزﯾﺪ‬ ‫ﻓﻮﻟﺪﺭر‬ POSIX ‫ﻓﺎﯾﻞ‬ ‫ﺳﺎﻣﺎﻧﻪ‬ ‫ﻫﺮ‬ ‫ﻣﺜﻞ‬ ‫ﻣﯿﺘﻮﺍاﻧﯿﺪ‬
bin/hdfs dfs -mkdir /acm
:‫ﮐﻨﯿﺪ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺩدﺳﺘﻮﺭر‬ ‫ﺍاﯾﻦ‬ ‫ﺍاﺯز‬ YARN ‫ﮐﺮﺩدﻥن‬ ‫ﺭرﻭوﺷﻦ‬ ‫ﺑﺮﺍاﯼی‬
sbin/start-yarn.sh
:‫ﮐﻨﯿﺪ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺯزﯾﺮ‬ ‫ﺩدﺳﺘﻮﺭر‬ ‫ﺍاﺯز‬ HDFS ‫ﺩدﺭر‬ ‫ﻓﺎﯾﻞ‬ ‫ﺩدﺍاﺩدﻥن‬ ‫ﻗﺮﺍاﺭر‬ ‫ﺑﺮﺍاﯼی‬
bin/hdfs dfs -put yourFile.dat /acm
104
‫ﭘﺮﻭوﮊژﻩه‬ ‫ﺍاﻭوﻟﯿﻪ‬ ‫ﺳﺎﺧﺘﺎﺭر‬ ‫ﺳﺎﺧﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Create the Maven project:
mvn archetype:generate
-DarchetypeGroupId=org.apache.maven.archetypes
-DgroupId=ir.ac.ut.acm.wordcount
-DartifactId=wordcount
-DinteractiveMode=false
105
‫ﭘﺮﻭوﮊژﻩه‬ ‫ﺍاﻭوﻟﯿﻪ‬ ‫ﺳﺎﺧﺘﺎﺭر‬ ‫ﺳﺎﺧﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Create the project:
mvn archetype:generate -DarchetypeGroupId=org.apache.maven.archetypes -DgroupId=ir.ac.ut.acm.wordcount -DartifactId=wordcount -DinteractiveMode=false
106
…‫‌ﻫﺎ‬‫ﯽ‬‫ﻭوﺍاﺑﺴﺘﮕ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
<dependency>
<groupid>org.apache.hadoop</groupid>
<artifactid>hadoop-client</artifactid>
<version>2.7.2</version>
</dependency>
Add the Hadoop Client the project POM:
107
…‫‌ﻫﺎ‬‫ﯽ‬‫ﻭوﺍاﺑﺴﺘﮕ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Add the following plugins to the POM:
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<configuration>
<archive>
<manifest>
<addClasspath>true</addClasspath>
<mainClass>ir.ac.ut.acm.wordcount.WordCount</mainClass>
</manifest>
</archive>
</configuration>
</plugin>
108
…‫‌ﻫﺎ‬‫ﯽ‬‫ﻭوﺍاﺑﺴﺘﮕ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Add the following plugins to the POM:
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-compiler-plugin</artifactId>
<configuration>
<source>1.7</source>
<target>1.7</target>
</configuration>
</plugin>
109
‫ﺟﺎﻭوﺍا‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
Create WordCount.java
package ir.ac.ut.acm.wordcount;
import java.io.IOException;
import java.util.*;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.conf.*;
import org.apache.hadoop.io.*;
import org.apache.hadoop.mapreduce.*;
import org.apache.hadoop.mapreduce.lib.input.FileInputFormat;
import org.apache.hadoop.mapreduce.lib.input.TextInputFormat;
import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat;
import org.apache.hadoop.mapreduce.lib.output.TextOutputFormat;
public class WordCount {
public static class Map extends Mapper<LongWritable, Text, Text, IntWritable> {
private final static IntWritable one = new IntWritable(1);
private Text word = new Text();
public void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException {
String line = value.toString();
StringTokenizer tokenizer = new StringTokenizer(line);
while (tokenizer.hasMoreTokens()) {
word.set(tokenizer.nextToken());
context.write(word, one);
}
}
}
110
‫ﺟﺎﻭوﺍا‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
public static class Reduce extends Reducer<Text, IntWritable, Text, IntWritable> {
public void reduce(Text key, Iterable<IntWritable> values, Context context)
throws IOException, InterruptedException {
int sum = 0;
for (IntWritable val : values) {
sum += val.get();
}
context.write(key, new IntWritable(sum));
}
}
public static void main(String[] args) throws Exception {
Configuration conf = new Configuration();
Job job = new Job(conf, "wordcount");
job.setJarByClass(WordCount.class);
job.setOutputKeyClass(Text.class);
job.setOutputValueClass(IntWritable.class);
job.setMapperClass(Map.class);
job.setReducerClass(Reduce.class);
job.setInputFormatClass(TextInputFormat.class);
job.setOutputFormatClass(TextOutputFormat.class);
FileInputFormat.addInputPath(job, new Path(args[0]));
FileOutputFormat.setOutputPath(job, new Path(args[1]));
job.waitForCompletion(true);
}
}
Complete WordCount.java
111
…‫ﺍاﺟﺮﺍا‬ ‫ﻭو‬ ‫ﺍاﺟﺮﺍاﯾﯽ‬ ‫ﺑﺴﺘﻪ‬ ‫ﺳﺎﺧﺖ‬ ‫ﻭو‬ ‫ﮐﻤﭙﺎﯾﻞ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
mvn clean install
112
…‫ﺍاﺟﺮﺍا‬ ‫ﻭو‬ ‫ﺍاﺟﺮﺍاﯾﯽ‬ ‫ﺑﺴﺘﻪ‬ ‫ﺳﺎﺧﺖ‬ ‫ﻭو‬ ‫ﮐﻤﭙﺎﯾﻞ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
hadoop jar target/wordcount-1.0-SNAPSHOT.jar input.txt wcount
113
!‫ﺍاﺳﺖ‬ ‫ﺷﺪﻩه‬ ‫ﻣﺮﺗﺐ‬ ‫ﻧﺘﯿﺠﻪ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
114
‫ﻣﺮﺟﻊ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
http://www.infogovsolutions.com/defensible-disposition-of-structured-data-2/
http://pamneely.com/6-ways-search-will-change/
http://www.forbes.com/sites/gilpress/2013/05/28/a-very-short-history-of-data-science
http://www.slideshare.net/accavdar/big-data-tech-stack
http://wallup.net/preview/?wallpaper=glaciers-landscape-snow-water-drops-water-nature-iceberg-underwater
http://wikipediea
http://hadoopilluminated.com/hadoop_illuminated
http://wiki.apache.org/hadoop/
http://tuttlem.github.io/2014/01/30/create-a-mapreduce-job-using-java-and-maven.html
https://getblueshift.com/setting-up-hadoop-2-4-and-pig-0-12-on-osx-locally/
‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬ ‫ﮐﺪ‬

Contenu connexe

En vedette

Neo4j Makes Graphs Easy: Nicole White
Neo4j Makes Graphs Easy: Nicole WhiteNeo4j Makes Graphs Easy: Nicole White
Neo4j Makes Graphs Easy: Nicole White
Neo4j
 
Practical Problem Solving with Apache Hadoop & Pig
Practical Problem Solving with Apache Hadoop & PigPractical Problem Solving with Apache Hadoop & Pig
Practical Problem Solving with Apache Hadoop & Pig
Milind Bhandarkar
 

En vedette (20)

ارائهٔ DLP
ارائهٔ DLPارائهٔ DLP
ارائهٔ DLP
 
بررسی کاربردها و چالش های کلان داده در تحلیل عقاید
بررسی کاربردها و چالش های کلان داده در تحلیل عقایدبررسی کاربردها و چالش های کلان داده در تحلیل عقاید
بررسی کاربردها و چالش های کلان داده در تحلیل عقاید
 
تشخیص انجمن در مقیاس کلان داده
تشخیص انجمن در مقیاس کلان دادهتشخیص انجمن در مقیاس کلان داده
تشخیص انجمن در مقیاس کلان داده
 
A Hybrid Recommendation system
A Hybrid Recommendation systemA Hybrid Recommendation system
A Hybrid Recommendation system
 
Introduction to behavior based recommendation system
Introduction to behavior based recommendation systemIntroduction to behavior based recommendation system
Introduction to behavior based recommendation system
 
Neo4j Makes Graphs Easy: Nicole White
Neo4j Makes Graphs Easy: Nicole WhiteNeo4j Makes Graphs Easy: Nicole White
Neo4j Makes Graphs Easy: Nicole White
 
Learning spark ch04 - Working with Key/Value Pairs
Learning spark ch04 - Working with Key/Value PairsLearning spark ch04 - Working with Key/Value Pairs
Learning spark ch04 - Working with Key/Value Pairs
 
عصر کلان داده، چرا و چگونه؟
عصر کلان داده، چرا و چگونه؟عصر کلان داده، چرا و چگونه؟
عصر کلان داده، چرا و چگونه؟
 
Nasiri PhD Thesis
Nasiri PhD Thesis Nasiri PhD Thesis
Nasiri PhD Thesis
 
Fraud system based on big data and machine learning
Fraud system based on big data and machine learningFraud system based on big data and machine learning
Fraud system based on big data and machine learning
 
Big Data Architecture
Big Data ArchitectureBig Data Architecture
Big Data Architecture
 
React JS and why it's awesome
React JS and why it's awesomeReact JS and why it's awesome
React JS and why it's awesome
 
Practical Problem Solving with Apache Hadoop & Pig
Practical Problem Solving with Apache Hadoop & PigPractical Problem Solving with Apache Hadoop & Pig
Practical Problem Solving with Apache Hadoop & Pig
 
React js
React jsReact js
React js
 
Graph database Use Cases
Graph database Use CasesGraph database Use Cases
Graph database Use Cases
 
Introduction to Big Data/Machine Learning
Introduction to Big Data/Machine LearningIntroduction to Big Data/Machine Learning
Introduction to Big Data/Machine Learning
 
Big Data Analytics with Hadoop
Big Data Analytics with HadoopBig Data Analytics with Hadoop
Big Data Analytics with Hadoop
 
What Makes Great Infographics
What Makes Great InfographicsWhat Makes Great Infographics
What Makes Great Infographics
 
Masters of SlideShare
Masters of SlideShareMasters of SlideShare
Masters of SlideShare
 
STOP! VIEW THIS! 10-Step Checklist When Uploading to Slideshare
STOP! VIEW THIS! 10-Step Checklist When Uploading to SlideshareSTOP! VIEW THIS! 10-Step Checklist When Uploading to Slideshare
STOP! VIEW THIS! 10-Step Checklist When Uploading to Slideshare
 

Plus de Amir Sedighi

Plus de Amir Sedighi (16)

Dark data
Dark dataDark data
Dark data
 
Big Data and Machine Learning Workshop - Day 7 @ UTACM
Big Data and Machine Learning Workshop - Day 7 @ UTACM Big Data and Machine Learning Workshop - Day 7 @ UTACM
Big Data and Machine Learning Workshop - Day 7 @ UTACM
 
Big Data and Machine Learning Workshop - Day 6 @ UTACM
Big Data and Machine Learning Workshop - Day 6 @ UTACMBig Data and Machine Learning Workshop - Day 6 @ UTACM
Big Data and Machine Learning Workshop - Day 6 @ UTACM
 
Big Data and Machine Learning Workshop - Day 5 @ UTACM
Big Data and Machine Learning Workshop - Day 5 @ UTACMBig Data and Machine Learning Workshop - Day 5 @ UTACM
Big Data and Machine Learning Workshop - Day 5 @ UTACM
 
Big Data and Machine Learning Workshop - Day 4 @ UTACM
Big Data and Machine Learning Workshop - Day 4 @ UTACM Big Data and Machine Learning Workshop - Day 4 @ UTACM
Big Data and Machine Learning Workshop - Day 4 @ UTACM
 
Helio, a Continues Real-Time Fraud Detection and Monitoring Solution
Helio, a Continues Real-Time Fraud Detection and Monitoring SolutionHelio, a Continues Real-Time Fraud Detection and Monitoring Solution
Helio, a Continues Real-Time Fraud Detection and Monitoring Solution
 
Big Data Processing Utilizing Open-source Technologies - May 2015
Big Data Processing Utilizing Open-source Technologies - May 2015Big Data Processing Utilizing Open-source Technologies - May 2015
Big Data Processing Utilizing Open-source Technologies - May 2015
 
Case Studies on Big-Data Processing and Streaming - Iranian Java User Group
Case Studies on Big-Data Processing and Streaming - Iranian Java User GroupCase Studies on Big-Data Processing and Streaming - Iranian Java User Group
Case Studies on Big-Data Processing and Streaming - Iranian Java User Group
 
Opensource Frameworks and BigData Processing
Opensource Frameworks and BigData ProcessingOpensource Frameworks and BigData Processing
Opensource Frameworks and BigData Processing
 
Elasticsearch 1.x Cluster Installation (VirtualBox)
Elasticsearch 1.x Cluster Installation (VirtualBox)Elasticsearch 1.x Cluster Installation (VirtualBox)
Elasticsearch 1.x Cluster Installation (VirtualBox)
 
Hadoop 2.x HDFS Cluster Installation (VirtualBox)
Hadoop 2.x  HDFS Cluster Installation (VirtualBox)Hadoop 2.x  HDFS Cluster Installation (VirtualBox)
Hadoop 2.x HDFS Cluster Installation (VirtualBox)
 
An Introduction to Apache Kafka
An Introduction to Apache KafkaAn Introduction to Apache Kafka
An Introduction to Apache Kafka
 
An introduction To Apache Spark
An introduction To Apache SparkAn introduction To Apache Spark
An introduction To Apache Spark
 
Distributed Data Processing Workshop - SBU
Distributed Data Processing Workshop - SBUDistributed Data Processing Workshop - SBU
Distributed Data Processing Workshop - SBU
 
An introduction to Big-Data processing applying hadoop
An introduction to Big-Data processing applying hadoopAn introduction to Big-Data processing applying hadoop
An introduction to Big-Data processing applying hadoop
 
An Introduction to Elasticsearch for Beginners
An Introduction to Elasticsearch for BeginnersAn Introduction to Elasticsearch for Beginners
An Introduction to Elasticsearch for Beginners
 

Big Data and Machine Learning Workshop - Day 3 @ UTACM

  • 1. 1 ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ ‫ﺻﺪﯾﻘﯽ‬ ‫ﺍاﻣﯿﺮ‬ ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ @amirsedighi :‫ﺗﻮ4ﺘﺮ‬ :‫ﺍاﯾﻤﯿﻞ‬sedighi@gmail.com ‫‌ﻫﺎ‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ،‫ﺩدﺍاﺩدﻩه‬ ‫‌ﻫﺎﯼی‬‫ﻥن‬‫ﺟﺮﯾﺎ‬ ،(‫‌ﺩدﺍاﺩدﻩه‬‫ﻪ‬ ِ‫)ﻣ‬ ‫‌ﺑﺰﺭرﮒگ‬‫ﯼی‬‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬ - ‫ﺳﻮﻡم‬ ‫ﺭرﻭوﺯز‬
  • 3. 3 ‫‌ﺁآﻣﻮﺯزﯾﻢ‬‫ﯽ‬‫ﻣ‬ ‫ﺍاﻣﺮﻭوﺯز‬ ‫ﺁآﻧﭽﻪ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (BigData Processing) (‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫‌ﺩدﺍاﺩدﻩه/ﺩدﺍاﺩد‬‫ﻥن‬‫‌ﺩدﯾﺘﺎ/ﮐﻼ‬‫ﮓ‬‫)ﺑﯿ‬ ‫‌ﺩدﺍاﺩدﻩه‬‫ﻪ‬ ِ‫ﻣ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬ (Data Streaming) ‫ﺩدﺍاﺩدﻩه‬ ‫‌ﻫﺎﯼی‬‫ﻥن‬‫ﺟﺮﯾﺎ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬ ‫ﺩدﺍاﺩدﻩه‬ ‫‌ﻫﺎﯼی‬‫ﻥن‬‫ﺟﺮﯾﺎ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﺣﻮﺯزﻩه‬ ‫ﺩدﺭر‬ ‫ﺻﻨﻌﺖ‬ ‫ﻭو‬ ‫‌ﮐﺎﺭر‬‫ﻭو‬‌‫ﺐ‬‫ﮐﺴ‬ ‫‌ﻫﺎﯼی‬‫ﺯز‬‫ﻧﯿﺎ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‌‫ﺵش‬‫ﭘﺮﺩدﺍاﺯز‬ ‫ﺯزﯾﺮﺳﺎﺧﺖ‬ ‫‌ﺗﺮﯾﻦ‬‫ﺭر‬‫ﻣﺸﻬﻮ‬ ‫ﺑﮑﺎﺭرﮔﯿﺮﯼی‬ ‫ﻧﻤﻮﻧﻪ‬ ‫ﯾﮏ‬ ‫‌ﺷﯿﻢ‬‫ﯽ‬‫ﻣ‬ ‫ﺁآﺷﻨﺎ‬ ‫ﺣﻮﺯزﻩه‬ ‫ﺍاﯾﻦ‬ ‫ﭘﺮﮐﺎﺭرﺑﺮﺩد‬ ‫‌ﺑﺎﺯز‬‫ﻦ‬‫ﻣﺘ‬ ‫ﺍاﺑﺰﺍاﺭرﻫﺎﯼی‬ ‫ﺑﺎ‬
  • 4. 4 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﭘﺎﯾﻪ‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﻭو‬ ‫ﺗﺎﺭرﯾﺨﭽﻪ‬ ‫ﺳﺮﻓﺼﻞ‬ ‫‌ﻫﺎ‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﺵش‬‫ﺭرﻭو‬
  • 5. 5 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻭوﺍاﻗﻌﯿﺖ‬ ‫ﺗﺎ‬ ‫ﺗﺼﻮﺭرﺍاﺕت‬ ‫ﺍاﺯز‬
  • 6. 6 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﺩدﺍاﺩدﻩه‬‫ﻪ‬ ِ‫ﻣ‬ ‫‌ﺩدﺍاﺩدﻩه‬‫ﻥن‬‫ﮐﻼ‬ ‫‌ﺩدﯾﺘﺎ‬‫ﮓ‬‫ﺑﯿ‬ Big-Data ‫ﻣﻘﺪﻣﻪ‬
  • 7. 7 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ :‫ﭘﯿﺶ‬ ‫ﺳﺎﻝل‬ ‫ﭼﻨﺪ‬ ‫ﻫﻤﯿﻦ‬ ‫ﺩدﯾﺮﻭوﺯز‬
  • 8. 8 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺩدﯾﺮﻭوﺯز‬
  • 9. 9 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺩدﯾﺮﻭوﺯز‬
  • 10. 10 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺩدﯾﺮﻭوﺯز‬
  • 11. 11 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺩدﯾﺮﻭوﺯز‬ 640KB 1.2MB
  • 12. 12 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ‬‫ﺭر‬‫ﻫﻨﺠﺎ‬ ‫ﺮ‬K‫ﺗﻐ‬
  • 13. 13 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 14. 14 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 15. 15 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 16. 16 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 17. 17 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 18. 18 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 19. 19 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺷﺪ‬ ‫ﺷﺮﻭوﻉع‬ ‫ﮐﺠﺎ‬ ‫ﺍاﺯز‬ ‫ﺩدﺍاﺳﺘﺎﻥن‬
  • 20. 20 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺩدﺍاﺩدﻩه‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﻭو‬ ‫ﺗﮑﺜﯿﺮ‬ ،‫ﺗﻮﻟﯿﺪ‬ ‫‌ﻫﺎﯼی‬‫ﺵش‬‫ﺭرﻭو‬ ‫ﺗﮑﺎﻣﻞ‬
  • 21. 21 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫ﺗﻨﻮﻉع‬ ‫ﻭو‬ ‫ﺗﻌﺪﺍاﺩد‬ ‫ﺭرﺷﺪ‬ ‫ﺍاﺯز‬ ‫ﻧﺎﺷﯽ‬ ‫ﺍاﺛﺮﺍاﺕت‬
  • 22. 22 Welcome to the Machine‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 23. 23 (‫)ﺧﻮﺩدﻣﺎﻧﯽ‬ ‫ﺗﻌﺮﯾﻒ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﺷﻮﻧﺪ‬‫ﯽ‬‫ﻣ‬ ‫ﻣﺴﺌﻠﻪ‬ ‫ﺍاﺯز‬ ‫ﺑﺨﺸﯽ‬ ‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬ (… SQL-Server ،MySQL ،‫)ﺍاﮐﺴﻞ‬ ‫ﻣﺘﺪﺍاﻭوﻝل‬ ‫‌ﻫﺎﯼی‬‫ﺵش‬‫ﺭرﻭو‬ ‫ﻧﺎﺗﻮﺍاﻧﯽ‬
  • 24. 24 ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﺍاﺯز‬ ‫ﮔﺎﺭرﻧﺘﺮ‬ ‫ﺗﻌﺮﯾﻒ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 25. 25 ‫ﺍاﻧﺪﺍاﺯزﻩه‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 26. 26 ‫ﺳﺮﻋﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 27. 27 ‫ﺗﻨﻮﻉع‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 28. 28 ‫ﺻﺤﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 29. 29 ‫ﺛﺎﻧﯿﻪ‬ ‫ﯾﮏ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 30. 30 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻣﻘﺪﻡم‬ ‫ﺧﻂ‬
  • 31. 31 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻣﻘﺪﻡم‬ ‫ﺧﻂ‬ Data Scientist Data Engineer
  • 32. 32 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻣﻘﺪﻡم‬ ‫ﺧﻂ‬
  • 33. 33 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻭوﺏب‬ ‫ﺻﻔﺤﺎﺕت‬
  • 34. 34 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ !‫ﭘﺴﻨﺪﯾﺪﻡم‬
  • 35. 35 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ (‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫)ﻧﻈﺮ‬ ‫‌ﻫﺎ‬‫ﺖ‬‫ﮐﺎﻣﻨ‬
  • 36. 36 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‌‫ﻮ‬‫ﻭوﯾﺪﺋ‬
  • 37. 37 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻣﺎﻟﯽ‬ ‫‌ﻫﺎﯼی‬‫ﺶ‬‫ﺗﺮﺍاﮐﻨ‬
  • 38. 38 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫‌ﻫﺎ‬‫ﺖ‬4‫ﺗﻮ‬
  • 39. 39 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﺗﺼﻮﯾﺮ‬
  • 40. 40 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻻﮒگ‬
  • 41. 41 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻻﮒگ‬ ‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬
  • 42. 42 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻻﮒگ‬ ‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬ ‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬
  • 43. 43 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻻﮒگ‬ ‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬ ‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬ ‫ﺍاﭘﻠﯿﮑﯿﺸﻦ‬ ‫ﻻﮒگ‬
  • 44. 44 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻻﮒگ‬ ‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬ ‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬ ‫ﺍاﭘﻠﯿﮑﯿﺸﻦ‬ ‫ﻻﮒگ‬ ‫ﺳﯿﺴﺘﻢ‬ ‫ﻻﮒگ‬
  • 45. 45 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ؟‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﮐﺪﺍاﻡم‬ ‫ﻻﮒگ‬ ‫ﮐﺎﺭرﺑﺮﺍاﻥن‬ ‫‌ﻫﺎﯼی‬‫ﮏ‬‫ﮐﻠﯿ‬ ‫‌ﺳﺮﻭوﺭر‬‫ﺏب‬‫ﻭو‬ ‫ﻻﮒگ‬ ‫ﺍاﭘﻠﯿﮑﯿﺸﻦ‬ ‫ﻻﮒگ‬ ‫ﺳﯿﺴﺘﻢ‬ ‫ﻻﮒگ‬ (‫‌ﻫﺎ‬‫ﺰ‬‫‌ﭼﯿ‬‫ﺖ‬‫)ﺍاﯾﻨﺘﺮﻧ‬ ‫ﺯزﻧﺪﮔﯽ‬ ‫ﻻﮒگ‬
  • 46. 46 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺍاﺻﻠﯽ‬ ‫ﻣﻨﺒﻊ‬
  • 47. 47 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺍاﺻﻠﯽ‬ ‫ﻣﻨﺒﻊ‬ http://hadoopilluminated.com/hadoop_illuminated
  • 48. 48 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﻫﺎ‬‫ﺖ‬‫ﻣﺤﺪﻭوﺩدﯾ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﺑﺮﺍاﯼی‬ (Platform) ‫‌ﺳﺎﺯزﻩه‬‫ﻦ‬‫ﺑ‬ ‫ﯾﮏ‬ ‫ﺩدﺳﺘﺮﺱس‬ ‫ﺩدﺭر‬ ‫ﻭو‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﺗﺠﻬﯿﺰﺍاﺕت‬ ‫ﺗﻮﺳﻂ‬ ‫ﭼﮕﻮﻧﻪ‬ ‫ﺑﺒﯿﻨﯿﻢ؟‬ ‫ﺗﻬﯿﻪ‬ ‫‌ﺑﺰﺭرﮒگ‬‫ﯼی‬‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬
  • 49. 49 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
  • 50. 50 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
  • 51. 51 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬ Scale-Up
  • 52. 52 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬ Scale-Out Scale-Up
  • 53. 53 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
  • 54. 54 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Scalability) ‫‌ﭘﺬﯾﺮﯼی‬‫ﺱس‬‫ﻣﻘﯿﺎ‬
  • 55. 55 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺮﺁآﻏﺎﺯز‬
  • 56. 56 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺮﺁآﻏﺎﺯز‬ 1999
  • 57. 57 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺮﺁآﻏﺎﺯز‬ 1999 2002
  • 58. 58 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺮﺁآﻏﺎﺯز‬ 1999 2002
  • 59. 59 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﭼﮕﻮﻧﻪ؟‬ Q!‫‌ﻭوﺭرﯾﻢ؟‬‫ﺎ‬‫ﺑﯿ‬ ‫ﺑﺪﺳﺖ‬ ‫ﺧﻄﯽ‬ ‫ﭘﺬﯾﺮﯼی‬ ‫ﻣﻘﯿﺎﺱس‬ ‫ﻗﯿﻤﺖ‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﻣﺎﺷﯿﻦ‬ ‫ﺯزﯾﺎﺩدﯼی‬ ‫ﺗﻌﺪﺍاﺩد‬ ‫ﮐﻤﮏ‬ ‫ﺑﻪ‬ ‫ﭼﮕﻮﻧﻪ‬
  • 60. 60 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ Q!‫‌ﻭوﺭرﯾﻢ؟‬‫ﺎ‬‫ﺑﯿ‬ ‫ﺑﺪﺳﺖ‬ ‫ﺧﻄﯽ‬ ‫ﭘﺬﯾﺮﯼی‬ ‫ﻣﻘﯿﺎﺱس‬ ‫ﻗﯿﻤﺖ‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﻣﺎﺷﯿﻦ‬ ‫ﺯزﯾﺎﺩدﯼی‬ ‫ﺗﻌﺪﺍاﺩد‬ ‫ﮐﻤﮏ‬ ‫ﺑﻪ‬ ‫ﭼﮕﻮﻧﻪ‬ A(Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
  • 61. 61 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺮﺁآﻏﺎﺯز‬ 1999 2002 2003 ..
  • 62. 62 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺮﺁآﻏﺎﺯز‬ 1999 2002 2006200
  • 63. 63 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﭘﺎﯾﻪ‬ ‫ﻣﻔﺎﻫﯿﻢ‬ ‫ﻭو‬ ‫ﺗﺎﺭرﯾﺨﭽﻪ‬ ‫‌ﻫﺎ‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﺵش‬‫ﺭرﻭو‬
  • 64. 64 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﺗﻮﺍاﻥن‬ ‫ﺍاﻓﺰﺍاﯾﺶ‬ - ‫ﭘﺮﺳﺶ‬ Q‫ﺍاﯾﺸﺎﻥن‬ ‫ﺍاﺯز‬ .‫ﺍاﺳﺖ‬ ‫ﮔﺮﻓﺘﻪ‬ ‫ﻗﺮﺍاﺭر‬ ‫ﻋﻠﯽ‬ ‫ﻭو‬ ‫ﺳﺎﺳﺎﻥن‬ ،‫ﭘﯿﺎﻡم‬ ‫ﺍاﺧﺘﯿﺎﺭر‬ ‫ﺩدﺭر‬ ‫ﻓﺮﺩدﻭوﺳﯽ‬ ‫ﺷﺎﻫﻨﺎﻣﻪ‬ ‫ﺟﻠﺪ‬ ‫ﯾﮏ‬ .‫ﺑﺸﻤﺎﺭرﻧﺪ‬ ‫ﺭرﺍا‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺍاﺳﺎﻣﯽ‬ ‫ﻣﻤﮑﻦ‬ ‫ﺭرﻭوﺵش‬ ‫‌ﺗﺮﯾﻦ‬‫ﻊ‬‫ﺳﺮﯾ‬ ‫ﺑﻪ‬ ‫‌ﺍاﻧﺪ‬‫ﻪ‬‫ﺧﻮﺍاﺳﺘ‬ ‫‌ﮐﻨﯿﺪ؟‬‫ﯽ‬‫ﻣ‬ ‫ﭘﯿﺸﻨﻬﺎﺩد‬ ‫ﺭرﻭوﺷﯽ‬ ‫ﭼﻪ‬
  • 65. 65 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
  • 66. 66 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
  • 67. 67 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
  • 68. 68 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
  • 69. 69 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
  • 70. 70 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬
  • 71. 71 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬
  • 72. 72 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬
  • 73. 73 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬
  • 74. 74 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺳﺎﺳﺎﻥن‬
  • 75. 75 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺳﺎﺳﺎﻥن‬ map() shuffle() reduce()splitting()
  • 76. 76 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﻭو‬ ‫ﺭرﺳﺘﻢ‬ ،‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﭘﯿﺎﻡم‬ ‫ﺳﺎﺳﺎﻥن‬ ‫ﻋﻠﯽ‬ ‫ﺭرﻭوﺩدﺍاﺑﻪ‬ ‫ﺭرﺳﺘﻢ‬ ‫ﺳﻬﺮﺍاﺏب‬ ‫ﺳﺎﺳﺎﻥن‬ map() shuffle() reduce() [k1,v1] by k1 [k1,[v1, v2, v3 …]]
  • 77. 77 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (Map-Reduce) ‫ﮐﺎﻫﺶ‬ ‫ﻧﮕﺎﺷﺖ‬
  • 78. 78 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺍاﻃﻤﯿﻨﺎﻥن‬ ‫ﺿﺮﯾﺐ‬ ‫ﺍاﻓﺰﺍاﯾﺶ‬ - ‫ﭘﺮﺳﺶ‬ Q‫ﮐﺎﻣﭙﯿﻮﺗﺮ‬ ‫ﻫﺮ‬ ‫ﺍاﯾﻨﮑﻪ‬ ‫ﺑﻔﺮﺽض‬ .‫‌ﺍاﯾﻢ‬‫ﻩه‬‫ﮐﺮﺩد‬ ‫ﺗﻬﯿﻪ‬ ‫ﻗﯿﻤﺖ‬ ‫ﺍاﺭرﺯزﺍاﻥن‬ ‫ﮐﺎﻣﭙﯿﻮﺗﺮ‬ ۳۶۵ ‫ﺑﺎ‬ ‫ﺧﻮﺷﻪ‬ ‫ﯾﮏ‬ ‫ﯾﮏ‬ ‫ﺭرﻭوﺯزﺍاﻧﻪ‬ ‫ﻣﺘﻮﺳﻂ‬ ‫ﻃﻮﺭر‬ ‫ﺑﻪ‬ (‫ﺧﺮﺍاﺑﯽ‬ ‫ﻧﻮﻉع‬ ‫)ﻫﺮ‬ ‫ﺷﻮﺩد‬ ‫ﺧﺮﺍاﺏب‬ ‫ﯾﮑﺒﺎﺭر‬ ‫ﺳﺎﻟﯽ‬ ‫ﺗﻨﻬﺎ‬ ،‫‌ﻗﯿﻤﺖ‬‫ﻥن‬‫ﺍاﺭرﺯزﺍا‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ ‫ﺳﻼﻣﺖ‬ ‫ﻭو‬ ‫‌ﻫﺎ‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫ﺳﻼﻣﺖ‬ ‫ﭼﮕﻮﻧﻪ‬ ‫ﺷﺮﺍاﯾﻄﯽ‬ ‫ﭼﻨﯿﻦ‬ ‫ﺩدﺭر‬ .‫ﺩدﺍاﺷﺖ‬ ‫ﺧﻮﺍاﻫﯿﻢ‬ ‫ﺧﺮﺍاﺑﯽ‬ ‫ﮐﻨﯿﻢ؟‬ ‫ﺗﻀﻤﯿﻦ‬ ‫ﺭرﺍا‬ (‫ﻣﺤﺴﺒﺎﺗﯽ‬ ‫ﻋﻤﻠﯿﺎﺕت‬ ‫)ﺗﮑﺮﺍاﺭرﭘﺬﯾﺮﯼی‬
  • 79. 79 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (DFS) ‫ﺷﺪﻩه‬ ‫ﺗﻮﺯزﯾﻊ‬ ‫ﻓﺎﯾﻞ‬ ‫ﺳﺎﻣﺎﻧﻪ‬
  • 80. 80 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ (DFS) ‫ﺷﺪﻩه‬ ‫ﺗﻮﺯزﯾﻊ‬ ‫ﻓﺎﯾﻞ‬ ‫ﺳﺎﻣﺎﻧﻪ‬
  • 81. 81 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﺰ‬‫ﺳﺎﯾ‬ ‫ﺑﻼﮎک‬
  • 82. 82 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﺷﺪﻩه‬‫ﻊ‬‫‌ﺗﻮﺯزﯾ‬‫ﻞ‬‫‌ﻓﺎﯾ‬+ ‫‌ﺷﺪﻩه‬‫ﻊ‬‫ﺗﻮﺯزﯾ‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬ = ‫ﻫﺪﻭوﭖپ‬ Hadoop = HDFS + MapReduce
  • 83. 83 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺭرﻋﯿﺘﯽ‬ /‫ﺍاﺭرﺑﺎﺏب‬
  • 84. 84 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺭرﻋﯿﺘﯽ‬ /‫ﺍاﺭرﺑﺎﺏب‬
  • 85. 85 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻫﺪﻭوﭖپ‬
  • 86. 86 ‫ﺩدﯾﮕﺮ‬ ‫‌ﻫﺎﯼی‬‫ﺭر‬‫ﺍاﺑﺰﺍا‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫‌ﺑﺎﺯز‬‫ﻦ‬‫ﻣﺘ‬ ‫ﻗﺪﺭرﺗﻤﻨﺪ‬ ‫ﺍاﺑﺰﺍاﺭر‬ ‫ﭼﻨﺪ‬ ‫ﺑﺎ‬ ‫ﺁآﺷﻨﺎﯾﯽ‬
  • 87. (Transfer) ‫ﺟﺎﺑﺠﺎﯾﯽ‬ ‫‌ﺳﺎﺯزﯼی‬‫ﻩه‬‫ﺫذﺧﯿﺮ‬ (Join) ‫ﺍاﺭرﺗﺒﺎﻁط‬ ‫ﺑﺮﻗﺮﺍاﺭرﯼی‬ (Index) ‫‌ﮔﺬﺍاﺭرﯼی‬‫ﺲ‬‫ﺍاﻧﺪﯾ‬ (Analytics) ‫ﺗﺤﻠﯿﻞ‬ (Aggregate) ‫ﺗﺠﻤﯿﻊ‬ (Visualize) ‫‌ﺳﺎﺯزﯼی‬‫ﻪ‬‫ﻧﻤﺎﯾ‬ 87 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻣﺎ‬ ‫‌ﻫﺎﯼی‬‫ﯼی‬‫ﻧﯿﺎﺯزﻣﻨﺪ‬ Image ref: http://supplychaininsightsglobalsummit.com/steps-4-5-to-regain-manufacturing-prowess/
  • 88. 88 ‫‌ﺩدﺍاﺩدﻩه‬‫ﻩه‬‫ﭘﺎﯾﮕﺎ‬ ‫ﺍاﻧﻮﺍاﻉع‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 89. 89 SQL ‫ﻭوﺍاﺳﻂ‬ ‫ﺍاﻧﻮﺍاﻉع‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ • Hive • Drill • Impala
  • 90. 90 ‫ﺩدﺍاﺩدﻩه‬ ‫ﺍاﻧﺘﻘﺎﻝل‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 91. 91 ‫ﮔﺬﺍاﺭرﯼی‬ ‫ﺍاﻧﺪﯾﺲ‬ ‫ﻭو‬ ‫ﺟﺴﺘﺠﻮ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 92. 92 ‫ﺻﻒ‬ ‫ﻣﺪﯾﺮﯾﺖ‬ ‫ﻭو‬ ‫ﺭرﺳﺎﻧﯽ‬ ‫ﭘﯿﺎﻡم‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 93. 93 ‫ﻓﺎﯾﻞ‬ ‫ﻻﮒگ‬ ‫ﻣﺪﯾﺮﯾﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 94. 94 ‫ﺩدﺍاﺩدﻩه‬ ‫ﺟﺮﯾﺎﻥن‬ ‫ﭘﺮﺩدﺍاﺯزﺵش‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Apache Flink
  • 95. 95 ‫ﻣﺎﺷﯿﻦ‬ ‫ﯾﺎﺩدﮔﯿﺮﯼی‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Apache Hama TensorFlow SystemML
  • 96. 96 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬ ‫ﺑﻨﻮﯾﺴﯿﻢ‬ ‫ﮐﺪ‬
  • 97. 97 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬ .‫ﮐﻨﯿﺪ‬ ‫ﻣﺮﺗﺐ‬ ‫ﻓﺮﺍاﻭوﺍاﻧﯽ‬ ‫ﺍاﺳﺎﺱس‬ ‫ﺑﺮ‬ ‫ﻭو‬ ‫ﺑﺸﻤﺎﺭرﯾﺪ‬ ‫ﺭرﺍا‬ ‫ﺷﺎﻫﻨﺎﻣﻪ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﻭوﺍاﮊژ‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﮐﻤﮏ‬ ‫ﺑﻪ‬
  • 98. 98 ‫ﻣﻠﺰﻭوﻣﺎﺕت‬ - ‫ﻧﮕﺎﺷﺖ‬ ‫ﮐﺎﻫﺶ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Prerequisites: • Windows, Linux or Mac • Java 1.7 • Apache Maven 3
  • 99. 99 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﺩدﺭرﯾﺎﻓﺖ‬ ‫ﻫﺎﯼی‬ ‫ﻧﺴﺨﻪ‬ ‫ﯾﺎ‬ ‫ﮐﻨﯿﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﻭو‬ ‫ﺑﮕﯿﺮﯾﺪ‬ ‫ﺭرﺍا‬ ‫ﮐﺪ‬ ‫ﺳﻮﺭرﺱس‬ ‫ﻣﯿﺘﻮﺍاﻧﯿﺪ‬ .‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﺭرﺍا‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﺑﺎﯾﺪ‬ ‫ﺍاﺑﺘﺪﺍا‬ .‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﻭو‬ ‫ﺩدﺍاﻧﻠﻮﺩد‬ ‫ﺭرﺍا‬ ‫ﺑﺎﯾﻨﺮﯼی‬
  • 100. 100 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﺩدﺭرﯾﺎﻓﺖ‬ ‫ﻫﺎﯼی‬ ‫ﻧﺴﺨﻪ‬ ‫ﯾﺎ‬ ‫ﮐﻨﯿﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﻭو‬ ‫ﺑﮕﯿﺮﯾﺪ‬ ‫ﺭرﺍا‬ ‫ﮐﺪ‬ ‫ﺳﻮﺭرﺱس‬ ‫ﻣﯿﺘﻮﺍاﻧﯿﺪ‬ .‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﺭرﺍا‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﺑﺎﯾﺪ‬ ‫ﺍاﺑﺘﺪﺍا‬ .‫ﮐﻨﯿﺪ‬ ‫ﻧﺼﺐ‬ ‫ﻭو‬ ‫ﺩدﺍاﻧﻠﻮﺩد‬ ‫ﺭرﺍا‬ ‫ﺑﺎﯾﻨﺮﯼی‬
  • 101. 101 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﻫﺪﻭوﭖپ‬ ‫ﮐﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﮐﺪ‬ ‫ﮐﻤﭙﺎﯾﻞ‬ ‫ﻭو‬ ‫ﺩدﺭرﯾﺎﻓﺖ‬
  • 102. 102 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺑﺎﯾﻨﺮﯼی‬ ‫ﻧﺼﺐ‬ (OS X) ‫ﺑﺎﯾﻨﺮﯼی‬ ‫‌ﻫﺎﯼی‬‫ﻪ‬‫ﻧﺴﺨ‬ ‫ﻧﺼﺐ‬ brew install hadoop
  • 103. 103 ‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ ‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬ :‫ﺷﻮﺩد‬ ‫ﻓﺮﻣﺖ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺑﺮﺍاﯼی‬ ‫ﺑﺎﯾﺪ‬ ‫ﺩدﯾﮕﺮ‬ ‫ﺩدﯾﺴﮏ‬ ‫ﻫﺮ‬ ‫ﻣﺜﻞ‬ HDFS bin/hdfs namenode -format :‫ﮐﻨﯿﺪ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺯزﯾﺮ‬ ‫ﺩدﺳﺘﻮﺭر‬ ‫ﺍاﺯز‬ HDFS ‫ﮐﺮﺩدﻥن‬ ‫ﺭرﻭوﺷﻦ‬ ‫ﺑﺮﺍاﯼی‬ sbin/start-dfs.sh :‫ﺑﺴﺎﺯزﯾﺪ‬ ‫ﻓﻮﻟﺪﺭر‬ POSIX ‫ﻓﺎﯾﻞ‬ ‫ﺳﺎﻣﺎﻧﻪ‬ ‫ﻫﺮ‬ ‫ﻣﺜﻞ‬ ‫ﻣﯿﺘﻮﺍاﻧﯿﺪ‬ bin/hdfs dfs -mkdir /acm :‫ﮐﻨﯿﺪ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺩدﺳﺘﻮﺭر‬ ‫ﺍاﯾﻦ‬ ‫ﺍاﺯز‬ YARN ‫ﮐﺮﺩدﻥن‬ ‫ﺭرﻭوﺷﻦ‬ ‫ﺑﺮﺍاﯼی‬ sbin/start-yarn.sh :‫ﮐﻨﯿﺪ‬ ‫ﺍاﺳﺘﻔﺎﺩدﻩه‬ ‫ﺯزﯾﺮ‬ ‫ﺩدﺳﺘﻮﺭر‬ ‫ﺍاﺯز‬ HDFS ‫ﺩدﺭر‬ ‫ﻓﺎﯾﻞ‬ ‫ﺩدﺍاﺩدﻥن‬ ‫ﻗﺮﺍاﺭر‬ ‫ﺑﺮﺍاﯼی‬ bin/hdfs dfs -put yourFile.dat /acm
  • 104. 104 ‫ﭘﺮﻭوﮊژﻩه‬ ‫ﺍاﻭوﻟﯿﻪ‬ ‫ﺳﺎﺧﺘﺎﺭر‬ ‫ﺳﺎﺧﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Create the Maven project: mvn archetype:generate -DarchetypeGroupId=org.apache.maven.archetypes -DgroupId=ir.ac.ut.acm.wordcount -DartifactId=wordcount -DinteractiveMode=false
  • 105. 105 ‫ﭘﺮﻭوﮊژﻩه‬ ‫ﺍاﻭوﻟﯿﻪ‬ ‫ﺳﺎﺧﺘﺎﺭر‬ ‫ﺳﺎﺧﺖ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Create the project: mvn archetype:generate -DarchetypeGroupId=org.apache.maven.archetypes -DgroupId=ir.ac.ut.acm.wordcount -DartifactId=wordcount -DinteractiveMode=false
  • 106. 106 …‫‌ﻫﺎ‬‫ﯽ‬‫ﻭوﺍاﺑﺴﺘﮕ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ <dependency> <groupid>org.apache.hadoop</groupid> <artifactid>hadoop-client</artifactid> <version>2.7.2</version> </dependency> Add the Hadoop Client the project POM:
  • 107. 107 …‫‌ﻫﺎ‬‫ﯽ‬‫ﻭوﺍاﺑﺴﺘﮕ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Add the following plugins to the POM: <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-jar-plugin</artifactId> <configuration> <archive> <manifest> <addClasspath>true</addClasspath> <mainClass>ir.ac.ut.acm.wordcount.WordCount</mainClass> </manifest> </archive> </configuration> </plugin>
  • 108. 108 …‫‌ﻫﺎ‬‫ﯽ‬‫ﻭوﺍاﺑﺴﺘﮕ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Add the following plugins to the POM: <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <configuration> <source>1.7</source> <target>1.7</target> </configuration> </plugin>
  • 109. 109 ‫ﺟﺎﻭوﺍا‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ Create WordCount.java package ir.ac.ut.acm.wordcount; import java.io.IOException; import java.util.*; import org.apache.hadoop.fs.Path; import org.apache.hadoop.conf.*; import org.apache.hadoop.io.*; import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; import org.apache.hadoop.mapreduce.lib.input.TextInputFormat; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; import org.apache.hadoop.mapreduce.lib.output.TextOutputFormat; public class WordCount { public static class Map extends Mapper<LongWritable, Text, Text, IntWritable> { private final static IntWritable one = new IntWritable(1); private Text word = new Text(); public void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException { String line = value.toString(); StringTokenizer tokenizer = new StringTokenizer(line); while (tokenizer.hasMoreTokens()) { word.set(tokenizer.nextToken()); context.write(word, one); } } }
  • 110. 110 ‫ﺟﺎﻭوﺍا‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ public static class Reduce extends Reducer<Text, IntWritable, Text, IntWritable> { public void reduce(Text key, Iterable<IntWritable> values, Context context) throws IOException, InterruptedException { int sum = 0; for (IntWritable val : values) { sum += val.get(); } context.write(key, new IntWritable(sum)); } } public static void main(String[] args) throws Exception { Configuration conf = new Configuration(); Job job = new Job(conf, "wordcount"); job.setJarByClass(WordCount.class); job.setOutputKeyClass(Text.class); job.setOutputValueClass(IntWritable.class); job.setMapperClass(Map.class); job.setReducerClass(Reduce.class); job.setInputFormatClass(TextInputFormat.class); job.setOutputFormatClass(TextOutputFormat.class); FileInputFormat.addInputPath(job, new Path(args[0])); FileOutputFormat.setOutputPath(job, new Path(args[1])); job.waitForCompletion(true); } } Complete WordCount.java
  • 111. 111 …‫ﺍاﺟﺮﺍا‬ ‫ﻭو‬ ‫ﺍاﺟﺮﺍاﯾﯽ‬ ‫ﺑﺴﺘﻪ‬ ‫ﺳﺎﺧﺖ‬ ‫ﻭو‬ ‫ﮐﻤﭙﺎﯾﻞ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ mvn clean install
  • 112. 112 …‫ﺍاﺟﺮﺍا‬ ‫ﻭو‬ ‫ﺍاﺟﺮﺍاﯾﯽ‬ ‫ﺑﺴﺘﻪ‬ ‫ﺳﺎﺧﺖ‬ ‫ﻭو‬ ‫ﮐﻤﭙﺎﯾﻞ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ hadoop jar target/wordcount-1.0-SNAPSHOT.jar input.txt wcount
  • 113. 113 !‫ﺍاﺳﺖ‬ ‫ﺷﺪﻩه‬ ‫ﻣﺮﺗﺐ‬ ‫ﻧﺘﯿﺠﻪ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬
  • 114. 114 ‫ﻣﺮﺟﻊ‬‫ﺍاﻥن‬‫ﺮ‬‫ﺗﻬ‬ ‫ﺩدﺍاﻧﺸﮕﺎﻩه‬ ACM - ۱۳۹۵ ‫ﺗﺎﺑﺴﺘﺎﻥن‬ - ‫‌ﻣﺎﺷﯿﻦ‬‫ﯼی‬‫ﯾﺎﺩدﮔﯿﺮ‬ ‫ﻭو‬ ‫ﺑﺰﺭرﮒگ‬ ‫‌ﻫﺎﯼی‬‫ﻩه‬‫ﺩدﺍاﺩد‬ ‫‌ﻫﺎﯼی‬‫ﺩد‬‫ﮐﺎﺭرﺑﺮ‬ ‫ﺑﺮ‬ ‫ﮔﺬﺭرﯼی‬ http://www.infogovsolutions.com/defensible-disposition-of-structured-data-2/ http://pamneely.com/6-ways-search-will-change/ http://www.forbes.com/sites/gilpress/2013/05/28/a-very-short-history-of-data-science http://www.slideshare.net/accavdar/big-data-tech-stack http://wallup.net/preview/?wallpaper=glaciers-landscape-snow-water-drops-water-nature-iceberg-underwater http://wikipediea http://hadoopilluminated.com/hadoop_illuminated http://wiki.apache.org/hadoop/ http://tuttlem.github.io/2014/01/30/create-a-mapreduce-job-using-java-and-maven.html https://getblueshift.com/setting-up-hadoop-2-4-and-pig-0-12-on-osx-locally/ ‫ﺳﺎﺯزﯼی‬ ‫ﭘﯿﺎﺩدﻩه‬ ‫ﮐﺪ‬