A Pen Based Intelligent System for Educating Arabic Handwriting Deep Learning
1. A Pen Based Intelligent System for Educating Arabic Handwriting
A Pen Based Intelligent System
for Educating Arabic Handwriting
2. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
3. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
4. A Pen Based Intelligent System for Educating Arabic Handwriting
Problem
Definition
Objectives
Hypothesis
Research
Questions
5. A Pen Based Intelligent System for Educating Arabic Handwriting
Problem
Definition
Objectives
Hypothesis
Research
Questions
6. A Pen Based Intelligent System for Educating Arabic Handwriting
Traditional Learning
7. A Pen Based Intelligent System for Educating Arabic Handwriting
Complexity of Arabic characters.
Expertise needs in traditional recognition systems.
Traditional hand-crafted features.
Arabic handwritten characters mistakes.
8. A Pen Based Intelligent System for Educating Arabic Handwriting
Description Template character Sample character
Missing stroke error
Extra stroke error
Broken stroke error
9. A Pen Based Intelligent System for Educating Arabic Handwriting
Description Template character Sample character
Concatenated stroke error
Stroke order error
Direction Error
10. A Pen Based Intelligent System for Educating Arabic Handwriting
Problem
Definition
Objectives
Hypothesis
Research
Questions
11. A Pen Based Intelligent System for Educating Arabic Handwriting
The main goal of this work is to build and develop an intelligent
tutor system for detecting Arabic preschool children handwriting
difficulty based on immediate feedback.
The second goal of this work is to use deep learning architectures
to recognize Arabic handwritten characters and digits.
12. A Pen Based Intelligent System for Educating Arabic Handwriting
Problem
Definition
Objectives
Hypothesis
Research
Questions
13. A Pen Based Intelligent System for Educating Arabic Handwriting
Our hypothesis is that applying Convolutional neural networks and
stacked auto-encoder to classify Arabic handwritten characters and
digits.
We expect that a simple Convolutional neural network and stacked
Autoencoder will success to obtain competitive results.
We believe that implementing deep learning for this domain
will be moderately easy.
14. A Pen Based Intelligent System for Educating Arabic Handwriting
Problem
Definition
Objectives
Hypothesis
Research
Questions
15. A Pen Based Intelligent System for Educating Arabic Handwriting
Is training a deep learning architectures on handwritten characters
and digits better than computing numeric features from handwritten
characters and digits and training a simpler classifier ?
Is deep learning feasible with the resources we have ? Is there any
advantage to use GPU acceleration ?
Can we simplify the pipeline for Arabic handwritten characters and
digits recognition ?
16. A Pen Based Intelligent System for Educating Arabic Handwriting
Can preprocessing and features extraction be replaced by more
layers on deep learning ?
What are the best parameters for our deep learning architectures ?
What are the advantages of using a automatic feedback to
determine handwriting stroke mistakes for Arab children ?
Are deep learning architectures are a good option for future
research ?
17. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
18. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Digits Recognition
Arabic Handwritten
Characters Recognition
Intelligent
Tutoring Systems
19. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Digits Recognition
Arabic Handwritten
Characters Recognition
Intelligent
Tutoring Systems
20. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Year Method Dataset Error Rate
Alwzwazy et al. 2016 CNN 46,612 4.3%
Kathirvalavakumar
and Palaniappan
2015 K-NN 6670 1.3%
Takruri et al. 2014 SVM 3510 12%
AlKhateeb et al. 2014 DBN 70,000 14.74%
Majdi Salameh 2014 Fuzzy 2000 5%
CNN: Convolutional Neural Network
SVM: Support Vector Machine
DBN: Dynamic Bayesian Network
21. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Year Method Dataset Error Rate
Pandi selvi and
Meyyappan
2013 NN Samples 4%
Mahmoud 2008 SVM 21120
0.15% and
2.16%
Melhaoui et al. 2011 CL 600 1%
NN: Neural Network
SVM: Support Vector Machine
CL: Characteristics Loci
22. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Digits Recognition
Arabic Handwritten
Characters Recognition
Intelligent
Tutoring Systems
23. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Year Method Dataset Error Rate
Hussien et al. 2015 HNN 8 22.75%
ElAdel et al. 2015 CNN 6000 6.08%
Elleuch et al. 2015 DBN 6600 2.10%
Shatnawi and
Abdallah
2015 K-NN 1824 26.6%
CNN: Convolutional Neural Network
HNN: Hopfild Neural Network
DBN: Dynamic Bayesian Network
24. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Year Method Dataset Error Rate
Kef et al. 2015
Fuzzy
NN
3840 6.20%
Alabodi and Li 2014 GF 3840 6.70%
Lawgali et al. 2014
DCT
NN
6033 9.27%
NN: Neural Network
DCT: Discrete Cosine Transform
GF: geometrical features
25. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Digits Recognition
Arabic Handwritten
Characters Recognition
Intelligent
Tutoring Systems
26. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Year Language Method
Will Tang et al. 2014 Chinese special relation matrix
H. Bezine & A.
Alimi
2013 Arabic Attributed Relational Graph
Fork and Chan 2013 Latin Algorithms
Priyankara et al. 2013 Latin logical and spatial relationships
Hammadi et al. 2012 Arabic
Graph matching
A* algorithm
Chea et al. 2012 Latin Chain code and direction code
27. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Year Language Method
Neo et. al. 2012 Latin Chain code and direction code
Chen et al. 2007 Chinese
Feature extraction
spatial relationships
Hu et al. 2007 Chinese
graph matching technique
A* algorithm
Kai-Tai Tang et
al.
2006 Chinese
Hungarian method
Euclidean distance
Tang and Leung 2006 Chinese Feature extraction techniques
28. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
29. A Pen Based Intelligent System for Educating Arabic Handwriting
Pattern Recognition
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
30. A Pen Based Intelligent System for Educating Arabic Handwriting
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
Pattern Recognition
31. A Pen Based Intelligent System for Educating Arabic Handwriting
Pattern recognition is a branch of machine learning
Machine learning is divided into two main types:
supervised learning
unsupervised learning
Supervised learning learn from labeled training data
UnSupervised learning learn from unlabeled training data
32. A Pen Based Intelligent System for Educating Arabic Handwriting
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
Pattern Recognition
33. A Pen Based Intelligent System for Educating Arabic Handwriting
Artificial neural networks or simply neural networks are one of the
most important nonlinear recognition classifiers used today.
Axon
Terminal Branches
of Axon
Dendrites
S
x1
x2
w1
w2
wn
xn
x3 w3
34. A Pen Based Intelligent System for Educating Arabic Handwriting
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
Pattern Recognition
35. A Pen Based Intelligent System for Educating Arabic Handwriting
Common
nonlinear
activation
functions
36. A Pen Based Intelligent System for Educating Arabic Handwriting
Most deep networks use Rectified Linear Unit (ReLU)
ReLU trains much faster
RelU more expressive than logistic function
ReLU prevents the gradient vanishing problem.
37. A Pen Based Intelligent System for Educating Arabic Handwriting
Recognition
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
38. A Pen Based Intelligent System for Educating Arabic Handwriting
Deep learning (DL) is a hierarchical structure network which through
simulates the human brain’s structure to extract the internal and
external input data’s features
39. A Pen Based Intelligent System for Educating Arabic Handwriting
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
Pattern Recognition
40. A Pen Based Intelligent System for Educating Arabic Handwriting
The main component in Stacked Autoencoder is combined
Autoencoder. Autoencoder is a simple three-layer neural network
including an encoder and a decoder where output units are directly
connected back to input units.
In Autoencoder: the number of input units equal the number of
output units.
41. A Pen Based Intelligent System for Educating Arabic Handwriting
Hidden Layer Equation:
Sigmoid Equation:
Output Layer Equation:
42. A Pen Based Intelligent System for Educating Arabic Handwriting
The first sparse auto-encoder produce the primary feature.
43. A Pen Based Intelligent System for Educating Arabic Handwriting
The second sparse auto-encoder produce the secondary feature.
44. A Pen Based Intelligent System for Educating Arabic Handwriting
Soft-max classifier:
45. A Pen Based Intelligent System for Educating Arabic Handwriting
Proposed Stack Auto-Encoder architecture:
46. A Pen Based Intelligent System for Educating Arabic Handwriting
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
Pattern Recognition
47. A Pen Based Intelligent System for Educating Arabic Handwriting
Convolution Neural Networks (CNN) is supervised learning and a family
of multi-layer neural networks particularly designed for use on two
dimensional data, such as images and videos.
A CNN consists of a number of layers:
Convolutional layers.
Pooling Layers.
Fully-Connected Layers.
48. A Pen Based Intelligent System for Educating Arabic Handwriting
Convolutional layer acts as a feature extractor that extracts features
of the inputs such as edges, corners , endpoints.
49. A Pen Based Intelligent System for Educating Arabic Handwriting
50. A Pen Based Intelligent System for Educating Arabic Handwriting
Feature extraction layer
10-1
10-1
10-1
Convolve with Activation
Kernel
51. A Pen Based Intelligent System for Educating Arabic Handwriting
features
Feature extraction layer
52. A Pen Based Intelligent System for Educating Arabic Handwriting
The pooling layer reduces the resolution of the image that
reduce the precision of the translation (shift and distortion) effect.
53. A Pen Based Intelligent System for Educating Arabic Handwriting
54. A Pen Based Intelligent System for Educating Arabic Handwriting
55. A Pen Based Intelligent System for Educating Arabic Handwriting
56. A Pen Based Intelligent System for Educating Arabic Handwriting
57. A Pen Based Intelligent System for Educating Arabic Handwriting
ConvInput Pooling
58. A Pen Based Intelligent System for Educating Arabic Handwriting
59. A Pen Based Intelligent System for Educating Arabic Handwriting
60. A Pen Based Intelligent System for Educating Arabic Handwriting
fully connected layer have full
connections to all activations in the
previous layer.
Fully connect layer act as classifier.
61. A Pen Based Intelligent System for Educating Arabic Handwriting
Neural Network
Activation Functions
Deep Learning
Stacked Autoencoder
Convolutional Neural Network
Intelligent Tutoring Systems
Pattern Recognition
62. A Pen Based Intelligent System for Educating Arabic Handwriting
Intelligent tutoring systems (ITS) are computational agents whose
purpose is to facilitate learning, usually without the help of a
human teacher.
ITS products can be organized on three categories:
Read Systems
Guided Systems
Immediate Error Detection Systems
63. A Pen Based Intelligent System for Educating Arabic Handwriting
Read systems are static not interactive systems; read-only because it
cannot provide the practice of writing.
64. A Pen Based Intelligent System for Educating Arabic Handwriting
The Guided systems allow children to practice writing in a guided
method and on-line.
65. A Pen Based Intelligent System for Educating Arabic Handwriting
The immediate error detection Systems gives access to the
children to practice free writing mode, and provide
immediately a feedback to indicate if there are any errors
in the writing.
66. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
67. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic
Handwritten Digit
Dataset
Convolutional
Neural Network
based on LeNet-5
Stacked
Autoencoder
Convolutional
Neural Network
Optimized
68. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic
Handwritten Digit
Dataset
Convolutional
Neural Network
based on LeNet-5
Stacked
Autoencoder
Convolutional
Neural Network
Optimized
69. A Pen Based Intelligent System for Educating Arabic Handwriting
The MADBase is a modified version of the ADBase
benchmark that has the same format as MNIST benchmark.
MADBase is composed of 70,000 digits written by 700 writers.
The databases is partitioned into two sets:
60,000 Training Data
10,000 Testing Data
70. A Pen Based Intelligent System for Educating Arabic Handwriting
Training Data
Testing Data
71. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic
Handwritten Digit
Dataset
Convolutional
Neural Network
based on LeNet-5
Stacked
Autoencoder
Convolutional
Neural Network
Optimized
72. A Pen Based Intelligent System for Educating Arabic Handwriting
CCN based on LeNet-5 architecture was used with an 8 layers
including one input layer, one output layer, two Convolutional
layers and two sub-sampling, two fully connected layers as multi-
layer perceptron hidden layers for nonlinear classification.
73. A Pen Based Intelligent System for Educating Arabic Handwriting
The experiments outcomes was performed by MATLAB 2016a
programming environment.
Why MATLAB 2016b:
Neural Network Toolbox (contain deep leaning algorithms)
Statistics and Machine Learning Toolbox
Image processing Toolbox
74. A Pen Based Intelligent System for Educating Arabic Handwriting
Misclassification Rate
75. A Pen Based Intelligent System for Educating Arabic Handwriting
Confusion Matrix:
76. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic
Handwritten Digit
Dataset
Convolutional
Neural Network
based on LeNet-5
Stacked
Autoencoder
Convolutional
Neural Network
Optimized
77. A Pen Based Intelligent System for Educating Arabic Handwriting
A Stacked Autoencoder (SAE) is a neural network consisting of
multiple layers of sparse Auto-encoders in which the outputs of each
layer is wired to the inputs of the successive layer.
78. A Pen Based Intelligent System for Educating Arabic Handwriting
Size of input layer is 784 x 60,000
Hidden layer for primary feature is 392
Train Autoencoder with 60,000 training set
Encode The training data with Autoencoder to produce the features
Encoder outcome is 392 x 60,000 features
The First Autoencoder:
79. A Pen Based Intelligent System for Educating Arabic Handwriting
Size of input layer is 392 x 60,000
Hidden layer for secondary feature is 196
Train Autoencoder with 60,000 features set
Encode The training features with Autoencoder to produce the features
Encoder outcome is 196 x 60,000 features
The Second Autoencoder:
80. A Pen Based Intelligent System for Educating Arabic Handwriting
Train a soft-max layer to classify the 196 x 60,000 feature vectors.
The soft-max layer is trained to produce 10 output class.
The Soft-max Classifier:
81. A Pen Based Intelligent System for Educating Arabic Handwriting
The proposed stacked Autoencoder produce ten output Arabic digits
82. A Pen Based Intelligent System for Educating Arabic Handwriting
Confusion Matrix
Feed Testing dataset to
proposed Stacked Autoencoder
Misclassification error is 2.2%
83. A Pen Based Intelligent System for Educating Arabic Handwriting
To produce better outcomes,
fine-tuning was used to update
all SAE parameters.
Feed Training dataset to
proposed Stacked Autoencoder
Feed Testing dataset to
proposed Stacked Autoencoder
Misclassification error is 1.5%
84. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Database Images Error Rate
Takruri et al. Private 3510 12%
AlKhateeb et al. ADBase 70000 14.74%
Majdi Salameh Fonts 2000 5%
Melhaoui et al. Private 600 1%
Pandi selvi & Meyyappan Private Samples 4%
Mahmoud Private 21120 0.15%
Kathirvalavakumar & Palaniappan Private 6670 1.3%
Alwzwazy et al. Private 46,612 4.3%
Our Approach MADBase 70000 1.5%
85. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic
Handwritten Digit
Dataset
Convolutional
Neural Network
based on LeNet-5
Stacked
Autoencoder
Convolutional
Neural Network
Optimized
86. A Pen Based Intelligent System for Educating Arabic Handwriting
We built a new CNN architecture:
INPUT → CONV → RELU → Max-pooling → CONV → RELU →
Max-pooling → FC → RELU → FC → Output
87. A Pen Based Intelligent System for Educating Arabic Handwriting
The CNN architecture
88. A Pen Based Intelligent System for Educating Arabic Handwriting
Confusion Matrix
Error Rate= 0.8%
89. A Pen Based Intelligent System for Educating Arabic Handwriting
The total of wrong
classification is 85 from 10k.
90. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Database Images Error Rate
Takruri et al. Private 3510 12%
AlKhateeb et al. ADBase 70000 14.74%
Majdi Salameh Fonts 2000 5%
Melhaoui et al. Private 600 1%
Pandi selvi & Meyyappan Private Samples 4%
Mahmoud Private 21120 0.15%
Kathirvalavakumar & Palaniappan Private 6670 1.3%
Alwzwazy et al. Private 46,612 4.3%
Our Approach MADBase 70000 0.85%
91. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
92. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Characters DataSet
Stacked
Autoencoder
Convolutional
Neural Network
93. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Characters DataSet
Stacked
Autoencoder
Convolutional
Neural Network
94. A Pen Based Intelligent System for Educating Arabic Handwriting
We collect a dataset that composed of 16,800 characters written by 60
participants, the age range is between 19 to 40 years.
The forms were scanned at the resolution of 300 dpi. Each block is
segmented automatically using Matlab 2016a to determining the
coordinates for each block.
The database is partitioned into two sets: a training set (13,440
characters to 480 images per class) and a test set (3,360 characters to
120 images per class).
95. A Pen Based Intelligent System for Educating Arabic Handwriting
Each participant wrote each
character (from ’alef’ to
’yeh’) ten times on two forms
96. A Pen Based Intelligent System for Educating Arabic Handwriting
The different shapes of some
Arabic characters
97. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Characters DataSet
Stacked
Autoencoder
Convolutional
Neural Network
98. A Pen Based Intelligent System for Educating Arabic Handwriting
Size of input layer is 1024 x 13,440
Hidden layer for primary feature is 512
Train Autoencoder with 13,440 training
set
Encode The training data with
Autoencoder to produce the features
Encoder outcome is 512 x 13,440
features
The First Autoencoder
99. A Pen Based Intelligent System for Educating Arabic Handwriting
Size of input layer is 512 x 13,440
Hidden layer for primary feature is 256
Train Autoencoder with 13,440 features
Encode The features data with
Autoencoder to produce the features
Encoder outcome is 256 x 13,440
features
The Second Autoencoder
100. A Pen Based Intelligent System for Educating Arabic Handwriting
Train a soft-max layer to classify the 256
x 13,440 feature vectors.
The soft-max layer is trained to produce
28 output class.
The Soft-max classifier
101. A Pen Based Intelligent System for Educating Arabic Handwriting
The proposed stacked Autoencoder
produce 28 output Arabic characters
103. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Handwritten
Characters DataSet
Stacked
Autoencoder
Convolutional
Neural Network
104. A Pen Based Intelligent System for Educating Arabic Handwriting
The CNN architecture
106. A Pen Based Intelligent System for Educating Arabic Handwriting
107. A Pen Based Intelligent System for Educating Arabic Handwriting
108. A Pen Based Intelligent System for Educating Arabic Handwriting
The total of wrong
classification is 173 from
3,360.
109. A Pen Based Intelligent System for Educating Arabic Handwriting
Authors Database Images Accuracy Rate
Hussien et al. Private 8 Letters 77.25%
ElAdel et al. IESK-arDB 6000 93.92%
Elleuch et al. HACDB 6600 97.9%
Shatnawi and Abdallah Private 1824 73.4%
Kef et al. IFN/ENIT 3840 93.8%
Alabodi and Li IFN/ENIT 3840 93.3%
Lawgali et al. IFN/ENIT 6033 90.73%
Our Approach Private 16800 94.85%
110. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
111. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
112. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
113. A Pen Based Intelligent System for Educating Arabic Handwriting
114. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
115. A Pen Based Intelligent System for Educating Arabic Handwriting
The AKT system implementation follows the MVC design pattern.
The Model–View–Controller (MVC) is a software architectural
pattern used to design a software system.
View
Controller
Model
Database
116. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
117. A Pen Based Intelligent System for Educating Arabic Handwriting
We Develop two interfaces:
Children & Tutor Interface
Learning Interface
118. A Pen Based Intelligent System for Educating Arabic Handwriting
119. A Pen Based Intelligent System for Educating Arabic Handwriting
120. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
121. A Pen Based Intelligent System for Educating Arabic Handwriting
122. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
123. A Pen Based Intelligent System for Educating Arabic Handwriting
Intelligent Arab Teaching is a multi-agent system based on
three components:
Learning Agent
Feedback Agent
Evaluation Agent
124. A Pen Based Intelligent System for Educating Arabic Handwriting
Learning agent based on four components:
1) stroke number
2) stroke similarity
3) stroke order
4) stroke direction
125. A Pen Based Intelligent System for Educating Arabic Handwriting
Stroke Number Arabic characters
One ،ح،د،ر،س،ص،ط،ع،ل،مﻫ،و
Two أ،ب،ج،خ،ذ،ز،ض،ظ،غ،ف،ك،ن
Three ت،ق،ي
Four ث،ش
126. A Pen Based Intelligent System for Educating Arabic Handwriting
Basic stroke
Similar
characters
Basic stroke
Similar
characters
ٮ ب،ت،ث ط ط،ظ
ح ج،ح،خ ص ص،ض
د د،ذ ع ع،غ
ر ر،ز ٯ ف،ق
س س،ش ل ل،ك
128. A Pen Based Intelligent System for Educating Arabic Handwriting
129. A Pen Based Intelligent System for Educating Arabic Handwriting
Feedback agent based on:
1) Stroke direction detector
2) Stroke order detector
130. A Pen Based Intelligent System for Educating Arabic Handwriting
Intelligent Arab
Teaching system
was used chain
code to encode
a movement.
Code Angle (θ) Direction
C0 355°<θ<5° Right
C1 5°<θ<85° Up Right
C2 85° <θ< 95° Up
C3 95°<θ< 175° Up Left
C4 175° <θ< 185° Left
C5 185° <θ< 265° Down Left
C6 265° <θ< 275° Down
C7 275° <θ< 355° Down Right
131. A Pen Based Intelligent System for Educating Arabic Handwriting
The freeman chain code algorithm is defined in the following three
steps:
Step 1: The absolute difference between y-axis
Step 2: The absolute difference between x-axis
Step 3: Calculate the angle
132. A Pen Based Intelligent System for Educating Arabic Handwriting
133. A Pen Based Intelligent System for Educating Arabic Handwriting
When the preschool children put his/her finger on touch
screen, the system detected the sequence of x−y point
coordinate.
When The children move his/her finger up, the system
store those sequence of points as stroke.
134. A Pen Based Intelligent System for Educating Arabic Handwriting
135. A Pen Based Intelligent System for Educating Arabic Handwriting
In this part, Intelligent Arab Teaching system indicates
the children level of understanding of learning
handwriting character concepts.
Intelligent Arab Teaching system use fuzzy logic to
evaluate Arabic children.
136. A Pen Based Intelligent System for Educating Arabic Handwriting
The Fuzzy Rules
Example
137. A Pen Based Intelligent System for Educating Arabic Handwriting
Fuzzy System & membership functions
138. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Character Difficulty Membership function
139. A Pen Based Intelligent System for Educating Arabic Handwriting
Arabic Character Error Membership function
140. A Pen Based Intelligent System for Educating Arabic Handwriting
Time Consumed Membership Function
141. A Pen Based Intelligent System for Educating Arabic Handwriting
Arab Children Age Membership function
142. A Pen Based Intelligent System for Educating Arabic Handwriting
Children Evaluation Membership Function
143. A Pen Based Intelligent System for Educating Arabic Handwriting
Interfaces
Architecture
Components
Database
Agents
Results
144. A Pen Based Intelligent System for Educating Arabic Handwriting
Directional stroke error of
character Seen.
145. A Pen Based Intelligent System for Educating Arabic Handwriting
Stroke position of Arabic
character Teh.
146. A Pen Based Intelligent System for Educating Arabic Handwriting
Extra stroke error of
Arabic character Seen.
147. A Pen Based Intelligent System for Educating Arabic Handwriting
The Egyptian preschool children and their tutors from Benha city
were asked to use the Intelligent Arab Teaching system as part of
their learning of write Arabic alphabet.
200 questionnaires were collected from the educators & some
children in the experimental groups after the computerized training
program.
The results specify that educators rated the Intelligent Arab Teaching
very highly on acceptability for both likeability and ease of use.
148. A Pen Based Intelligent System for Educating Arabic Handwriting
149. A Pen Based Intelligent System for Educating Arabic Handwriting
150. A Pen Based Intelligent System for Educating Arabic Handwriting
1) Improve children handwriting
تحسيناداءكتابةاالطفال
(a) No (b) Neutral (c) Yes
(ج)نعم(ب)عادى(أ)ال
2) Easy to learn Application
سهولةتعلمالتطبيق
(a) No (b) Neutral (c) Yes
(ج)نعم(ب)عادى(أ)ال
3) Easy to use
سهولةاالستخدام
(a) No (b) Neutral (c) Yes
(ج)نعم(ب)عادى(أ)ال
4) Interactive with kids
متفاعلمعاالطفال
(a) No (b) Neutral (c) Yes
(ج)نعم(ب)عادى(أ)ال
# Yes Neutral No
1 85% 10% 5%
2 90% 5% 5%
3 90% 5% 5%
4 75% 10% 15%
151. A Pen Based Intelligent System for Educating Arabic Handwriting
Introduction
Previous Related Work
Background and Preliminaries
Arabic Handwritten Digits Recognition System
Arabic Handwritten Characters Recognition System
Intelligent Arab Teaching System
Conclusion and Future Work
152. A Pen Based Intelligent System for Educating Arabic Handwriting
In this presentation, we have demonstrated the
effectiveness of deep learning for Arabic handwritten
Arabic characters and digits recognition.
Compared to other machine learning architectures, SAE
and CNN have better performance in both images and
big data of images.
153. A Pen Based Intelligent System for Educating Arabic Handwriting
In Arabic handwritten digits based on MADBase dataset:
We achieved misclassification error rates 12% using CNN
based on LeNet-5.
We achieved misclassification error rates 1.5% using SAE.
We achieved misclassification error rates 0.85% using CNN.
154. A Pen Based Intelligent System for Educating Arabic Handwriting
In Arabic handwritten characters based on our dataset:
We achieve 36% misclassification error rates using
SAE.
We achieve 5.15% misclassification error rates using
CNN.
155. A Pen Based Intelligent System for Educating Arabic Handwriting
An intelligent tutoring system for handwriting Education
was developed, called Intelligent Arab Teaching system.
The main purpose of Intelligent Arab Teaching is to help
Arab preschool children to diagnose their handwriting
mistakes.
156. A Pen Based Intelligent System for Educating Arabic Handwriting
Work on Arabic handwritten word recognition using deep
learning techniques.
Improving the performance of handwritten Arabic
character recognition.
Improving our Intelligent Arab Teaching system to detect
all types of the Arabic handwriting learning mistakes.
157. A Pen Based Intelligent System for Educating Arabic Handwriting
facebook.com/mloey
mohamedloey@gmail.com
twitter.com/mloey
linkedin.com/in/mloey
mloey@fci.bu.edu.eg