SlideShare une entreprise Scribd logo
1  sur  27
DIPLOMA THESIS DESIGN
VOICE INTERACTIONS IN A SMART HOME
Budapest University of Technology and Economics
Author: KARIM NAIRI
Supervisor: Dr Gabor Feher
11 January 2021
Presentation plan:
2
1- Project display:
• Introduction
• Problem
• Requirements specification
2- Proposed solution:
• Traitement card
• Voice interaction card
• Block diagram of the system
3- Planning:
4- Work done
Conclusion
Project
display
3
Introduction:
■ Voice control was a dream
■ Currently voice control is a reality and is accessible to the general public
■ Many manufacturers are trying to position themselves in the market
■ Google Home, Amazon Alexa, Apple Siri …
■ Speech Recognition and Speech Synthesis APIs have been developed
■ All the proposed systems are based on internet connection
4
Voice Interaction in a smart house:
■ A smart person is someone who has the information and knowledge to solve a
problem.
■ A smart home needs the availability of information from its environment.
■ Depending on a given situation, actions are taken.
To have this we need:
 A set of sensors are available according to user needs.
 A program is designed to handle different cases.
5
Problem:
6
How to make a voice response system in a smart home?
Requirements specification:
7
Voice to
interaction
card
Treatment
card
 Tool able to hear voice commands and to speak.
 Device able to convert voice commands and to
realise an action over the Appliance.
 Microphone and speakers .
Peripheral
Proposed
solution
8
9
Introduction:
Most of the Voice Interactive Response (VIR) applications use an Internet
connection.
During the search I discovered the MOVI: My Own Voice Interface card. It is a card
that allows recognition and speech synthesis based on a memory card without the
need for an internet connection.
This board will be the core for the realization of the project.
 No internet connexion
 Cheap
 Scalable according to user needs
 Security
Block diagram of the system:
10
Traitement Board:
Arduino Simple to program
Open-source software
and hardware
flexible
Not expensive
11
MOVI Shield:
MOVI
SHIELD Simplicity of
implementation
Data Security and Safety
No internet needed
Low energy
consumption
12
SD Card:
■ The SD card is the essential part of the MOVI card
■ Training: MOVI’s Arduino library sends the training sentences in textual form
over the serial connection to the shield. The shield phonetizes the words in
each sentences using a 2 GB English dictionary that knows spelling rules and
approximates even for proper names.
■ Recognition: During recognition, a waveform comes in over the microphone
and is broken down into speech and non-speech regions. The speech regions of
the signal are then passed to a classifier that has been trained on hundreds of
adult speakers.
13
Planning
14
System components:
15
DHT11
Operating flow diagram:
16
Arduino board with components:
17
www.TheEngineeringProjects.com
Vcc
OUT
GND
TestPin
PIR
PIR SENSOR
80
27
%RH
>
°C
DATA
2
VDD
1
GND
4
U2
DHT11
D1
LED=PIR
R1
220
R2
220
D2
LIGHT or DARK
DIGITAL
(~PWM)
ANALOG
IN
ATMEGA328P-PU
1121
~
~
~
~
~
~
microcontrolandos.blogspot.com
TX
RX
PD0/RXD
0
PD1/TXD
1
PD2/INT0
2
PD3/INT1
3
PD4/T0/XCK
4
PD5/T1
5
PD6/AIN0
6
PD7/AIN1
7
PB0/ICP1/CLKO
8
PB1/OC1A
9
PB2/SS/OC1B
10
PB3/MOSI/OC2A
11
PB4/MISO
12
PB5/SCK
13
AREF
PC5/ADC5/SCL
A5
PC4/ADC4/SDA
A4
PC3/ADC3
A3
PC2/ADC2
A2
PC1/ADC1
A1
PC0/ADC0
A0
RESET
ARDUINO UNO
ARDUINO UNO R3
R3
4.7K
1.0
LDR
LDR
R5
5k
U2(VDD)
PIR(PB5/SCK)
LDR(2)
R4
10k
SECURITY
R4(1)
Light test:
18
LDR light test:
19
We tried to introduce the possibility of artificial intelligence (AI)
DHT11 test:
20
If the sensor is incorrectly connected or not functional, the system informs the
user.
PIR test:
21
In this part we used the state of the PIR to light a lamp when
it is active, and do say ‘’Can I help you? ‘’ Except at the rising
front.
Security Test:
22
In this essay we read a digital data
23
Result
Result:
24
■Vidéo
25
Conclusion:
■ Discovery of speech recognition and speech synthesis
■ Creation of a VIR system without an internet connection
■ The cost is about
■ The system can be used as:
 A security system
 A regulation system to control humidity, temperature, light,,,
 …
26
THANK YOU FOR YOUR
ATTENTION
27

Contenu connexe

Similaire à thesisV4.pptx

Similaire à thesisV4.pptx (20)

Voice Control Home Automation
Voice Control Home AutomationVoice Control Home Automation
Voice Control Home Automation
 
Arduino presentation by_warishusain
Arduino presentation by_warishusainArduino presentation by_warishusain
Arduino presentation by_warishusain
 
Iot based garbage monitoring system
Iot based garbage monitoring systemIot based garbage monitoring system
Iot based garbage monitoring system
 
Iot based digital notice board with arduino
Iot based digital notice board with arduinoIot based digital notice board with arduino
Iot based digital notice board with arduino
 
Presentation.pptx
Presentation.pptxPresentation.pptx
Presentation.pptx
 
Introduction to Arduino & Raspberry Pi
Introduction to Arduino & Raspberry PiIntroduction to Arduino & Raspberry Pi
Introduction to Arduino & Raspberry Pi
 
Eyes of things
Eyes of thingsEyes of things
Eyes of things
 
ArduRadio
ArduRadio ArduRadio
ArduRadio
 
Arduino, Open Source and The Internet of Things Landscape
Arduino, Open Source and The Internet of Things LandscapeArduino, Open Source and The Internet of Things Landscape
Arduino, Open Source and The Internet of Things Landscape
 
Raspberry Pi
Raspberry PiRaspberry Pi
Raspberry Pi
 
Hello World - Introduction to coding.pptx
Hello World - Introduction to coding.pptxHello World - Introduction to coding.pptx
Hello World - Introduction to coding.pptx
 
Home automation through android mobile 1
Home automation through android mobile 1Home automation through android mobile 1
Home automation through android mobile 1
 
ARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHON
ARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHONARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHON
ARTIFICIAL INTELLIGENCE DESKTOP VOICE ASSISTANT IN PYTHON
 
Report
ReportReport
Report
 
DIGITAL LOGIC DESIGN (1) PROJECT REPORT.docx
DIGITAL LOGIC DESIGN (1) PROJECT REPORT.docxDIGITAL LOGIC DESIGN (1) PROJECT REPORT.docx
DIGITAL LOGIC DESIGN (1) PROJECT REPORT.docx
 
IoT Session Thomas More
IoT Session Thomas MoreIoT Session Thomas More
IoT Session Thomas More
 
Cc internet of things @ Thomas More
Cc internet of things @ Thomas MoreCc internet of things @ Thomas More
Cc internet of things @ Thomas More
 
Comparison of ESP programming platforms
Comparison of ESP programming platformsComparison of ESP programming platforms
Comparison of ESP programming platforms
 
Type 2 final project list 15 16
Type 2 final project list 15 16Type 2 final project list 15 16
Type 2 final project list 15 16
 
IRJET- Smart Home: Speech Recognition based Home Automation using IoT
IRJET-  	  Smart Home: Speech Recognition based Home Automation using IoTIRJET-  	  Smart Home: Speech Recognition based Home Automation using IoT
IRJET- Smart Home: Speech Recognition based Home Automation using IoT
 

Dernier

Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Christo Ananth
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
dharasingh5698
 

Dernier (20)

Online banking management system project.pdf
Online banking management system project.pdfOnline banking management system project.pdf
Online banking management system project.pdf
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance BookingCall Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
Call Girls Wakad Call Me 7737669865 Budget Friendly No Advance Booking
 
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
 
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01Double rodded leveling 1 pdf activity 01
Double rodded leveling 1 pdf activity 01
 
Thermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - VThermal Engineering-R & A / C - unit - V
Thermal Engineering-R & A / C - unit - V
 
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
 
Double Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torqueDouble Revolving field theory-how the rotor develops torque
Double Revolving field theory-how the rotor develops torque
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
Thermal Engineering Unit - I & II . ppt
Thermal Engineering  Unit - I & II . pptThermal Engineering  Unit - I & II . ppt
Thermal Engineering Unit - I & II . ppt
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
University management System project report..pdf
University management System project report..pdfUniversity management System project report..pdf
University management System project report..pdf
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
 
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Palanpur 7001035870 Whatsapp Number, 24/07 Booking
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 

thesisV4.pptx

  • 1. DIPLOMA THESIS DESIGN VOICE INTERACTIONS IN A SMART HOME Budapest University of Technology and Economics Author: KARIM NAIRI Supervisor: Dr Gabor Feher 11 January 2021
  • 2. Presentation plan: 2 1- Project display: • Introduction • Problem • Requirements specification 2- Proposed solution: • Traitement card • Voice interaction card • Block diagram of the system 3- Planning: 4- Work done Conclusion
  • 4. Introduction: ■ Voice control was a dream ■ Currently voice control is a reality and is accessible to the general public ■ Many manufacturers are trying to position themselves in the market ■ Google Home, Amazon Alexa, Apple Siri … ■ Speech Recognition and Speech Synthesis APIs have been developed ■ All the proposed systems are based on internet connection 4
  • 5. Voice Interaction in a smart house: ■ A smart person is someone who has the information and knowledge to solve a problem. ■ A smart home needs the availability of information from its environment. ■ Depending on a given situation, actions are taken. To have this we need:  A set of sensors are available according to user needs.  A program is designed to handle different cases. 5
  • 6. Problem: 6 How to make a voice response system in a smart home?
  • 7. Requirements specification: 7 Voice to interaction card Treatment card  Tool able to hear voice commands and to speak.  Device able to convert voice commands and to realise an action over the Appliance.  Microphone and speakers . Peripheral
  • 9. 9 Introduction: Most of the Voice Interactive Response (VIR) applications use an Internet connection. During the search I discovered the MOVI: My Own Voice Interface card. It is a card that allows recognition and speech synthesis based on a memory card without the need for an internet connection. This board will be the core for the realization of the project.  No internet connexion  Cheap  Scalable according to user needs  Security
  • 10. Block diagram of the system: 10
  • 11. Traitement Board: Arduino Simple to program Open-source software and hardware flexible Not expensive 11
  • 12. MOVI Shield: MOVI SHIELD Simplicity of implementation Data Security and Safety No internet needed Low energy consumption 12
  • 13. SD Card: ■ The SD card is the essential part of the MOVI card ■ Training: MOVI’s Arduino library sends the training sentences in textual form over the serial connection to the shield. The shield phonetizes the words in each sentences using a 2 GB English dictionary that knows spelling rules and approximates even for proper names. ■ Recognition: During recognition, a waveform comes in over the microphone and is broken down into speech and non-speech regions. The speech regions of the signal are then passed to a classifier that has been trained on hundreds of adult speakers. 13
  • 17. Arduino board with components: 17 www.TheEngineeringProjects.com Vcc OUT GND TestPin PIR PIR SENSOR 80 27 %RH > °C DATA 2 VDD 1 GND 4 U2 DHT11 D1 LED=PIR R1 220 R2 220 D2 LIGHT or DARK DIGITAL (~PWM) ANALOG IN ATMEGA328P-PU 1121 ~ ~ ~ ~ ~ ~ microcontrolandos.blogspot.com TX RX PD0/RXD 0 PD1/TXD 1 PD2/INT0 2 PD3/INT1 3 PD4/T0/XCK 4 PD5/T1 5 PD6/AIN0 6 PD7/AIN1 7 PB0/ICP1/CLKO 8 PB1/OC1A 9 PB2/SS/OC1B 10 PB3/MOSI/OC2A 11 PB4/MISO 12 PB5/SCK 13 AREF PC5/ADC5/SCL A5 PC4/ADC4/SDA A4 PC3/ADC3 A3 PC2/ADC2 A2 PC1/ADC1 A1 PC0/ADC0 A0 RESET ARDUINO UNO ARDUINO UNO R3 R3 4.7K 1.0 LDR LDR R5 5k U2(VDD) PIR(PB5/SCK) LDR(2) R4 10k SECURITY R4(1)
  • 19. LDR light test: 19 We tried to introduce the possibility of artificial intelligence (AI)
  • 20. DHT11 test: 20 If the sensor is incorrectly connected or not functional, the system informs the user.
  • 21. PIR test: 21 In this part we used the state of the PIR to light a lamp when it is active, and do say ‘’Can I help you? ‘’ Except at the rising front.
  • 22. Security Test: 22 In this essay we read a digital data
  • 26. Conclusion: ■ Discovery of speech recognition and speech synthesis ■ Creation of a VIR system without an internet connection ■ The cost is about ■ The system can be used as:  A security system  A regulation system to control humidity, temperature, light,,,  … 26
  • 27. THANK YOU FOR YOUR ATTENTION 27