FINAL PROJECT INTERNET OF THINGS face recognition door lock system

HCMC University of Technology and EducationFACULTY OF HIGH QUALITY TRAINING FINAL PROJECT INTERNET OF THINGS Face Recognition Door Lock System Instructor: Mr... Therefore, Face Recogniti

HCMC University of Technology and Education

FACULTY OF HIGH QUALITY TRAINING

FINAL PROJECT INTERNET OF THINGS

Face Recognition Door Lock System

Instructor: Mr Dinh Cong Doan

Participants – Group 4:

Huỳnh Thị Mỹ Duyên - 18110009 Nguyễn Tấn Thành - 18110046 Phan Ngọc Bảo Tuyền - 18110062

- -HO CHI MINH CITY, April 30, 2022

ACKNOWLEDGEMENTS 3

CHAPTER 1: OVERVIEW OF THE TOPIC 4

1 Give out the problem 4

2 Research Content 5

CHAPTER 2: THEORETICAL BASIS 6

1 Hardware 6

1.1 ESP 32 ( Board ESP-EYE ) 6

1.2 12V Solenoid Lock 8

1.3 Module Relay 5V 9

1.4 FTDI Board 10

FT232RL Features and Specifications 11

1.5 Charging data cable 12

1.6 Jump wire 12

1.7 Buzzer 13

2 Arduino IDE Software 15

3 Principle of operation 16

CHAPTER 3: DESIGN AND BUILD THE SYSTEM 16

1 Design 16

2 Build the System 17

CHAPTER 4: CONCLUSION 19

1 Result 19

 Difficulties encountered: Due to illness, we couldn't buy electronic components easily, communication with team members was also limited but our team tried our best to do 19

2 Pros and cons 19

2.1 Pros 19

2.2 Cons 19

3 Future Development Direction 19

During the implementation of this project, we have received a lot of help,suggestions and enthusiastic guidance from teachers and friends, so we would like tosincerely thank:

- The management board of Ho Chi Minh City University of Technology andEducation has created the best conditions for students to study and research

- The school's teachers have enthusiastically enjoyed the guide and the schoollibrary has provided textbooks and reference materials throughout the student's learningprocess

- Especially, the guidance and dedicated help of teacher Dinh Cong Doan has

taught, helped and clearly analyzed the problems students still have

We have tried our best in the process of researching and implementing it, butbecause my limited knowledge makes this project unsatisfactory, I hope to receivesuggestions, comments and evaluations on the content and presentation form from teacher

to be able to complete the report better

Sincerely thank!

CHAPTER 1: OVERVIEW OF THE TOPIC

1 Give out the problem

Currently, our country is developing in the direction of industrialization andmodernization, people's demand for convenience in life is increasing, along withthe use of smart technologies is also increasing One of them is the FaceRecognition Door Lock System It helps to make your house modern, convenientand especially effective against theft

Home security systems have become important to every home in Viet Nam

In the past, most doors could be opened by traditional means, such as a key,security card, password, or pattern However, incidents like lost keys have led tomany disturbing cases such as theft and identity fraud This has become animportant issue To overcome this problem, facial recognition using deep learningtechniques has been introduced, and the Internet of Things (IoT) is also used toimplement an effective access control system Raspberry Pi is a small computerboard that is programmable and is used as the main controller for facialrecognition, youth system, and locking system The camera is used to record theimage of the person in front of the door The IoT system allows the user to controlthe entrance to the door

Therefore, Face Recognition Door Lock System is a topic that my groupresearches

2 Research Content

 Study the documentation about Arduino & ESP32

 Design the identification camera, transmission block, power block, readerand central processing block

 Design, calculate and build hardware

 Write code for Arduino

 Assemble and connect the central processing unit and other units

 Display data

 Run system tests

 Fix control errors, programming errors and errors of devices

 Write project report

CHAPTER 2: THEORETICAL BASIS

 Block Diagram:

 Parameters:

Product category Video IC Development Tools

Chip camera on board OV2640

 8Mbyte PSRAM and a 4Mbyte flash storage

 Supports image transmission via Wi-Fi

 Supports debugging through a Micro-USB port

Relay 5V Spectifications Sheet

Input:

 Supply voltage: 5VDC

 Control input signal: 0V

+ Signal is 0V: the relay is closed

+ The signal is 5V: the relay is open

Output:

 NC: Normally closed

 NO: Normally open.

 COM: Common pins

 Source symbol:

 VCC, GND are power supplies for Relay

 In is the control signal pin

1.4 FTDI Board

Leg type Function Description

DTR Data Terminal Ready status pin, used to

control signal flow

RX Serial data receive pin

TX Serial data pin

VCC Power supply pins

CTS Input pin clears data to send, used to control

dataGND GND pins

FT232RL Features and Specifications

 Operating voltage: 5V / 3.3V DC

 Maximum current: 5V – 500mA; 3.3V – 50mA

 Connection: Mini USB port

 Built-in 1024bit EEPROM storage and CBUS I/O configuration

 Data transfer rate from 300 baud to 3 Mbaud (RS422, RS485, RS232) at TTL signal level

 128byte receive buffer and 256 byte transmit buffer

 Transmit and receive LED control signal

 Built-in clock without an external quartz oscillator

The FTDI Basic Breakout (5V) is a basic breakout board for the FTDI FT232RL USB to serial IC The pinout of this board matches the FTDI cable to work with official Arduino and cloned 5V Arduino boards It can also be used for general serial applications The DTR pin allows an

Arduino target to auto-reset when a new Sketch is downloaded This board will auto reset any Arduino board that has the reset pin brought out to a 6-pin connector.

1.5 Charging data cable

 Transfer rate: 480MMbps

 Material: Aluminum shell + TPE + thick nylon braid

 Product features: Full protection SR

 Current:100cm: 2.4A

1.6 Jump wire

Fiber optic patch cord is used for patch cord from device to fiber link It has a thicker layer in use in optical transceivers and connections between terminal boxes.

1.7. Buzzer

Pinout of Buzzer Circuit of

2 Arduino IDE Software

The Arduino IDE (Arduino Integrated Development Environment) is a texteditor help write code to load into arduino board Arduino can run onWindows, MAC OS and Linux

A program written by the Arduino IDE is called sketch, the sketch is saved

in ino format

After starting the Arduino IDE, we get the interface as shown below:

Arduino IDE User Interface

Arduino programs are written in C or C++ The Arduino IDE comes with asoftware library called 'Wiring'.The user needs to define two functions toexecute a program:

 Setup () : function run only once at the start of a program used toinitialize the settings

 Loop() : the function is called repeatedly until the board is turned off

3 Principle of operation

FACE RECOGNITION ENGINEERING EVENT

Once the correct face recognition has been learned, the RelayPin pin will bepulled to the HIGH level After 5 seconds have passed, if there is norecognition face, the pin is set to LOW The code in the rzoCheckForFace()function can be changed to whatever function you require when it comes toface detection

CHAPTER 3: DESIGN AND BUILD THE SYSTEM

2 Build the System

2.1 Implementation

In this tutorial we will explain how to save the registered image (eroll face) in memory, and then we can use these saved identifiers to comparewith the image obtained from the ESP32 There are three steps:

 Create a new partition scheme to enable persistent storage

 Modify CameraWebServer example sketch to save face data to new partition

 Use these saved identities to control devices connected to the ESP32

2.2 repartition ESP32 memory

2.3 Add the following three lines below the available partitioning options

for the esp32wrover board in this board.txt file

2.4 Collect face data for storage

2.5 Delete face data from memory

CHAPTER 4: CONCLUSION

1 Result

 After researching and manufacturing, our face recognize lock door sytem has been working stably

 About design: Compact, simple and accurate

 About purpose: high versatility

 Difficulties encountered:Due to illness, we couldn't buy electronic

components easily, communication with team members was also limited but our team tried our best to do

2 Pros and cons

2.1 Pros

 Suitable for all ages

 Suitable for forgetful people

 Use quickly

 Convenient

2.2 Cons

 Lack of security should only be used for unlocking bedroom doors

or locking applications for things of moderate importance

 High price

 Requires skilled workers

 Use existing images for identification

3 Future Development Direction

 Use high precision components to improve system stability and guarantee

 Integrate more fingerprint processing for the system, enhancing security

 Incorporating more alarm bells when false identification, in order to detectthieves early.

 Combined with high-strength doors