Facial recognition based Speak Doorbell and future trends

Project Title

Facial recognition based Speak Doorbell and future trends

Project Area of Specialization Internet of ThingsProject Summary Project Summary

We are introducing a smart and technological doorbell system for the homes, apartments, in-door rooms, offices etc, based on facial recognition approach as well as an innovative speaking methodology.The tools this system would use are:

1. An HD camera with a night vision capability.
2. There would be a database feature in the form of UI device, providing the customer more informative and efficient way to deal with the visitors.
3. It also include a Speaker, producing a pleasant smooth voice to inform the resident.

The interface design of this proposed system would be customized, depending upon the requirements and interest area of the customer.This approach of Speak Doorbell would result in providing the resident more ease, convenience and comfortability regarding to the door.It will be an innovative experience towards the future of smart doorbell systems.
Although, there exist some smart doorbell systems in the market but our doorbell system has the different approach that's what make it innovative product.

Project Objectives Project Objectives

The aim of this product is to resolve the problems, people face in their residence regarding to the doorbell. For instance,

• Even if we have a simple bell on the door but the problem is, we exactly do not know, which persond is being knocked at the door.
• When it is cold outside the residence, no one would dare to go to the door and would check who knocked at the door, while sitting or lying under the blanket. The problem is, it would be so hard for one to leave the blanket and check the door whout knwoing who knocked at the door.
• It would be insecure, if someone will open the door without having any idea, who'es been knocking at the door.
• Sometimes, naughty children ring the bell, consider it as a fun for them. And resident has to check the door without knowing that they were children.

However, the main purpose of this smart doorbell is to provide the customer an effective and effcient way to know the circumstances about the door through a proper channel.To provide such channel, Speak Doorbell would detect the face of a person (visitor) at the door and inform the resident/host that who is at the door by speaking his/her identity (name) in the form of voice. In such manner, this smart doorbell (channel) will provide more comfort and ease to the people in their homes or apartments or any room which they want to have such informative and alert doorbell systems.
 

Project Implementation Method Working

Suppose a person, name Hamza, rings the bell as shown in figure 1.

1. The camera gets on and detects the face of HAMZA.
2.  After that, the camera sends the detected data to the UI device for the analysis (matching).
3. When the data is analyzed, the data is sent further to the speaker to tell the resident (ZEESHAN) that HAMZA is at the door, depending on the data is wether matched or not.
4. If data is matched from the Database then the speaker would say “HAMZA is at the door”. If it is not matched then the speaker would say “Unknown person is at the door”.

Software Requirements:

•  Matlab would be required to achieve the Facial recognition approach.
• Android Studio would be used to create the User Interface for the Database.
• SQLite would be used for the database.

NOTE: The User Interface of Speak Doorbell would be like:images/Facial recognition based Speak Doorbell and future trends _1582918845.png?dl=0

However, this is the generall idea not compulsive.

 Hardware requirement:

• Bell button and HD Camera (with a night vision feature) would be placed on a single board (circuit board).
• An embbaded hardware such as Ardino or Resberry Pi3 and a touch screen LCD TFT panel would  be used to make the device for user interface.
• User Interface device would be used to save and remove the database at user end. Login system would also be a part of this device to make the data more secure. 
• An Speaker (smooth voice) inside the residence. This speaker will get the message from the UI device and then speak the message to the resident.

S.No	Hardware	Purposes
1	Camera	For Facial Recognition.
2	UI Device	To create Database/Information at user end.
3	Speaker	To inform the resident about the person who’s been knocking.

S.No123Benefits of the Project

The project will have the following primary advantages:

Secure: It would make the door more informative and secure for the resident.
Satisfied: Speak Doorbell would prove to be a convenient and comfortable product for the user.
Innovative: There would be no product with similar approach, as Speak Doorbell has, in the market yet. This would be a new experience for the customers.
Competitive: According the to features/services, Speak Doorbell is providing, it will merge in the market among the competitors.

Future Work: In the future, we can further work on different features like providing the Video streaming, battery system, wifi enabling, mobile application for Mobile users, motion detection, etc.

The final product would be look like this(Approximately):images/Facial recognition based Speak Doorbell and future trends _1582918846.png?dl=0

Technical Details of Final Deliverable

The scop of this project is to provide the resident more reliable and efficient smart door bell in a very easy and effective way so that the resident can stay in toch with the people who come and knock at the door. This would prove, ultimately, beneficial for the resident.

1. A smart hardware based module of door bell that is adusjable with the already installed classical door bells.
2. A digital smart camera based door bell that is capable to recognize the known and unkhnown person and speak according to it.

Final Deliverable of the Project HW/SW integrated systemType of Industry IT , Security Technologies Internet of Things (IoT)Sustainable Development Goals Industry, Innovation and InfrastructureRequired Resources

Elapsed time in (days or weeks or month or quarter) since start of the project	Milestone	Deliverable
Month 1	Android Application	We will develop android application for User Interface
Month 2	Matlab for Facial Recogniation	After developing the Android App, we will work on facial recognition through Matlab and merge the facial part with android app.
Month 3	User Interface Device	In this section, we will make a UI device by using aurdino or resberry pi3 and LCD screen in a way so that we can use android app on it.
Month 4	Implementing the whole system	After completing each part of development, we will synchronize the whole system together.
Month 5	Final Testing	After putting the whole system togather, we will test it properly so that our system can work properly