Smart Mirror

Smart mirror helps the customers to try out variety of clothes in a short span of time this innovative tool has made shopping easy and convenient for the customer.           The Smart Mirror System dedicated to providing assi

Project Title

Smart Mirror

Project Area of Specialization

Augmented and Virtual Reality

Project Summary

Smart mirror helps the customers to try out variety of clothes in a short span of time this innovative tool has made shopping easy and convenient for the customer.

          The Smart Mirror System dedicated to providing assistance to buyers visualize themselves trying a variety of clothes and garments virtually without restoring to any physical means for ha customers because It will eventually save a lot of time and inconvenience especially of female buyers also shop owners can save costs because they do not need dressing rooms any more. Moreover wasting clothes tried on by customers will be reduced.

Project Objectives

In this modern era of revolution everyone is depending more and more on technology. People don’t want to spend a lot of time while shopping. Smart mirror provide support for user by offering the facility of selected clothes try-on. Therefore, users can see how they look in the clothes without physically putting them on, and without spending a lot time. A user can operate a computer system by selecting virtual objects on a screen with his/her hand using Kinect.

Project Implementation Method

Following are the project implementation methods:

• User Detection:

To detect the human body first we needed to detect the skeleton. This will be done by RGB-D mapping where the using joint algorithm and shape-based alignment. These were the base of the development of skeleton tracking. These algorithms compiled a unique system with the sensors and algorithm named Kinect.

• Fixed Position Detection:

To make the system more efficient and more functional we needed to fix the position of the user. A fixed position will enable us to get the skeleton data more accurately and to show user the measurement of a cloth. Create a virtual fitting room based on depth data of the Kinect. In the system the body joint coordinate detection process is implemented and before starting the body tracking process the user must be in a fixed position and gesture to initiate the calibration process.

• Virtual Cloth Mapping (2D):

To place a virtual clothing item on the user, first we resize the image of the virtual garment based on the distance between the x-axis of the shoulders and between the y-axis of the hip center and shoulder center.

X-axis of virtual garment’s’ image = x-axis of shoulder left - x-axis of shoulder right

Y-axis of virtual garment’s image = y-axis of hip center - y-axis of shoulder center

Owing to this step, cloth-sizing dynamism is capacitated to those who wear virtual clothes.

Then the resized virtual cloth will be mapped on the user’s body and then user can move in both directions horizontally and vertically to get a better look of the virtual cloth.

• Gesture Control:

To make the system more user friendly the system need to have an interaction point where it can interact with the user. To make that happen a gesture control was needed which will be used to change simulated cloth in the image canvas. This gesture recognition enables the user to change the cloths by swipe of their hand. It is very efficient as the user stands in a little distance from display or screen and cannot use touch-screen or other technology to change the cloths.

Benefits of the Project

Following are the Benefits of the Smart Mirror:

Boutique/Shopping Centers:-

• Providing a better experience and a sophisticated style for selling the product.
• Increase Sales and breakthrough in retailer’s profit.
• Cut down in the number of sales staff.
• Lessen the amount of expenses.
• Displaying all of the products on one side of store.
• Overcrowded public is managed.

Normal users visiting stores:-

• User can Experience a fresh way of shopping.
• No roaming in stores shelf by shelf.
• Trying suits virtually on screen rather than waiting for trail rooms.
• User can take snapshots of their displayed virtual image on system.
• Sharing of pictures through Emails and share with your friends making it more appealing.

Technical Details of Final Deliverable

1. Microsoft Kinect Sensor:

Introduction:

Kinect is a motion sensing input device developed by Microsoft in early 2010. Kinect is mainly used in Xbox 360 console and for Windows PCS. For Windows, a Kinect sensor consists of an RGB camera which can store up to three channel data of resolution 1280×960. It has an IR (infrared) emitter which emits lights beams and an IR depth sensor that reads the reflected beams and process the information to measure the distance between the object and the sensor. It also has multi-array microphone that can capture sound and detect the location of the source and direction of the audio wave. It has a practical ranging limit of 40cm – 3.5m for Windows and the frame rate is 30 FPS (Frames per Second).

Kinect SDK:

Kinect SDK is developed to enable developers to develop applications in C++, C# or Visual Basic by using Microsoft Visual Studio. It is capable of capturing front body 2D motion, gesture, facial, skeletal tracking. To setup virtual mirror we need Kinect sensor to record skeleton and depth data and capture the RGB video stream. Core of the Kinect for the set of Windows API, supports fundamental image and device management features like access to the Kinect sensors that are connected to the computer, access to image and depth data streams from the Kinect image sensors and delivery of a processed version of image and depth data to support skeletal tracking.

2.Microsoft Visual Studio:

Microsoft visual studio is an integrated development environment (IDE) from Microsoft. It is an integrated solution which enables the users to develop console and graphical user interface applications along with Windows Forms Applications (WFP), web sites, web applications, web services etc. Visual studio supports almost all kinds of programming languages including built-in languages such as C, C++ (via Visual C++), VB.NET (via Visual Basic .NET), C# (via Visual C#), and F# (as of Visual Studio 2010). All of these languages are built on top of the .NET Runtime (known as Common Language Runtime or CLR) and produce the same intermediate output in Microsoft Intermediate Language (MSIL). Like any other IDE, it includes a code editor that supports syntax highlighting and code completion using IntelliSense for variables, functions, methods, loops and LINQ queries. IntelliSense is supported for the included languages, as well as for XML and for Cascading Style Sheets and JavaScript when developing websites and web application.

3.Natural User Interface (NUI):

NUI APIs are the set of APIs that retrieves data from Kinect Sensors, camera and control the devices. This enables you to access images and stream data from Kinect Sensors. For any kind of application your application access the NUI APIs, which interacts with Kinect Sensors and transfer back Image Stream, Depth Stream data to applications and this APIs also allow user to take control of Kinect Motor.

Final Deliverable of the Project

HW/SW integrated system

Type of Industry

IT

Technologies

Augmented & Virtual Reality

Sustainable Development Goals

Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com