Augmented Reality integrated online shopping solution

Project Title

Augmented Reality integrated online shopping solution

Project Area of Specialization Augmented and Virtual RealityProject Summary

Augmented-reality based E-commerce platform offers a way to give customers deeper and more complete information about the products, right from their own space personalizing the shopping experience. Allowing the customers to see what products look like on them and the actual size of a product in their space increases customers' confidence in the quality of the products. This solves a major problem of online retail.

Project Objectives

The use of augmented reality in e-commerce gives customers an immersive experience, allowing them to have real-time interaction with products while remaining in their own environment. Augmented reality bridges the gap felt by customers between physical stores and online shopping experiences. Our project objective is to provide users a visual simulation of products, customization and personalized recommendation. Our system will offer the customer multiple products (jewelry, watches and glasses) to virtually try on with the option to customize and price adjustments according to the customizations and users can also browse product filters.

Project Implementation Method

Project implementation is divided into two main parts, first is to design the basic features of an e-commerce system such as user login, catalog and product pages, check out and billing. Then the AR features are implemented in a way that the real-time object pose estimation component acts as the main component of the application and performs the core face detection, facial feature extraction, face tracking and geometric pose estimation operations for determining the head pose and ultimately the pose of the virtual object to be rendered on the human face. The proposed system will be designed to communicate with a backend system that holds a database of 3D models of facial accessories. The administrator can upload the 3D models of the products available for sale and the users can try them out virtually. The proposed application consists of two main components, the Application controller and the Object pose estimator. The application controller is responsible for reading frames one at a time from the mobile device camera as an image and feeding it into the Object pose estimator component. The returned results are used in updating the pose of the 3D model used in terms of position, scale and rotation in a 3D world. The Object pose estimation component acts as the core component that supports the main functionality of the system. Once an image frame is fed into this module by the Application controller, this component will first perform a face and hand detection to see if the image contains a facehand or not. If a face is detected the algorithm will proceed with fitting a facial model to the face thereby extracting facial and hand features. Once all the features are extracted successfully, the algorithm then proceeds with extracting feature points that are suitable to be used with a point tracker. All the computations from this point onwards are done on a processed image obtained by applying a histogram equalization technique to compensate for unfavorable lighting conditions. The facial region extracted from the processed image is then used for feature extraction using a corner detection algorithm. The proposed application uses a threshold value on the number of extracted corner points to decide whether to proceed

Benefits of the Project

AR integrated online shopping platform provides benefits to both brand and the customer. Some of these benefits are:

Try before buying

Clients get the amazing chance to attempt an item prior to purchasing. Consider it from all sides to ensure it merits purchasing. Before, it was only possible by coming to the store. Now, because of augmented reality, clients can play out all the ideal item controls without getting up from the couch. All they need is to download an application and pick the ideal item.

Appealing to customers:

Developing augmented reality solutions in e-commerce is a great way to attract a new generation of consumers. Generation Y and Z is difficult to surprise with anything. Augmented and virtual reality will help to attain more attention from customers.

Increase Brand Awareness

Implementation of AR technologies boosts the brand by making it advanced, innovative, and interesting. Consumers always want to go back to those companies that have taken care of them and provided them with the best experience of using their services. This increases the loyalty of customers and their inclination to buy the products.

Strengthen Consumer-Product Connection

AR applications make a passionate association among client and items. Show of online business merchandise in AR increments customer commitment makes the shopping experience more important, gives clients amazement. This is actually the thing they search for among the endless choices and products

Technical Details of Final Deliverable

Augmented reality based onine shopping sytem wil be deeloped with the help of google's framework Flutter, cloud database Firebase, Flutter's AR tool to be used is Wikitude.

The solution is based on the AR technology utilizing specific markers printed on a band, which should be worn on a user’s wrist or face in place of the accessory item in order to start a virtual try-on of products. The computer vision algorithm processes only those markers visible in the frame and identifies the camera’s position in relation to them. After that, to render a 3D object correctly, the virtual camera should be placed at the same location.

Final Deliverable of the Project Software SystemCore Industry OthersOther IndustriesCore Technology Augmented & Virtual RealityOther Technologies Artificial Intelligence(AI)Sustainable Development GoalsRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	88922
Google Map Api	Equipment	1	3700	3700
virtua try on Api	Equipment	1	5547	5547
Wikitude sdk for flutter	Equipment	1	9253	9253
3D Models	Equipment	1	18544	18544
Firebase	Equipment	1	7417	7417
Google Map Api	Equipment	1	3700	3700
virtua try on Api	Equipment	1	5547	5547
Wikitude sdk for flutter	Equipment	1	9253	9253
3D Models	Equipment	1	18544	18544
Firebase	Equipment	1	7417	7417