TalkSee

Communication plays a crucial role in our daily life. But, there are still some gaps while interacting with people from different cultures due to language barriers In the increasingly integrated global business community, due to an increasing need to communicate with people all arou

Project Title

TalkSee

Project Area of Specialization

Artificial Intelligence

Project Summary

Communication plays a crucial role in our daily life. But, there are still some gaps while interacting with people from different cultures due to language barriers

In the increasingly integrated global business community, due to an increasing need to communicate with people all around the world, the language barrier between different cultures needs to be removed. Therefore, by keeping in mind, the problem of the language barrier we proposed a solution named TalkSee.

TalkSee is a web-based chat application that will allow people to have cross-cultural communication with each other on one platform. TalkSee facilitates its users to opt for a language in which they want to type text messages and received videos on their side. TalkSee reduces the language barriers among its user by translating their text messages, written in their chosen language, to some other language on the receiver’s end in the form of their talking Avatar to provide them with the best possible experience of communication.TalkSee is an application that provides text messages as well as short video clips of Talking Avatar because people are inclined to watch a short video rather than read a long text message.

Project Objectives

Following are the objectives for our project:

• To provide a user-friendly and cooperative design.
• To provide users with an option of setting up their preferred language that enables the users to type and communicate in their chosen language.
• To provide users with an option of setting up their profile picture of their own choice.
• To build a virtual model from the user’s profile pictures in which the translated message will be fed and converted to speech then a video of that talking avatar with lip syncing will be shown to the receiver.

Project Implementation Method

After signup verification, the user will need to create his profile by adding his preferences. Then, the user needs to login in order to take benefits from TalkSee. As TalkSee, is a web-based chat application the user will add friends in the contact list to start communication.

While chatting with a friend, the user will type a text message in his preferred language, when user will send this text message, this text message will pass through the translator that will convert the sent text into the receiver's preferred language. For translating the text message, sent by the user, to a specified language, we are using ‘GTrans’ library which uses Google Translator’s API.

The generated translated text will pass through the Text to Speech module that will give an output in the form of an audio. For converting the translated message to speech, we are using ‘gTTs’ library which is the Google Text-to-Speech engine.

The translated audio and the profile image of the sender will be given to the Generative Adversarial Network (GAN) a deep learning-based generative model, that will give output in the form of Talking Avataron on the receiver side. In order to continue the chat, the same above process will be follow by other users.

Benefits of the Project

• This project is aimed at providing a user-friendly application that will be helpful to enhance the social and business networks of a person even if he only knows his native language. 
• This project will facilitate the user to set the profile of his own choice without any restriction.
• Received Talking Avatar on the receiver's end will provide a realistic experience of face-to-face communication. 

Technical Details of Final Deliverable

The final deliverable of the project is a web-based application that would be ready to use where there is a need for cross-cultural communication. The application is aimed to remove language barriers among people from different language backgrounds in a more meaningful experience of in-person communication.

Final Deliverable of the Project

Software System

Core Industry

IT

Other Industries

Core Technology

Artificial Intelligence(AI)

Other Technologies

Sustainable Development Goals

Decent Work and Economic Growth, Industry, Innovation and Infrastructure

Required Resources

If you need this project, please contact me on contact@adikhanofficial.com