This Project has made an attempt to show background of massive information management and referenced numerous issues and difficulties faced to process large amount of information. Many execution based limitations are observed while Hadoop MapReduce is utilized to execute jobs which require prom
Improving Data Locality In Hadoop Framework For Big data applications
This Project has made an attempt to show background of massive information management and referenced numerous issues and difficulties faced to process large amount of information. Many execution based limitations are observed while Hadoop MapReduce is utilized to execute jobs which require prompt reactions; also, potential solutions are examined and presented. As to increase the execution of map and reduce jobs, enhancement methodologies are needed to increase the execution of MapReduce performance to enhance data locality. A better scheduling algorithm has been considered that is iShuffle which can result in great execution and outputs. Then we examined some limitations from ishuffle algorithm and purposed a new solution Eishuffle based on job size, partition size and enhance real time processing. EIShuffle gives better results and increase the CPU utilization and decrease the responce time.
The following are the goals of research project:
A new solution is proposed in the project and is implemented in 4-node cloudera Hadoop on google.
The Proposd solution is better than the existing Techniques.
The main purpose of this project is basically to improve data locaity In hadoop so that the management of Big Data would be Easy. In oyr work we deal with the responce time and real time processing og the Data Jobs.
A Research paper named " A critical analysis:Improving Data locality in Hadoop Framwork for Big Data Applications " is written and Published by INCCST Conference.
Another Research paper is in progress in which the testing and results of the proposed solution are discussed.
| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Publication Fee | Miscellaneous | 1 | 5000 | 5000 |
| Domain and Hosting | Equipment | 3 | 20000 | 60000 |
| Survey Travel Cost | Miscellaneous | 1 | 5000 | 5000 |
| Total in (Rs) | 70000 |
In this century, computer vision has a wide range of applications in various fields of lif...
Today internet has become a major source for data searching and scraping as per one?s need...
Wearable electronic equipment is continually improving and becoming more integrated with t...
We are going to make a bicycle which will use solar so no batteries will be provided....
Automatic synchronizers are widely employed to connect more than one synchronous generator...