Database Comparison Utility Solution

Project Title

Database Comparison Utility Solution

Project Area of Specialization Shared EconomyProject Summary

This utility is being developed to help the end users who have to compare large databases in real time. This utility will make the database comparison work and process not even faster but more accurate too. This utility system does not just allow the user to compare databases but specifically focuses on huge SQLite databases allowing flexibility while comparing the databases.

In companies, when a structure or a solution for some project is designed, the statistics and ideal design values in a database are recorded in order to implement them in the project during its development to avoid any issues. After the completion of the project, the design values of the implemented project are recorded. These real-word implemented design values are then compared to the proposed ideal design values. As the real-world situations are not ideal so there might occur some difference between the idealized and the real values. If there occurs a difference between the proposed and real design values, it might be problematic if not considered. These error values can also cause minor to major hazards which include destruction of whole project or infrastructure and might cause life loss too.

The use of the tolerance factor in the database comparison utility solution introduces flexibility to the database comparison process. With the help of this factor we try to cope up with the real-world post-implementation design value changes in the database. The tolerance factor that is being introduced in this system actually specified the range in the form of percentage up to which the changes in the real-world recorded data are acceptable and hence there might be no danger or fault in the project. This factor might also stop the false alarms, that might appear due to the non-flexible design of the other database comparison system or solutions. Hence, preventing the damage or loss of the infrastructure as well as lives.

Project Objectives

The aims of our project include:

• Making real time comparison of huge SQLite databases flexible instead of performing strict comparison. 
• Efficient and quick comparison of huge SQLite databases.
• Comparison of multiple database fields at a time including integer, character, floating point and alphanumeric.
• Introduction of flexible database comparison feature in the software:
  • Addition of column tolerance comparison factor/feature.
  • Addition of generic tolerance comparison factor/feature.
• Creation of a user-friendly utility solution that can be used in off-shore structural industry in real time.
• Developing a pathway of further research in big data handling and optimization.

Project Implementation Method

For the implementation of Database Comparison Utility Solution (DCUS) a whole Software Development Life Cyclewill be followed. Agile development method has been selected for this purpose. Agile methodology is selected as it suits best to DCUS and is also in accordance with the requirements of the utility.

Firstly, connections will be established with both baseline and test databases. After that total database tables will be extracted, counted and stored in a list. This list will be stored in a separate memory space. The total number of tables and records in a database can vary up to hundreds and thousands and even million as the size of the databases can be very large.

Tables with record will be processed, sorted and separated from the tables which contain no record. Processing of two huge databases at the same time is a costly and time taking process due to processing and calculation complexities.

For database comparison module, the processors of the device will be assigned the comparison task as per the capability of the device. In order to improve the processing and database querying speed multiple methods will be tested again and again so as to evaluate the best and efficient possible method correctly. Comparison of corresponding tables of baseline and test databases will be performed. During the implementation of DCUS different database query and performance optimizing techniques will also be used and tested.

Along with the tolerance factor being introduced in this process, these techniques will increase the efficiency database comparison process up to maximum. After the comparison of the databases, corresponding cell tolerance of the comparison results will be calculated and processed. The calculated results will then be compared with predefined value(s) of the stored tolerance value(s). Database comparison results will be stored in XML, text and database formats.

Benefits of the Project

Many offshore and cross sea bridges and other offshore infrastructures have been around the world. Due to offshore corrosion and continuously varying environment, the offshore structures have time varying fragility. For increasing their durability and avoiding complete damage or loss due to multiple environmental factors the constructors and engineers have to keep a keen eye on multiple measurements regarding the built structure. The main goal of this project is to develop such a utility that might help the companies mainly during off-shore structural analysis to compare their SQLite databases without getting any false positive alarms or errors at the end. The tolerance factor being introduced in this system will help to decrease or approximately remove the false positive failure reports, hence increasing the efficiency of the system. This will help saving many lives which might be damaged due to the infrastructure damage. This will also help in maintaining the infrastructure hence supporting the economy and reputation of the country.

Technical Details of Final Deliverable

The final deliverable of this project is a software system which will be mainly desktop-based devices. The final deliverable of this project will be developed using software development standards over an agile software development life cycle. This will not only ensure the quality of the product but as this product is an innovation in the big data comparison field so it will also prove to be an efficient and flexible. The developed system will not only compare the databases dynamically according to the size of the databases but also in accordance with the processing power of the device.

Final Deliverable of the Project Software SystemType of Industry IT , Manufacturing Technologies Big DataSustainable Development Goals Industry, Innovation and InfrastructureRequired Resources

Item Name	Type	No. of Units	Per Unit Cost (in Rs)	Total (in Rs)
			Total in (Rs)	67760
Portable SSD with cable	Equipment	2	28910	57820
Travel	Miscellaneous	3	1000	3000
Printing	Miscellaneous	6	1000	6000
Binding of Thesis	Miscellaneous	1	940	940