An Intelligent Approach for Handling Complexity by Migrating from Conventional Databases to Big Data
Open Access
- 3 December 2018
- Vol. 10 (12), 698
- https://doi.org/10.3390/sym10120698
Abstract
Handling complexity in the data of information systems has emerged into a serious challenge in recent times. The typical relational databases have limited ability to manage the discrete and heterogenous nature of modern data. Additionally, the complexity of data in relational databases is so high that the efficient retrieval of information has become a bottleneck in traditional information systems. On the side, Big Data has emerged into a decent solution for heterogenous and complex data (structured, semi-structured and unstructured data) by providing architectural support to handle complex data and by providing a tool-kit for efficient analysis of complex data. For the organizations that are sticking to relational databases and are facing the challenge of handling complex data, they need to migrate their data to a Big Data solution to get benefits such as horizontal scalability, real-time interaction, handling high volume data, etc. However, such migration from relational databases to Big Data is in itself a challenge due to the complexity of data. In this paper, we introduce a novel approach that handles complexity of automatic transformation of existing relational database (MySQL) into a Big data solution (Oracle NoSQL). The used approach supports a bi-fold transformation (schema-to-schema and data-to-data) to minimize the complexity of data and to allow improved analysis of data. A software prototype for this transformation is also developed as a proof of concept. The results of the experiments show the correctness of our transformations that outperform the other similar approaches.Keywords
This publication has 17 references indexed in Scilit:
- SQL-to-NoSQL Schema Denormalization and Migration: A Study on Content Management SystemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Cloud Computing for Extracting Price Knowledge from Big DataPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Migration of Relational Database to Document-Oriented Database: Structure Denormalization and Data TransformationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- From Relations to Multi-dimensional Maps: Towards an SQL-to-HBase Transformation MethodologyPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- A Framework for Migrating Relational Datasets to NoSQL 1Procedia Computer Science, 2015
- ODBAPI: A Unified REST API for Relational and NoSQL Data StoresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- CassandraACM SIGOPS Operating Systems Review, 2010
- BigtableACM Transactions on Computer Systems, 2008
- DynamoACM SIGOPS Operating Systems Review, 2007
- The log-structured merge-tree (LSM-tree)Acta Informatica, 1996