Applications for Big Data Analysis - 1806 Words

In the last few years the global marketplace has seen exponential growth in data volume. Every day people create unstructured large datasets of different types such as GPS coordinates, payment transactions, web data, e-mails or smart meter values that are termed as big data \cite{nasscom}. The need to derive useful information from such data requires the development of specific tools that are based on techniques as data mining, statistics, artificial intelligence, neural networks and other advanced analytics methods \cite{russom}. The analysis of big data is widely used in insurance, medicine for disease prediction and improved health outcomes, industry for sales prediction and customer relationship optimization and transport \cite{oreilly, kinsey}. There is a wide range of paid or open source tools and techniques for big data analytics: statistical analysis, online analytical processing (OLAP) tools \cite{dwh}, data warehouses (DWH) \cite{dwh}, distributed programming models (e.g., MapReduce \cite{mapreduce}), clouds \cite{cloudcomputing}, complex event processing \cite{cep}, etc. \cite{russom}. The objective of the proposed research is to evaluate different applications for big data analysis using benchmarks for store sales with focus on performance, and to compare their applicability in this context. Two open source applications such as KNIME \cite{knime, rosaria, berthold} and WEKA \cite{weka, hallweka} and two open-source software packages: R language packageShow MoreRelatedStatistical Analysis : The Big Data Analytics1399 Words   |  6 PagesThe big data analytics deals with a large amount of data to work with and also the processing techniques to handle and manage large number of records with many attributes. The combination of big data and computing power with statistical analysis allows the designers to explore new behavioral data throughout the day at various websites. It represents a database that can’t be processed and managed by current data mining techniques due to large size and complexity of data. Big data analytic includesRead MoreData Mining Of Big Data1646 Words   |  7 PagesData Mining in Big Data Vishesh Shukla Department of Computer Science University of Technology and Management Shillong, India shukla.vishesh07@gmail.com Saurav Utkarsh Department of Computer Science University of Technology and Management Shillong, India saurav.utkarsh@stu.utm.ac.in Sahil Mittal Department of Computer Science University of Technology and Management Shillong, India tousif.raza@stu.utm.ac.in Abhishek Kumar Department of Computer Science University of Technology and ManagementRead MoreThe Big Data Related Activities1487 Words   |  6 PagesThe world is changing with respect to the growth in big data and to the way in which it is used. Growth in big data brings with it many challenges, but it also presents new opportunities. Figure 1, helps understand some of the big data related activities that are taking place in the world with respect to volume of data that is being consumed by these activities over the next 5 years. Fig. 1: Data is predicted to grow to more than 160,000 terabytes in the next 5 years. Apple was Teradata’s â€Å"fastestRead MoreA Study On Big Data1643 Words   |  7 Pages.A STUDY ON BIG DATA ABSTRACTION Big data is a popular term which is used to describe the improvement and availability of data in both structured and unstructured data. Structure data is located in a fixed field within a record or file and the data is contained in relation data base and spreadsheet. Unstructured data files include text and multimedia. Data Big data describes extreme volume of data sets with sizes. Big data is defined with three v dimensions namely volume, velocity and variety, andRead MoreImpact Of Big Data On Businesses1298 Words   |  6 Pages The impact of big data to businesses CIS 5681 Research Project Big Data Solution for Businesses Summer 2015 06/24/2015 Sai Kireety Kokkiligadda Sxk77140@ucmo.edu â€Æ' Abstract Big data is buzzword in every field of business as well as research. Organizations have found its application across various sectors from Sports to Security, from Healthcare to e-Commerce. Information when rightly put in use can cease the market. For instance, with the rise of smart phone purchases, transactions throughRead MoreComputer Science And The Big Data Management Essay1492 Words   |  6 Pages Abstract— The Data which is structured and unstructured and is so large with massive volume that it is not possible by traditional database system to process this data is termed as Big Data. The governance, organization and administration of the big data is known as Big Data Management. For reporting and analysis purposes we use data warehouse techniques to process data. These are the central repositories from disparate data sources. Now Big Data Management also requires the data warehousing techniquesRead MoreAnalytics In Oil And Gas Essay1068 Words   |  5 Pagesthe use of digital data kicks in the form of Big Data and Analytics helping to collect and analyze vast amount of data which are obtained during the upstream of oil and gas in the field. By this modern digitization of data collection, the oil and gas industries has by far managed to process the resource without any obstruction and it also helps in predictive analysis in future for when and where to dig the well. Bi g Data and Analytics are used to deal with huge amount of data from the field to makeRead MoreData Warehousing : Big Data Management Essay1673 Words   |  7 Pages Abstract— The Data which is structured and unstructured and is so large with massive volume that it is not possible by traditional database system to process this data is termed as Big Data. The governance, organization and administration of the big data is known as Big Data Management. For reporting and analysis purposes we use data warehouse techniques to process data. These are the central repositories from disparate data sources. Now Big Data Management also requires the data warehousing techniquesRead MoreBig Data And Analytics Essay860 Words   |  4 PagesIntroduction: Big data and Analytics have become very prominent areas of study in recent years. Company revenues exceeding more than one million are found to use some or the other form of business analytics. The techniques, technologies, systems, practices, methodologies and applications help analyze the data in the organizations to make critical decisions. Evolution: Big data and big data analytics are used to describe data sets and analytical techniques in applications that are so large and complexRead MoreChallenges Faced With Big Data1731 Words   |  7 PagesCHALLENGES WITH BIG DATA Already some success is achieved from big data in some fields like Sloan digital sky survey so it’s mean there is some potential in big data and benefits are also real but still some challenges like scalability, heterogeneity, integration, privacy, security etc. need to be addressed for realizing full potential of big data. One of the major challenge is transformation of unstructured data to structured form for accurate and timely processing. Challenges with big data starts with