Health Care and Precision Medicine Research: Analysis of a Scalable Data Science Platform
Open Access
- 9 April 2019
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 21 (4), e13043
- https://doi.org/10.2196/13043
Abstract
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Healthcare data is increasing in volume and complexity. Storing and analyzing this data to implement precision medicine initiatives and data driven research has exceeded the capabilities of traditional computer systems. Modern big data platforms must be adapted to the specific demands of healthcare and designed for scalability and growth. Objective: To (1) demonstrate the implementation of a data science platform built on open-source technology within a large, academic healthcare system and (2) describe two computational healthcare applications built on such a platform. Methods: A data science platform based on several open source technologies was deployed to support real-time, big data workloads. Data acquisition workflows for Apache Storm and NiFi were developed in Java and Python to capture patient monitoring and laboratory data for downstream analytics. Results: The use of emerging data management approaches along with open-source technologies such as Hadoop can be used to create integrated data lakes to store large, real-time data sets. This infrastructure also provides a robust analytics platform where healthcare and biomedical research data can be analyzed in near real-time for precision medicine and computational healthcare use cases. Conclusions: The implementation and use of integrated data science platforms offer organizations the opportunity to combine traditional data sets, including data from the electronic health record, with emerging big data sources, such as continuous patient monitoring and real-time laboratory results. These platforms can enable cost-effective and scalable analytics for the information that will be key to the delivery of precision medicine initiatives. Organizations that can take advantage of the technical advances found in data science platforms will have the opportunity to provide comprehensive access to healthcare data for computational healthcare and precision medicine research.Keywords
Other Versions
This publication has 15 references indexed in Scilit:
- The problem with Big Data in Translational Medicine. A review of where we've been and the possibilities ahead.Applied & Translational Genomics, 2015
- Precision Medicine — Personalized, Problematic, and PromisingNew England Journal of Medicine, 2015
- Managing data lakes in big data era: What's a data lake and why has it became popular in data management ecosystemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- A New Initiative on Precision MedicineNew England Journal of Medicine, 2015
- Security Issues Associated with Big Data in Cloud ComputingInternational journal of Network Security & Its Applications, 2014
- Big data analytics for healthcarePublished by Association for Computing Machinery (ACM) ,2013
- Addressing big data problem using Hadoop and Map ReducePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Network physiology reveals relations between network topology and physiological functionNature Communications, 2012
- MapReduceCommunications of the ACM, 2008
- DryadPublished by Association for Computing Machinery (ACM) ,2007