Corporate Banner
Satellite Banner
LIMS & ELNs
Scientific Community
 
Become a Member | Sign in
Home>News>This Article
  News
Return

What's the Big Deal about Big Data?

Published: Monday, September 17, 2012
Last Updated: Monday, September 17, 2012
Bookmark and Share
The data-intensive nature of scientific research is currently driving the emergence of big data solutions that can gather, analyze, and transport extremely large volumes of data among multiple locations worldwide.

Wikipedia defines big data as "a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools. The challenges include capture, storage, search, sharing, analysis, and visualization".

Laboratories have been dealing with large amounts of data for decades, with the volume increasing dramatically every year and the trend now being toward larger data sets.  The problem has long been how to manage and mine that data for relevant information.  In the current data-intensive environment, the difficulty executing data management tasks has increased exponentially.

What's interesting is how big data is changing the nature of data management in the lab.  Relational databases and desktop statistics and visualization packages that have been so effective previously are not up to the task.  Instead, big data utilizes massively parallel software running on a large number of servers, typically more than any one business can afford.

One such solution is an open-source NoSQL database that is designed for massive amount of data delivery over web and cloud applications. NoSQL databases do not use tables and thus generally do not use SQL as the query language. What they do use is a distributed, fault-tolerant architecture that manages the data redundantly on multiple servers.

NoSQL databases don't replace databases such as Oracle RDBMS, instead they provide an entirely new way to manage data because they allow applications to collect and analyze massive amounts of information from numerous sources.

Life sciences laboratories are particularly affected by the big data trend.  When it comes to genomics, for instance, petabyte-scale networks are emerging that better support genomic research and emerging clinical requirements.  

There is also growing demand to manage big data using cloud computing platforms, and to move large volumes of next-gen DNA sequencing and research data at high-speed over vast distances.  The challenges of performing these activities into and out of the cloud are being addressed. This area has been led by Genentech, one of the early adopters of big data and cloud computing solutions to support their research.

Perhaps laboratories should have seen this coming since it is the inevitable result of better instrumentation that generates more data faster that then needs better analytical solutions–but hindsight is always 20/20. 


Further Information
Access to this exclusive content is for Technology Networks Premium members only.

Join Technology Networks Premium for free access to:

  • Exclusive articles
  • Presentations from international conferences
  • Over 2,500+ scientific posters on ePosters
  • More than 3,700+ scientific videos on LabTube
  • 35 community eNewsletters


Sign In



Forgotten your details? Click Here
If you are not a member you can join here

*Please note: By logging into TechnologyNetworks.com you agree to accept the use of cookies. To find out more about the cookies we use and how to delete them, see our privacy policy.

Related Content

The Perfect Partnership: Research & Industry; Software & Instrumentation. It really starts to come together at ASMS 2015
Collaboration and knowledge-sharing were evident everywhere: on the bus, in the hallways and in the bars. This article aims to capture this theme and share with you some of the fruits of this coming together of science and industry.
Thursday, June 11, 2015
Pittcon 2015 Informatics Wrap-Up
Technology Continues to Impact the Lab; Pittcon Focuses on Workflows, Integration, Meta Data Management and Accelerating Innovation
Tuesday, April 14, 2015
Every Lab is a Regulated Lab… and that may be Good News!
Response to Editor Helen Gillespie's recent editorial on labs and regulations by Joe Liscouski, Executive Director, Institute for Laboratory Automation
Thursday, July 17, 2014
Every Lab is a Regulated Lab
There’s an interesting misconception in the research arena that “regulated” labs are only those labs that manufacture drugs and must follow Current Good Manufacturing Practices (cGMP) practices because they are required by law to do so. This article explores some of the issues surrounding the lab and regulations.
Monday, May 12, 2014
Pittcon 2014 Informatics Wrap-Up
Applications focus on better, faster, cheaper data management in the lab.
Tuesday, April 15, 2014
Today’s Challenge: Managing Big Data
Now that we have it, what do we do with it? - Editorial by Informatics Editor Helen Gillespie after the Molecular Med Tri-Con 2014 conference in San Francisco, CA.
Tuesday, March 18, 2014
A Look Back at LIMS and Informatics 2013
Technology Networks' editor Helen Gillespie reviews the LIMS and Informatics market activity over the previous twelve months.
Tuesday, January 14, 2014
How to Select the Best LIMS for your Lab: Part Two
Whether selecting a new system or replacing a legacy solution, choosing the best informatics solution is never easy. This two-part article examines the steps to take to ensure success.
Friday, December 13, 2013
How to Select the Best LIMS for your Lab: Part One
Whether selecting a new system or replacing a legacy solution, choosing the best informatics solution is never easy. This two-part article examines the steps to take to ensure success.
Monday, November 11, 2013
The Evolving Relationship of LIMS and Mobile Devices
An Interview with Abbott's Clive Baron about the new STARLIMS Version 11 and how it will leverage mobile devices.
Wednesday, May 22, 2013
Pittcon 2013 Informatics Wrap-Up
Helen Gillespie's annual LIMS and Informatics highlights from the recent Pittsburg Conference (Pittcon) in Philadelphia.
Thursday, April 11, 2013
The Impact of Tablet PCs and Social Networking on Lab Informatics
IDBS's Director of Product Strategy Scott Weiss discusses how new technology and social software tools are being used in the lab.
Thursday, March 14, 2013
Pittcon 2013 LIMS & Laboratory Informatics Preview
Visit LIMS and Informatics vendors at Pittcon 2013, and stop by Technology Networks in booth no. 2628
Tuesday, February 12, 2013
2012: The LIMS and Informatics Year in Review
Technology Networks' editor Helen Gillespie reviews the LIMS and Informatics market activity over the previous twelve months.
Friday, December 14, 2012
Four Tips to Ensure LIMS Selection Success
Selecting and implementing LIMS solution is not an easy project; this article provides four tips to navigating obstacles and hurdles on the path to LIMS selection success.
Monday, November 12, 2012
Scientific News
Researchers Construct Atomic Model of an Immature Retrovirus
Using molecular modeling and large-scale molecular dynamic simulation, Beckman researchers have constructed an atomic model of an immature retrovirus.
New Mathematics Advances the Frontier of Macromolecular Imaging
Berkeley Lab’s M-TIP solves the reconstruction problem for fluctuation X-ray scattering.
Exploring Living cells
JPK reports the exploration of living cells using nanoscale and single molecule techniques through the application of scanning probe microscopy.
The Perfect Partnership: Research & Industry; Software & Instrumentation. It really starts to come together at ASMS 2015
Collaboration and knowledge-sharing were evident everywhere: on the bus, in the hallways and in the bars. This article aims to capture this theme and share with you some of the fruits of this coming together of science and industry.
Designing New Pain Relief Drugs
Researchers have identified the molecular interactions that allow capsaicin to activate the body’s primary receptor for sensing heat and pain, paving the way for the design of more selective and effective drugs to relieve pain.
Antibody Pries Loose Bacteria’s Grip
Study finds novel method of improving antibody efficacy.
CLAIRE Brings Electron Microscopy to Soft Materials
CLAIRE works by essentially combining the best attributes of optical and scanning electron microscopy into a single imaging platform.
Sample & Analysis Tracking in Oncogenomic Experiments
The study outlines Onco-STS, a web-based laboratory information management system for sample and analysis tracking in oncogenomic experiments.
Pittcon Announces Wide Variety of Short Courses
Courses range from beginner and intermediate to advanced levels.
Ultra-enriched Silicon Paves the Road to Quantum Computing
Using a relatively straightforward technique, a team of NIST researchers has created what may be the most highly enriched silicon currently being produced.
SELECTBIO

Skyscraper Banner
Go to LabTube
Go to eposters
 
Access to the latest scientific news
Exclusive articles
Upload and share your posters on ePosters
Latest presentations and webinars
View a library of 1,800+ scientific and medical posters
2,500+ scientific and medical posters
A library of 2,500+ scientific videos on LabTube
3,700+ scientific videos
Close
Premium CrownJOIN TECHNOLOGY NETWORKS PREMIUM FREE!