The Data Big Bang and the Expanding Digital Universe: High-Dimensional, Complex and Massive Data Sets in an Inflationary Epoch - Astrophysics > Instrumentation and Methods for AstrophysicsReport as inadecuate




The Data Big Bang and the Expanding Digital Universe: High-Dimensional, Complex and Massive Data Sets in an Inflationary Epoch - Astrophysics > Instrumentation and Methods for Astrophysics - Download this document for free, or read online. Document in PDF available to download.

Abstract: Recent and forthcoming advances in instrumentation, and giant new surveys,are creating astronomical data sets that are not amenable to the methods ofanalysis familiar to astronomers. Traditional methods are often inadequate notmerely because of the size in bytes of the data sets, but also because of thecomplexity of modern data sets. Mathematical limitations of familiar algorithmsand techniques in dealing with such data sets create a critical need for newparadigms for the representation, analysis and scientific visualization asopposed to illustrative visualization of heterogeneous, multiresolution dataacross application domains. Some of the problems presented by the new data setshave been addressed by other disciplines such as applied mathematics,statistics and machine learning and have been utilized by other sciences suchas space-based geosciences. Unfortunately, valuable results pertaining to theseproblems are mostly to be found only in publications outside of astronomy. Herewe offer brief overviews of a number of concepts, techniques and developments,some -old- and some new. These are generally unknown to most of theastronomical community, but are vital to the analysis and visualization ofcomplex datasets and images. In order for astronomers to take advantage of therichness and complexity of the new era of data, and to be able to identify,adopt, and apply new solutions, the astronomical community needs a certaindegree of awareness and understanding of the new concepts. One of the goals ofthis paper is to help bridge the gap between applied mathematics, artificialintelligence and computer science on the one side and astronomy on the other.



Author: Meyer Z. Pesenson 1, Isaac Z. Pesenson 2, Bruce McCollum 1 1 California Institute of Technology, 2 Temple University

Source: https://arxiv.org/







Related documents