Systems Science Friday Noon Seminar Series
Loading...
Date
3-4-2016
Abstract
Scientific datasets associated with a research project can proliferate over time as a result of activities such as sharing datasets among collaborators, extending existing ones with new measurements, and extracting subsets of data for analysis. As such datasets begin to accumulate, it becomes increasingly difficult for a scientist to keep track of their derivation history, which complicates data sharing, provenance tracking, and scientific reproducibility. Understanding what relationships exist between datasets can help scientists recall their original derivation history. For instance, if dataset A is contained in dataset B, then the connection between A and B could be that A was extended to create B. In our initial work, we developed a set of relevant relationships, proposed the relationship-identification methodology for testing relationships between pairs of datasets, developed a set of algorithms for efficient discovery of these relationships, and organized these algorithms into a new system called ReConnect to assist scientists in relationship discovery. We evaluated existing alternative approaches that rely on flagging differences between two spreadsheets and found that they were impractical for many relationship-discovery tasks. Additionally, a user study showed that ReConnect can improve scientists' ability to detect useful relationships between datasets. While ReConnect helps with identifying relationships between two datasets, it is infeasible for scientists to use it for determining relationships between all possible pairs in a large collection. In this talk, we introduce an end-to-end prototype system, ReDiscover, that identifies, from a collection of datasets, the pairs that are most likely related. Our preliminarily evaluation shows that ReDiscover can predict selected relationships with high precision and within reasonable computational cost.
Biographical Information
David Maier is Maseeh Professor of Emerging Technologies at Portland State University. Prior to his current position, he was on the faculty at SUNY Stony Brook and Oregon Graduate Institute. He has spent extended visits with INRIA, University of Wisconsin at Madison, Microsoft Research and National University of Singapore. He is the author of books on relational databases, logic programming and object-oriented databases, as well as many papers in database theory, object-oriented technology, scientific databases and data-stream processing. He received the Presidential Young Investigator Award from the National Science Foundation in 1984 and was awarded the 1997 SIGMOD Innovations Award for his contributions in objects and databases. He is also an ACM Fellow and IEEE Senior Member and serves on the Board on Mathematical Sciences and Their Applications at The National Academies. He holds a dual B.A. in Mathematics and in Computer Science from the University of Oregon (Honors Col lege, 1974) and a Ph.D. in Electrical Engineering and Computer Science from Princeton University (1978).
Subjects
Science -- Data processing, Database management, Data sets -- Management, Big data, Data mining -- Algorithms
Disciplines
Databases and Information Systems | Data Science
Persistent Identifier
https://archives.pdx.edu/ds/psu/33979
Rights
© Copyright the author(s)
IN COPYRIGHT:
http://rightsstatements.org/vocab/InC/1.0/
This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s).
DISCLAIMER:
The purpose of this statement is to help the public understand how this Item may be used. When there is a (non-standard) License or contract that governs re-use of the associated Item, this statement only summarizes the effects of some of its terms. It is not a License, and should not be used to license your Work. To license your own Work, use a License offered at https://creativecommons.org/
Recommended Citation
Maier, David, "Helping Scientists Connect Their Datasets" (2016). Systems Science Friday Noon Seminar Series. 95.
https://archives.pdx.edu/ds/psu/33979