Reconstructability Analysis, Information Theory, Probabilistic graphical modeling, Multivariate analysis discrete multivariate modeling, Data mining
This paper integrates the structures considered in Reconstructability Analysis (RA) and those considered in Bayesian Networks (BN) into a joint lattice of probabilistic graphical models. This integration and associated lattice visualizations are done in this paper for four variables, but the approach can easily be expanded to more variables. The work builds on the RA work of Klir (1985), Krippendorff (1986), and Zwick (2001), and the BN work of Pearl (1985, 1987, 1988, 2000), Verma (1990), Heckerman (1994), Chickering (1995), Andersson (1997), and others. The RA four variable lattice and the BN four variable lattice partially overlap: there are ten unique RA general graphs, ten unique BN general graphs, and ten general graphs common to both RA and BN. For example, the specific graph having probability distribution p(A)p(C)p(B|AC) is unique to BN, the RA specific graph AB:AC:BC, which contains a loop, is unique to RA, and the specific graph ACD:BCD with probability distribution p(A|CD)p(B|CD)p(D|C)p(C) is common to both RA and BN. The joint RA-BN lattice of general graphs presented in this paper expands the set of general graphs with unique independence structures beyond what was previously available by either RA alone or BN alone, thus allowing for representations of complex systems which are (i) more accurate relative to data and/or (ii) simpler and thus more comprehensible and more generalizable than would be possible by modeling only with RA or only with BN.
Harris, Marcus and Zwick, Martin (2020). “Joint Lattice of Reconstructability Analysis and Bayesian Network General Graphs.” International Conference on Complex Systems (New England Complex Systems Institute), On-line. July 29.