Feldman, David P., McTague, Carl S., Crutchfield, James P.
Intrinsic computation refers to how dynamical systems store, structure, and transform historical and spatial information. By graphing a measure of structural complexity against a measure of...
David Feldman, David P. Feldman
• Complexity is generally understood to be a measure of the difficulty of describing a thing or a process. • There are many different contexts in which the term complexity is used: – Complexity...
Structural Information in Two-Dimensional Patterns: Entropy Convergence and Excess Entropy (2002)
Feldman, David P., Crutchfield, James P.
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and...
Feldman, David P., Crutchfield, James P.
We analyze how difficult it is to synchronize to a periodic sequence whose structure is known, when an observer is initially unaware of the sequence's phase. We examine the transient information T, a...
Synchronizing to the Environment: Information Theoretic Constraints on Agent Learning (2001)
Crutchfield, James P., Feldman, David P.
We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and...
Regularities Unseen, Randomness Observed: Levels of Entropy Convergence (2001)
Crutchfield, James P., Feldman, David P.
We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information...
Comment on "Simple Measure of Complexity" (1999)
Crutchfield, James P., Feldman, David P., Shalizi, Cosma Rohilla
We critique the measure of complexity introduced by Shiner, Davison, and Landsberg in Ref. [1]. In particular, we point out that it is over-universal, in the sense that it has the same dependence on...
Statistical Measures of Complexity: Why? (1997)
Feldman, David P., Crutchfield, James P.
We review several statistical complexity measures proposed over the last decade and a half as general indicators of structure or correlation. Recently, Lopez-Ruiz, Mancini, and Calbet [Phys. Lett. A...
Statistical Complexity of Simple 1D Spin Systems (1997)
Crutchfield, James P., Feldman, David P.
We present exact results for two complementary measures of spatial structure generated by 1D spin systems with finite-range interactions. The first, excess entropy, measures the apparent spatial...
Synchronizing to the Environment: Information Theoretic Constraints on Agent Learning
James P. Crutchfield, David P. Feldman
We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and...
Regularities Unseen, Randomness Observed: Levels of Entropy Convergence
James P. Crutchfield, David P. Feldman
We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information...
Comments on ``Simple Measure for Complexity''
James P. Crutchfield, David P. Feldman, Cosma Rohilla Shalizi
We critique the measure of complexity introduced by Shiner, Davison, and Landsberg in Ref. [1]. In particular, we point out that it is over-universal, in the sense that it has the same dependence on...
David P. Feldman, James P. Crutchfield
We compare and contrast three different, but complementary views of "structure" and "pattern" in spatial processes. For definiteness and analytical clarity we apply all three approaches to the...
Measures of Statistical Complexity: Why?
David P. Feldman, James P. Crutchfield
We review several statistical complexity measures proposed over the last decade and a half as general indicators of structure or correlation. Recently, L\`opez-Ruiz, Mancini, and Calbet [Phys. Lett....
SYNCHRONIZING TO THE ENVIRONMENT: INFORMATION-THEORETIC CONSTRAINTS ON AGENT LEARNING
JAMES P. CRUTCHFIELD, DAVID P. FELDMAN
Using an information-theoretic framework, we examine how an intelligent agent, given an accurate model of its environment, synchronizes to the environment â i.e., comes to know in which state the...
DAVID P. FELDMAN, JAMES P. CRUTCHFIELD
We analyze how difficult it is to synchronize to a periodic sequence whose structure is known, when an observer is initially unaware of the sequence's phase. We examine the transient information T, a...
Statistical Complexity of Simple 1D Spin Systems
James P. Crutchfield, David P. Feldman
We present exact results for two complementary measures of spatial structure generated by 1D spin systems with finite-range interactions. The first, excess entropy, measures the apparent spatial...