Infinite Excess Entropy Processes with Countable-State Generators
We present two examples of finite-alphabet, infinite excess entropy processes generated by stationary hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. These are the first explicit constructions of processes of this type.
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2014-03-01
|
Series: | Entropy |
Subjects: | |
Online Access: | http://www.mdpi.com/1099-4300/16/3/1396 |
id |
doaj-b1ee960a3c8d413fbacfc3d8d007fa50 |
---|---|
record_format |
Article |
spelling |
doaj-b1ee960a3c8d413fbacfc3d8d007fa502020-11-24T23:58:41ZengMDPI AGEntropy1099-43002014-03-011631396141310.3390/e16031396e16031396Infinite Excess Entropy Processes with Countable-State GeneratorsNicholas F. Travers0James P. Crutchfield1Complexity Sciences Center, University of California at Davis, One Shields Avenue, Davis, CA 95616, USAComplexity Sciences Center, University of California at Davis, One Shields Avenue, Davis, CA 95616, USAWe present two examples of finite-alphabet, infinite excess entropy processes generated by stationary hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. These are the first explicit constructions of processes of this type.http://www.mdpi.com/1099-4300/16/3/1396stationary stochastic processhidden Markov modelepsilon-machineergodicityentropy rateexcess entropymutual information |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Nicholas F. Travers James P. Crutchfield |
spellingShingle |
Nicholas F. Travers James P. Crutchfield Infinite Excess Entropy Processes with Countable-State Generators Entropy stationary stochastic process hidden Markov model epsilon-machine ergodicity entropy rate excess entropy mutual information |
author_facet |
Nicholas F. Travers James P. Crutchfield |
author_sort |
Nicholas F. Travers |
title |
Infinite Excess Entropy Processes with Countable-State Generators |
title_short |
Infinite Excess Entropy Processes with Countable-State Generators |
title_full |
Infinite Excess Entropy Processes with Countable-State Generators |
title_fullStr |
Infinite Excess Entropy Processes with Countable-State Generators |
title_full_unstemmed |
Infinite Excess Entropy Processes with Countable-State Generators |
title_sort |
infinite excess entropy processes with countable-state generators |
publisher |
MDPI AG |
series |
Entropy |
issn |
1099-4300 |
publishDate |
2014-03-01 |
description |
We present two examples of finite-alphabet, infinite excess entropy processes generated by stationary hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. These are the first explicit constructions of processes of this type. |
topic |
stationary stochastic process hidden Markov model epsilon-machine ergodicity entropy rate excess entropy mutual information |
url |
http://www.mdpi.com/1099-4300/16/3/1396 |
work_keys_str_mv |
AT nicholasftravers infiniteexcessentropyprocesseswithcountablestategenerators AT jamespcrutchfield infiniteexcessentropyprocesseswithcountablestategenerators |
_version_ |
1725450294871982080 |