Broomhead, D. S. and Sidorov, Nikita (2004) Mutual information and capacity of a linear digital channel. Nonlinearity, 17 (6). pp. 2203-2223. ISSN 1361-6544

[img] PDF

Download (301kB)


In this paper we analyse a simple model of a digital communications channel. This model proves to be closely related to an iterated function system (IFS) related to the well-known Bernoulli convolution. We derive it from a randomly forced first-order ordinary differential equation. This allows the parameter of the Bernoulli convolution—the contraction rate, λ—to be related to the rate at which symbols are input to the channel. It is shown that for a channel with equiprobable binary inputs the mutual information between input and output distributions is the stationary measure of the complement of the overlap region of the IFS. We show that the mutual information is Hölder continuous with respect to λ and decreases hyper-exponentially as λ → 1. We also study the case of non-equiprobable binary inputs and show that the maximum of the mutual information—the channel capacity—does not always correspond to equiprobable inputs.

Item Type: Article
Uncontrolled Keywords: Digital channel, capacity, IFS, Bernoulli convolution
Subjects: MSC 2010, the AMS's Mathematics Subject Classification > 60 Probability theory and stochastic processes
MSC 2010, the AMS's Mathematics Subject Classification > 68 Computer science
MSC 2010, the AMS's Mathematics Subject Classification > 94 Information and communication, circuits
Depositing User: Dr Mark Muldoon
Date Deposited: 02 Mar 2006
Last Modified: 20 Oct 2017 14:12
MIMS EPrints is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.