Broomhead, D. S. and Sidorov, Nikita (2004) Mutual information and capacity of a linear digital channel. Nonlinearity, 17 (6). pp. 2203-2223. ISSN 1361-6544
![[thumbnail of 2004Nonlinearity17.pdf]](https://eprints.maths.manchester.ac.uk/style/images/fileicons/application_pdf.png) |
PDF
2004Nonlinearity17.pdf Download (301kB) |
Abstract
In this paper we analyse a simple model of a digital communications channel. This model proves to be closely related to an iterated function system (IFS) related to the well-known Bernoulli convolution. We derive it from a randomly forced first-order ordinary differential equation. This allows the parameter of the Bernoulli convolution—the contraction rate, λ—to be related to the rate at which symbols are input to the channel. It is shown that for a channel with equiprobable binary inputs the mutual information between input and output distributions is the stationary measure of the complement of the overlap region of the IFS. We show that the mutual information is Hölder continuous with respect to λ and decreases hyper-exponentially as λ → 1. We also study the case of non-equiprobable binary inputs and show that the maximum of the mutual information—the channel capacity—does not always correspond to equiprobable inputs.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Digital channel, capacity, IFS, Bernoulli convolution |
| Subjects: | MSC 2010, the AMS's Mathematics Subject Classification > 60 Probability theory and stochastic processes MSC 2010, the AMS's Mathematics Subject Classification > 68 Computer science MSC 2010, the AMS's Mathematics Subject Classification > 94 Information and communication, circuits |
| Depositing User: | Dr Mark Muldoon |
| Date Deposited: | 02 Mar 2006 |
| Last Modified: | 20 Oct 2017 14:12 |
| URI: | https://eprints.maths.manchester.ac.uk/id/eprint/166 |
Actions (login required)
 |
View Item |