Liu, W., Chu, X. and Zhang, J. (2015) On a generalised typicality with respect to general probability distributions. In: 2015 IEEE 14th Canadian Workshop on Information Theory (CWIT). 2015 IEEE 14th Canadian Workshop on Information Theory (CWIT), 06-09 Jul 2015, St. John's, NL. IEEE , pp. 165-169.
Abstract
The method of typical sequences is a fundamental tool in asymptotic analyses of information theory. The conditional typicality lemma is one of the most commonly used lemmas in the method of typical sequences. Recent works have generalised the definition of typicality to general alphabets or general probability distributions. However, there is still a lack of the conditional typicality lemma based on the definition of typicality with respect to general distributions on the product space. In this paper, we propose a generalised joint typicality for general alphabets and with respect to general probability distributions, and obtain the counterpart of conventional conditional and joint typicality lemmas based on the generalised typicality. As applications of the typicality lemmas, we prove the packing and coverings for the proposed generalised typicality, and then recover the direct part of the capacity theorem on the general Gelfand-Pinsker coding. We also prove a mutual covering lemma for the generalised typicality, and then obtain the Marton-type inner bound to the capacity region of the general broadcast channel.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Electronic and Electrical Engineering (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 29 Jan 2016 15:42 |
Last Modified: | 19 Dec 2022 13:32 |
Published Version: | http://dx.doi.org/10.1109/CWIT.2015.7255177 |
Status: | Published |
Publisher: | IEEE |
Refereed: | Yes |
Identification Number: | 10.1109/CWIT.2015.7255177 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:90960 |