Axiomatic Characterization of A Family of Information Measures That Contains the Directed Divergences
Author | : Rodney W. Johnson |
Publisher | : |
Total Pages | : 29 |
Release | : 1977 |
ISBN-10 | : OCLC:227483965 |
ISBN-13 | : |
Rating | : 4/5 ( Downloads) |
Download or read book Axiomatic Characterization of A Family of Information Measures That Contains the Directed Divergences written by Rodney W. Johnson and published by . This book was released on 1977 with total page 29 pages. Available in PDF, EPUB and Kindle. Book excerpt: Let p and q be probability densities. The directed divergences of p and q are given by the integral p(x) log (p(x)/q(x))dx and by the same expression with p and q interchanged; the divergence is the sum of the directed divergences. These quantities have applications in information theory and to the problem of assigning prior probabilities subject to constraints. In this report, it is shown that the directed divergences and their positive linear combinations, including the divergence, are characterized by axioms of positivity, additivity, and finiteness; in the course of the proof, the latter two are shown to imply yet another axiom; imvariance. These axioms are fundamental in work on prior probabilities. It has been claimed that they characterize only constant multiples of the single directed divergence; that claim is here refuted.