Author of the publication

A Maximum Entropy Approach to Recovering Information From Multinomial Response Data

, , and . Journal of the American Statistical Association, 91 (434): 841--853 (June 1996)The classical maximum entropy (ME) approach to estimating the unknown parameters of a multinomial discrete choice problem, which is equivalent to the maximum likelihood multinomial logit (ML) estimator, is generalized. The generalized maximum entropy (GME) model includes noise terms in the multinomial information constraints. Each noise term is modeled as the mean of a finite set of a priori known points in the interval -1, 1 with unknown probabilities where no parametric assumptions about the error distribution are made. A GME model for the multinomial probabilities and for the distributions associated with the noise terms is derived by maximizing the joint entropy of multinomial and noise distributions, under the assumption of independence. The GME formulation reduces to the ME in the limit as the sample grows large or when no noise is included in the entropy maximization. Further, even though the GME and the logit estimators are conceptually different, the dual GME model is related to a generalized class of logit models. In finite samples, modeling the noise terms along with the multinomial probabilities results in a gain of efficiency of the GME over the ME and ML. In addition to analytical results, some extensions, sampling experiments, and an example based on real-world data are presented..

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

The extended Stein procedure for simultaneous model selection and parameter estimation, , , and . Journal of Econometrics, 35 (2-3): 375--391 (July 1987)Estimation and inference with censored and ordered multinomial response data, , and . Journal of Econometrics, 79 (1): 23--51 (July 1997)A Maximum Entropy Approach to Recovering Information From Multinomial Response Data, , and . Journal of the American Statistical Association, 91 (434): 841--853 (June 1996)The classical maximum entropy (ME) approach to estimating the unknown parameters of a multinomial discrete choice problem, which is equivalent to the maximum likelihood multinomial logit (ML) estimator, is generalized. The generalized maximum entropy (GME) model includes noise terms in the multinomial information constraints. Each noise term is modeled as the mean of a finite set of a priori known points in the interval -1, 1 with unknown probabilities where no parametric assumptions about the error distribution are made. A GME model for the multinomial probabilities and for the distributions associated with the noise terms is derived by maximizing the joint entropy of multinomial and noise distributions, under the assumption of independence. The GME formulation reduces to the ME in the limit as the sample grows large or when no noise is included in the entropy maximization. Further, even though the GME and the logit estimators are conceptually different, the dual GME model is related to a generalized class of logit models. In finite samples, modeling the noise terms along with the multinomial probabilities results in a gain of efficiency of the GME over the ME and ML. In addition to analytical results, some extensions, sampling experiments, and an example based on real-world data are presented..A maximum entropy approach to estimation and inference in dynamic models or Counting fish in the sea using maximum entropy, , and . Journal of Economic Dynamics and Control, 20 (4): 559--582 (April 1996)Implications of the Cressie-Read Family of Additive Divergences for Information Recovery., and . Entropy, 14 (12): 2427-2438 (2012)Entropy: The Markov Ordering Approach., , and . Entropy, 12 (5): 1145-1193 (2010)On Extracting Probability Distribution Information from Time Series., , , and . Entropy, 14 (10): 1829-1841 (2012)Maximum entropy econometrics, , and . Series in financial economics and quantitative analysis Wiley, Chichester u.a., Repr edition, (1996)Generalized moment based estimation and inference, , and . Journal of Econometrics, 107 (1-2): 127--148 (March 2002)Applied multivariate analysis : S. James Press, (Holt, Rinehart and Winston, New York, 1972) xix+521 pp.. Journal of Econometrics, 3 (3): 320--318 (August 1975)