Likelihood

Empirical likelihood provides inferences whose validity does not depend on specifying a parametric model for the data. Because it uses a likelihood, the method has certain inherent advantages over resampling methods: it uses the data to determine the shape of the confidence regions, and it makes it easy to combined data from multiple sources. It al

This book takes a fresh look at the popular and well-established method of maximum likelihood for statistical estimation and inference. It begins with an intuitive introduction to the concepts and background of likelihood, and moves through to the latest developments in maximum likelihood methodology, including general latent variable models and new material for the practical implementation of integrated likelihood using the free ADMB software. Fundamental issues of statistical inference are also examined, with a presentation of some of the philosophical debates underlying the choice of statistical paradigm. Key features: Provides an accessible introduction to pragmatic maximum likelihood modelling. Covers more advanced topics, including general forms of latent variable models (including non-linear and non-normal mixed-effects and state-space models) and the use of maximum likelihood variants, such as estimating equations, conditional likelihood, restricted likelihood and integrated likelihood. Adopts a practical approach, with a focus on providing the relevant tools required by researchers and practitioners who collect and analyze real data. Presents numerous examples and case studies across a wide range of applications including medicine, biology and ecology. Features applications from a range of disciplines, with implementation in R, SAS and/or ADMB. Provides all program code and software extensions on a supporting website. Confines supporting theory to the final chapters to maintain a readable and pragmatic focus of the preceding chapters. This book is not just an accessible and practical text about maximum likelihood, it is a comprehensive guide to modern maximum likelihood estimation and inference. It will be of interest to readers of all levels, from novice to expert. It will be of great benefit to researchers, and to students of statistics from senior undergraduate to graduate level. For use as a course text, exercises are provided at the end of each chapter.

This is a short introduction to Maximum Likelihood (ML) Estimation. It provides a general modeling framework that utilizes the tools of ML methods to outline a flexible modeling strategy that accommodates cases from the simplest linear models (such as the normal error regression model) to the most complex nonlinear models linking endogenous and exogenous variables with non-normal distributions. Using examples to illustrate the techniques of finding ML estimators and estimates, the author discusses what properties are desirable in an estimator, basic techniques for finding maximum likelihood solutions, the general form of the covariance matrix for ML estimates, the sampling distribution of ML estimators; the use of ML in the normal as well as other distributions, and some useful illustrations of likelihoods.

Based on a course in the theory of statistics this text concentrates on what can be achieved using the likelihood/Fisherian method of taking account of uncertainty when studying a statistical problem. It takes the concept ot the likelihood as providing the best methods for unifying the demands of statistical modelling and the theory of inference. Every likelihood concept is illustrated by realistic examples, which are not compromised by computational problems. Examples range from a simile comparison of two accident rates, to complex studies that require generalised linear or semiparametric modelling. The emphasis is that the likelihood is not simply a device to produce an estimate, but an important tool for modelling. The book generally takes an informal approach, where most important results are established using heuristic arguments and motivated with realistic examples. With the currently available computing power, examples are not contrived to allow a closed analytical solution, and the book can concentrate on the statistical aspects of the data modelling. In addition to classical likelihood theory, the book covers many modern topics such as generalized linear models and mixed models, non parametric smoothing, robustness, the EM algorithm and empirical likelihood.

The Likelihood plays a key role in both introducing general notions of statistical theory, and in developing specific methods. This book introduces likelihood-based statistical theory and related methods from a classical viewpoint, and demonstrates how the main body of currently used statistical techniques can be generated from a few key concepts, in particular the likelihood. Focusing on those methods, which have both a solid theoretical background and practical relevance, the author gives formal justification of the methods used and provides numerical examples with real data.

Written by the creators of Stata's likelihood maximization features, Maximum Likelihood Estimation with Stata, Third Edition continues the pioneering work of the previous editions. Emphasizing practical implications for applied work, the first chapter provides an overview of maximum likelihood estimation theory and numerical optimization methods. With step-by-step instructions, the next several chapters detail the use of Stata to maximize user-written likelihood functions. Various examples include logit, probit, linear, Weibull, and random-effects linear regression as well as the Cox proportional hazards model. The final chapters describe how to add a new estimation command to Stata. Assuming a familiarity with Stata, this reference is ideal for researchers who need to maximize their own likelihood functions. New ml commands and their functions: constraint: fits a model with linear constraints on the coefficient by defining your constraints; accepts a constraint matrix ml model: picks up survey characteristics; accepts the subpop option for analyzing survey data optimization algorithms: Berndt-Hall-Hall-Hausman (BHHH), Davidon-Fletcher-Powell (DFP), Broyden-Fletcher-Goldfarb-Shanno (BFGS) ml: switches between optimization algorithms; computes variance estimates using the outer product of gradients (OPG)

This book deals with parametric and nonparametric density estimation from the maximum (penalized) likelihood point of view, including estimation under constraints. The focal points are existence and uniqueness of the estimators, almost sure convergence rates for the L1 error, and data-driven smoothing parameter selection methods, including their practical performance. The reader will gain insight into technical tools from probability theory and applied mathematics.

This book contains the lecture notes for a DMV course presented by the authors at Gunzburg, Germany, in September, 1990. In the course we sketched the theory of information bounds for non parametric and semiparametric models, and developed the theory of non parametric maximum likelihood estimation in several particular inverse problems: interval censoring and deconvolution models. Part I, based on Jon Wellner's lectures, gives a brief sketch of information lower bound theory: Hajek's convolution theorem and extensions, useful minimax bounds for parametric problems due to Ibragimov and Has'minskii, and a recent result characterizing differentiable functionals due to van der Vaart (1991). The differentiability theorem is illustrated with the examples of interval censoring and deconvolution (which are pursued from the estimation perspective in part II). The differentiability theorem gives a way of clearly distinguishing situations in which 1 2 the parameter of interest can be estimated at rate n / and situations in which this is not the case. However it says nothing about which rates to expect when the functional is not differentiable. Even the casual reader will notice that several models are introduced, but not pursued in any detail; many problems remain. Part II, based on Piet Groeneboom's lectures, focuses on non parametric maximum likelihood estimates (NPMLE's) for certain inverse problems. The first chapter deals with the interval censoring problem.

Dr Edwards' stimulating and provocative book advances the thesis that the appropriate axiomatic basis for inductive inference is not that of probability, with its addition axiom, but rather likelihood - the concept introduced by Fisher as a measure of relative support amongst different hypotheses. Starting from the simplest considerations and assuming no more than a modest acquaintance with probability theory, the author sets out to reconstruct nothing less than a consistent theory of statistical inference in science.