RESUMEN
Pairwise likelihood is a limited-information method widely used to estimate latent variable models, including factor analysis of categorical data. It can often avoid evaluating high-dimensional integrals and, thus, is computationally more efficient than relying on the full likelihood. Despite its computational advantage, the pairwise likelihood approach can still be demanding for large-scale problems that involve many observed variables. We tackle this challenge by employing an approximation of the pairwise likelihood estimator, which is derived from an optimization procedure relying on stochastic gradients. The stochastic gradients are constructed by subsampling the pairwise log-likelihood contributions, for which the subsampling scheme controls the per-iteration computational complexity. The stochastic estimator is shown to be asymptotically equivalent to the pairwise likelihood one. However, finite-sample performance can be improved by compounding the sampling variability of the data with the uncertainty introduced by the subsampling scheme. We demonstrate the performance of the proposed method using simulation studies and two real data applications.
RESUMEN
The three-parameter logistic model is widely used to model the responses to a proficiency test when the examinees can guess the correct response, as is the case for multiple-choice items. However, the weak identifiability of the parameters of the model results in large variability of the estimates and in convergence difficulties in the numerical maximization of the likelihood function. To overcome these issues, in this paper we explore various shrinkage estimation methods, following two main approaches. First, a ridge-type penalty on the guessing parameters is introduced in the likelihood function. The tuning parameter is then selected through various approaches: cross-validation, information criteria or using an empirical Bayes method. The second approach explored is based on the methodology developed to reduce the bias of the maximum likelihood estimator through an adjusted score equation. The performance of the methods is investigated through simulation studies and a real data example.
Asunto(s)
Modelos Logísticos , Teorema de Bayes , Sesgo , Simulación por Computador , Funciones de VerosimilitudRESUMEN
We introduce a novel class of factor analysis methodologies for the joint analysis of multiple studies. The goal is to separately identify and estimate (1) common factors shared across multiple studies, and (2) study-specific factors. We develop an Expectation Conditional-Maximization algorithm for parameter estimates and we provide a procedure for choosing the numbers of common and specific factors. We present simulations for evaluating the performance of the method and we illustrate it by applying it to gene expression data in ovarian cancer. In both, we clarify the benefits of a joint analysis compared to the standard factor analysis. We have provided a tool to accelerate the pace at which we can combine unsupervised analysis across multiple studies, and understand the cross-study reproducibility of signal in multivariate data. An R package (MSFA), is implemented and is available on GitHub.
Asunto(s)
Algoritmos , Análisis Factorial , Simulación por Computador , Femenino , Expresión Génica , Humanos , Sistema Inmunológico , Neoplasias Ováricas/genética , Neoplasias Ováricas/inmunología , Reproducibilidad de los ResultadosRESUMEN
Stratified data arise in several settings, such as longitudinal studies or multicenter clinical trials. Between-strata heterogeneity is usually addressed by random effects models, but an alternative approach is given by fixed effects models, which treat the incidental nuisance parameters as fixed unknown quantities. This approach presents several advantages, like computational simplicity and robustness to confounding by strata. However, maximum likelihood estimates of the parameter of interest are typically affected by incidental parameter bias. A remedy to this is given by the elimination of stratum-specific parameters by exact or approximate conditioning. The latter solution is afforded by the modified profile likelihood, which is the method applied in this paper. The aim is to demonstrate how the theory of modified profile likelihoods provides convenient solutions to various inferential problems in this setting. Specific procedures are available for different kinds of response variables, and they are useful both for inferential purposes and as a diagnostic method for validating random effects models. Some examples with real data illustrate these points.