Questions tagged [model-comparison]
Comparing two or more models fit to a common data set. It can be part of the process of "model selection".
609
questions
1
vote
0
answers
20
views
Comparing GLMM with LMM with -2*log-likelihood
Is it possible/recommended to compare the -2*Log-Likelihood (-2LL) value of a Generalized Linear Mixed Model (GLMM) against the -2LL value (and/or AIC/AICC/BIC) of a Linear Mixed Model (LMM) with the ...
- 115
6
votes
1
answer
206
views
Model comparison for nested regression models that are not symbolically nested
Say I have two nested models and I want to compare them, but they are parameterized differently so that no simple constraint (i.e., setting coefficients to 0) on the larger model corresponds exactly ...
- 35.4k
0
votes
0
answers
31
views
Bayesian: Formally comparing prior and posterior distributions
Consider Bayesian inference in the regression model:
$$ \begin{align*} y &= \beta_0+\beta_1x_1+\beta_2x_2 + \varepsilon \\ \varepsilon &\sim
\mathcal{N}(0,\sigma^2) \end{align*}$$
Suppose we ...
- 368
0
votes
0
answers
24
views
Confused about the results of a mixed effect model
I have a dataset of two continuous muscle activity levels A and B. I hypothesized that B is linearly correlated to A which is confirmed by a simple correlation test. And I have two categorical factors:...
- 1
4
votes
2
answers
184
views
Compare estimates between non-nested mixed-effects models
I have two mixed-effect linear regression models, both fit on the same same data and same outcome, but with slightly different predictors. Is there a way to compare (i.e., generate a p-value for the ...
- 1,754
0
votes
0
answers
36
views
Comparing Models with Unequal Sample Sizes
I have performed an association analysis where I have associatiated several different perdictor variables to a dependent variable. For each predictor, I run two models and compare them via the ...
- 75
0
votes
1
answer
32
views
ML V REML for Hypothesis Testing
I am curious about doing hypothesis testing with REML values via a likelihood ratio test, or whatever test would make sense for REML values, but these two highly upvoted answers to existing cross ...
- 405
2
votes
2
answers
200
views
How to compare two PMF generating functions?
I have two functions $f$ and $g$ that map an input vector $x_i$ to a probability mass function.
For example:
$$
x_i = [0,1,2] \\\\
f(x_i) \rightarrow [0.1, 0.3, 0.2, 0.2, 0.2] \\\\
g(x_i) \...
- 21
1
vote
0
answers
25
views
Calculate weight for GLM-quasi poisson model
I am running several models with the quasi-Poisson family. I am looking at data from vulture restaurants. Vulture count was modelled at each site as a function of either a linear or quadratic effect ...
- 11
0
votes
0
answers
39
views
Likelihood ratios not distributed as a chi2 distribution with the correct dof (Wilks' theorem)
I perform Bayesian inference on a mixture model such that $\mu$ is the mixture weight for a feature in the mixture
$p(x | \mu, \theta) = \mu p_{f}(x|\theta) + (1-\mu)p_{nf}(x|\theta)$
I have prior $p(\...
4
votes
1
answer
57
views
Measurement invariance and latent mean comparison between 3 groups
I performed an Exploratory Factor Analysis (EFA) followed by a Confirmatory Factor Analysis (CFA) in R, successfully assessing the model fit using indices such as TLI, CFI, RMSEA for a two-factor ...
- 43
0
votes
0
answers
30
views
Testing difference between two models using WAIC and degrees of freedom of WAIC
I am conducting Bayesian penalised regression, horseshoe specifically, in R using the bayesreg package see here. One model is nested within the other, i.e. to the second model I have simply used all ...
- 2,053
1
vote
0
answers
21
views
GAMLSS - How to adjust AIC for log-transformation of variables [duplicate]
I have one GAMLSS model in which the independent and dependent variable are on the natural scale, and a second model in which both variables have been log-transformed. How do I adjust the AIC of the ...
- 333
0
votes
0
answers
34
views
Comparison of two different models with different variables
How to compare two models at two levels? For example, I want to model crime events at two levels (streets and census tracts). The models are logistic regression for the streets (occurrence of crime) ...
- 43
0
votes
0
answers
13
views
Interpretation Comparison Bayesian Models with Leave-One-Out Cross Validation
I'm currently working on comparing two Bayesian linear models using the brms package in R, with a dataset of 400 participants. The models differ in that one ...
- 21