Multilevel Modelling of Country Effects: A Cautionary Tale

Article English OPEN
Bryan, M.L. ; Jenkins, S.P. (2016)
  • Publisher: Oxford University Press

Country effects on outcomes for individuals are often analysed using multilevel (hierarchical) models applied to harmonized multi-country data sets such as ESS, EU-SILC, EVS, ISSP, and SHARE. We point out problems with the assessment of country effects that appear not to be widely appreciated, and develop our arguments using Monte Carlo simulation analysis of multilevel linear and logit models. With large sample sizes of individuals within each country but only a small number of countries, analysts can reliably estimate individual-level effects but estimates of parameters summarizing country effects are likely to be unreliable. Multilevel modelling methods are no panacea.
  • References (30)
    30 references, page 1 of 3

    Angrist, J. D. and Pischke, J.-S. (2009). Mostly Harmless Econometrics: An Empiricist's Companion. Princeton NJ: Princeton University Press.

    Gill, J. (2008). Bayesian Methods: A Social and Behavioral Sciences Approach, 2nd ed. Boca Raton, FL: Chapman and Hall/CRC.

    Greene, W. (2004). The behaviour of the maximum likelihood estimator of limited dependent variable models in the presence of fixed effects. Econometrics Journal, 7, 98-119.

    Hanushek, E. A. (1974). Efficient estimators for regressing regression coefficients. American Statistician, 28, 66-67.

    Hox, J. J. (2010). Multilevel Analysis: Techniques and Applications, 2nd ed. London: Routledge.

    Jenkins, S. P. (2013). A Monte-Carlo analysis of multilevel binary logit model estimator performance. Presentation at the Stata User Group Meeting, London, 13 September, available from: <> [accessed 14 August 2014).

    Jusko, K. L. and Shively, W. P. (2005). A two-step strategy for the analysis of cross-national public opinion data. Political Analysis, 13, 327-344.

    Kackar, R. H. and Harville, D. A. (1981). Unbiasedness of twostage estimation and prediction procedures for mixed linear models. Communications in Statistics: Theory and Methods, 13, 1249-1261.

    Kackar, R. H. and Harville, D. A. (1984). Approximations for standard errors of estimators of fixed and random effects in mixed linear models. Journal of the American Statistical Association, 79, 853-862.

    Kedar, O. and Shively, W. P. (2005). Introduction to the special issue. Political Analysis, 13, 297-300.

  • Metrics
    views in OpenAIRE
    views in local repository
    downloads in local repository

    The information is available from the following content providers:

    From Number Of Views Number Of Downloads
    White Rose Research Online - IRUS-UK 0 32
Share - Bookmark