Loading...
Thumbnail Image
Item

Comparing network structures on three aspects: A permutation test

van Borkulo,C.D.
van Bork,R.
Boschloo,L.
Kossakowski,J.J.
Tio,P.
Schoevers,R.A.
Borsboom,D.
Waldorp,L.J.
Abstract
Network approaches to psychometric constructs, in which constructs are modeled in terms of interactions between their constituent factors, have rapidly gained popularity in psychology. Applications of such network approaches to various psychological constructs have recently moved from a descriptive stance, in which the goal is to estimate the network structure that pertains to a construct, to a more comparative stance, in which the goal is to compare network structures across populations. However, the statistical tools to do so are lacking. In this article, we present the network comparison test (NCT), which uses resampling-based permutation testing to compare network structures from two independent, cross-sectional data sets on invariance of (a) network structure, (b) edge (connection) strength, and (c) global strength. Performance of NCT is evaluated in simulations that show NCT to perform well in various circumstances for all three tests: The Type I error rate is close to the nominal significance level, and power proves sufficiently high if sample size and difference between networks are substantial. We illustrate NCT by comparing depression symptom networks of males and females. Possible extensions of NCT are discussed.
Description
Date
2023-12
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Comparison, Cross-sectional, Network, Permutation test, Validation
Citation
van Borkulo, C D, van Bork, R, Boschloo, L, Kossakowski, J J, Tio, P, Schoevers, R A, Borsboom, D & Waldorp, L J 2023, 'Comparing network structures on three aspects : A permutation test', Psychological Methods, vol. 28, no. 6, pp. 1273-1285. https://doi.org/10.1037/met0000476
Embedded videos