Network psychometric models are often estimated using a single indicator for each node in the network, thus failing to consider potential measurement error. In this study, we investigate the impact... Show moreNetwork psychometric models are often estimated using a single indicator for each node in the network, thus failing to consider potential measurement error. In this study, we investigate the impact of measurement error on cross-sectional network models. First, we conduct a simulation study to evaluate the performance of models based on single indicators as well as models that utilize information from multiple indicators per node, including average scores, factor scores, and latent variables. Our results demonstrate that measurement error impairs the reliability and performance of network models, especially when using single indicators. The reliability and performance of network models improves substantially with increasing sample size and when using methods that combine information from multiple indicators per node. Second, we use empirical data from the STAR*D trial (n = 3,731) to further evaluate the impact of measurement error. In the STAR*D trial, depression symptoms were assessed via three questionnaires, providing multiple indicators per symptom. Consistent with our simulation results, we find that when using sub-samples of this dataset, the discrepancy between the three single-indicator networks (one network per questionnaire) diminishes with increasing sample size. Together, our simulated and empirical findings provide evidence that measurement error can hinder network estimation when working with smaller samples and offers guidance on methods to mitigate measurement error. Show less
Psychotherapy is an effective treatment for many common mental health problems, but the mechanisms of action and processes of change are unclear, perhaps driven by the focus on a single diagnosis... Show morePsychotherapy is an effective treatment for many common mental health problems, but the mechanisms of action and processes of change are unclear, perhaps driven by the focus on a single diagnosis which does not reflect the heterogeneous symptom experiences of many patients. The objective of this study was to better understand therapeutic change, by illustrating how symptoms evolve and interact during psychotherapy. Data from 113,608 patients from psychological therapy services who completed depression and anxiety symptom measures across three to six therapy sessions were analysed. A panel graphical vector-autoregression model was estimated in a model development sample (N = 68,165) and generalizability was tested in a confirmatory model, fitted to a separate (hold-out) sample of patients (N = 45,443). The model displayed an excellent fit and replicated in the confirmatory holdout sample. First, we found that nearly all symptoms were statistically related to each other (i.e. dense connectivity), indicating that no one symptom or association drives change. Second, the structure of symptom interrelations which emerged did not change across sessions. These findings provide a dynamic view of the process of symptom change during psychotherapy and give rise to several causal hypotheses relating to structure, mechanism, and process. Show less
In their recent paper, Forbes et al. (2019; FWMK) evaluate the replicability of network models in two studies. They identify considerable replicability issues, concluding that "current 'state-of... Show moreIn their recent paper, Forbes et al. (2019; FWMK) evaluate the replicability of network models in two studies. They identify considerable replicability issues, concluding that "current 'state-of-the-art' methods in the psychopathology network literature [ horizontal ellipsis ] are not well-suited to analyzing the structure of the relationships between individual symptoms". Such strong claims require strong evidence, which the authors do not provide. FWMK identify low replicability by analyzing point estimates of networks; contrast low replicability with results of two statistical tests that indicate higher replicability, and conclude that these tests are problematic. We make four points. First, statistical tests are superior to the visual inspection of point estimates, because tests take into account sampling variability. Second, FWMK misinterpret the statistical tests in several important ways. Third, FWMK did not follow established recommendations when estimating networks in their first study, underestimating replicability. Fourth, FWMK draw conclusions about methodology, which does not follow from investigations of data, and requires investigations of methodology. Overall, we show that the "poor replicability "observed by FWMK occurs due to sampling variability and use of suboptimal methods. We conclude by discussing important recent simulation work that guides researchers to use models appropriate for their data, such as nonregularized estimation routines. Show less
Steinley, Hoffman, Brusco, and Sher (2017) proposed a new method for evaluating the performance of psychological network models: fixed-margin sampling. The authors investigated LASSO regularized... Show moreSteinley, Hoffman, Brusco, and Sher (2017) proposed a new method for evaluating the performance of psychological network models: fixed-margin sampling. The authors investigated LASSO regularized Ising models (eLasso) by generating random datasets with the same margins as the original binary dataset, and concluded that many estimated eLasso parameters are not distinguishable from those that would be expected if the data were generated by chance. We argue that fixed-margin sampling cannot be used for this purpose, as it generates data under a particular null-hypothesis: a unidimensional factor model with interchangeable indicators (i.e., the Rasch model). We show this by discussing relevant psychometric literature and by performing simulation studies. Results indicate that while eLasso correctly estimated network models and estimated almost no edges due to chance, fixed-margin sampling performed poorly in classifying true effects as “interesting” (Steinley et al. 2017, p. 1004). Further simulation studies indicate that fixed-margin sampling offers a powerful method for highlighting local misfit from the Rasch model, but performs only moderately in identifying global departures from the Rasch model. We conclude that fixed-margin sampling is not up to the task of assessing if results from estimated Ising models or other multivariate psychometric models are due to chance. Show less
Elucidating schizotypal traits is important if we are to understand the various manifestations of psychosis spectrum liability and to reliably identify individuals at high risk for psychosis. The... Show moreElucidating schizotypal traits is important if we are to understand the various manifestations of psychosis spectrum liability and to reliably identify individuals at high risk for psychosis. The present study examined the network structures of (1) 9 schizotypal personality domains and (2) 74 individual schizotypal items, and (3) explored whether networks differed across gender and culture (North America vs China). The study was conducted in a sample of 27001 participants from 12 countries and 21 sites (M age = 22.12; SD = 6.28; 37.5% males). The Schizotypal Personality Questionnaire (SPQ) was used to assess 74 self-report items aggregated in 9 domains. We used network models to estimate conditional dependence relations among variables. In the domain-level network, schizotypal traits were strongly interconnected. Predictability (explained variance of each node) ranged from 31% (odd/magical beliefs) to 55% (constricted affect), with a mean of 43.7%. In the item-level network, variables showed relations both within and across domains, although within-domain associations were generally stronger. The average predictability of SPQ items was 27.8%. The network structures of men and women were similar (r = .74), node centrality was similar across networks (r = .90), as was connectivity (195.59 and 199.70, respectively). North American and Chinese participants networks showed lower similarity in terms of structure (r = 0.44), node centrality (r = 0.56), and connectivity (180.35 and 153.97, respectively). In sum, the present article points to the value of conceptualizing schizotypal personality as a complex system of interacting cognitive, emotional, and affective characteristics. Show less
Recent years have seen an emergence of network modeling applied to moods, attitudes, and problems in the realm of psychology. In this framework, psychological variables are understood to directly... Show moreRecent years have seen an emergence of network modeling applied to moods, attitudes, and problems in the realm of psychology. In this framework, psychological variables are understood to directly affect each other rather than being caused by an unobserved latent entity. In this tutorial, we introduce the reader to estimating the most popular network model for psychological data: the partialcorrelationnetwork. We describe how regularization techniques can be used to efficiently estimate a parsimonious and interpretable network structure in psychological data. We show how to perform these analyses in R and demonstrate the method in an empirical example on posttraumatic stress disorder data. In addition, we discuss the effect of the hyperparameter that needs to be manually set by the researcher, how to handle non-normal data, how to determine the required sample size for a network analysis, and provide a checklist with potential solutions for problems that can arise when estimating regularizedpartialcorrelationnetworks. (PsycINFO Database Record (c) 2018 APA, all rights reserved) Show less
Greene, T.; Gelkopf, M.; Epskamp, S.; Fried, E.I. 2018
BackgroundConceptualizing posttraumatic stress disorder (PTSD) symptoms as a dynamic system of causal elements could provide valuable insights into the way that PTSD develops and is maintained in... Show moreBackgroundConceptualizing posttraumatic stress disorder (PTSD) symptoms as a dynamic system of causal elements could provide valuable insights into the way that PTSD develops and is maintained in traumatized individuals. We present the first study to apply a multilevel network model to produce an exploratory empirical conceptualization of dynamic networks of PTSD symptoms, using data collected during a period of conflict.MethodsIntensive longitudinal assessment data were collected during the Israel–Gaza War in July–August 2014. The final sample (n = 96) comprised a general population sample of Israeli adult civilians exposed to rocket fire. Participants completed twice-daily reports of PTSD symptoms via smartphone for 30 days. We used a multilevel vector auto-regression model to produce contemporaneous and temporal networks, and a partial correlation network model to obtain a between-subjects network.ResultsMultilevel network analysis found strong positive contemporaneous associations between hypervigilance and startle response, avoidance of thoughts and avoidance of reminders, and between flashbacks and emotional reactivity. The temporal network indicated the central role of startle response as a predictor of future PTSD symptomatology, together with restricted affect, blame, negative emotions, and avoidance of thoughts. There were some notable differences between the temporal and contemporaneous networks, including the presence of a number of negative associations, particularly from blame. The between-person network indicated flashbacks and emotional reactivity to be the most central symptoms.ConclusionsThis study suggests various symptoms that could potentially be driving the development of PTSD. We discuss clinical implications such as identifying particular symptoms as targets for interventions. Show less
