This paper is in the following e-collection/theme issue:

Non-randomized Protocols and Methods (ehealth) (568) mHealth for Data Collection and Research (955) mHealth for Wellness, Behavior Change and Prevention (2875) Innovations in Mental Health Systems (391)

Published on in Vol 11, No 8 (2022): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/35206, first published .
Transdiagnostic Psychopathology in a Help-Seeking Population of an Early Recognition Center for Mental Disorders: Protocol for an Experience Sampling Study

Transdiagnostic Psychopathology in a Help-Seeking Population of an Early Recognition Center for Mental Disorders: Protocol for an Experience Sampling Study

Transdiagnostic Psychopathology in a Help-Seeking Population of an Early Recognition Center for Mental Disorders: Protocol for an Experience Sampling Study

Authors of this article:

Marlene Rosen1 Author Orcid Image ;   Linda T Betz1 Author Orcid Image ;   Christian Montag2 Author Orcid Image ;   Christopher Kannen2 Author Orcid Image ;   Joseph Kambeitz1 Author Orcid Image
Article Authors Cited by (2) Tweetations (3) Metrics

    Protocol

    1Department of Psychiatry and Psychotherapy, Faculty of Medicine and University Hospital of Cologne, University of Cologne, Cologne, Germany

    2Institute of Psychology and Education, Ulm University, Ulm, Germany

    *these authors contributed equally

    Corresponding Author:

    Marlene Rosen, PhD

    Department of Psychiatry and Psychotherapy

    Faculty of Medicine and University Hospital of Cologne

    University of Cologne

    Kerpener Straße 62

    Cologne, 50937

    Germany

    Phone: 49 221 478 87166

    Email: marlene.rosen@uk-koeln.de


    Background: Prevention in psychiatry provides a promising way to address the burden of mental illness. However, established approaches focus on specific diagnoses and do not address the heterogeneity and manifold potential outcomes of help-seeking populations that present at early recognition services. Conceptualizing the psychopathology manifested in help-seeking populations from a network perspective of interacting symptoms allows transdiagnostic investigations beyond binary disease categories. Furthermore, modern technologies such as smartphones facilitate the application of the Experience Sampling Method (ESM).

    Objective: This study is a combination of ESM with network analyses to provide valid insights beyond the established assessment instruments in a help-seeking population.

    Methods: We will examine 75 individuals (aged 18-40 years) of the help-seeking population of the Cologne early recognition center. For a maximally naturalistic sample, only minimal exclusion criteria will be applied. We will collect data for 14 days using a mobile app to assess 10 transdiagnostic symptoms (ie, depressive, anxious, and psychotic symptoms) as well as distress level 5 times a day. With these data, we will generate average group-level symptom networks and personalized symptom networks using a 2-step multilevel vector autoregressive model. Additionally, we will explore associations between symptom networks and sociodemographic, risk, and resilience factors, as well as psychosocial functioning.

    Results: The protocol was designed in February 2020 and approved by the Ethics Committee of the University Hospital Cologne in October 2020. The protocol was reviewed and funded by the Köln Fortune program in September 2020. Data collection began in November 2020 and was completed in November 2021. Of the 258 participants who were screened, 93 (36%) fulfilled the inclusion criteria and were willing to participate in the study. Of these 93 participants, 86 (92%) completed the study. The first results are expected to be published in 2022.

    Conclusions: This study will provide insights about the feasibility and utility of the ESM in a help-seeking population of an early recognition center. Providing the first explorative phenotyping of transdiagnostic psychopathology in this population, our study will contribute to the innovation of early recognition in psychiatry. The results will help pave the way for prevention and targeted early intervention in a broader patient group, and thus, enable greater intended effects in alleviating the burden of psychiatric disorders.

    International Registered Report Identifier (IRRID): DERR1-10.2196/35206

    JMIR Res Protoc 2022;11(8):e35206

    doi:10.2196/35206

    Keywords

    help-seeking population; phenotyping; ecological momentary assessment; symptom networks; transdiagnositc psychiatry; prevention; early intervention; psychiatry; mental health 


    Background

    Prevention and early intervention in psychiatry provide promising ways to address the immense burden of mental illness [1-3]. The currently established prevention approach implemented in early recognition services focuses on risk syndromes developed for predicting specific diagnoses (eg, psychosis [4,5]). However, the majority of help-seeking patients who present at early recognition services are not covered by these specific risk syndromes, as they do not fulfill the respective criteria that indicate the increased risk that qualifies them for targeted intervention [4,6]. Thus, in a sizable proportion of this population, early recognition centers for mental disorders currently miss out on a critical potential for preventive efforts. In fact, help-seeking populations present with a mixture of various symptoms [7] such as depressive, anxious, and psychotic symptoms. Depressive and anxiety symptoms have proven to be among the main reasons why individuals seek help [8,9], whereas psychotic symptoms are of interest as they are the most burdensome for the affected individuals as well as for the health care system, despite their low prevalence [10]. These symptoms are shared across different diagnoses [11-13], as well as different disorder states such as risk-syndrome, subthreshold, and full-threshold disorders [11]. Similarly, growing evidence demonstrates that distress is a mediating and triggering factor for psychopathology at large [12-16]. Taken together, help-seeking populations are much more heterogeneous than previously assumed and may develop manifold potential outcomes [17] or show other unfavorable outcomes such as persisting deficits in psychosocial functioning [18].

    Thus, there is a growing call for a broader, transdiagnostic approach for prevention in psychiatry [19-22]. Although there is important data on the psychopathology of patients presenting to early recognition centers (eg, [6,8,23,24]), their interpretation is limited by the typically purely cross-sectional, retrospective, and diagnosis-specific character of the assessments. However, symptoms fluctuate over time [25-27], and important insights are missed when neglecting this dynamic component of psychopathology in help-seeking populations. Moreover, as outlined above, conventional assessments are often considered in isolation rather than in concert, neglecting the transdiagnostic, intertwined nature of psychopathology in help-seeking populations. Collectively, these observations underline the necessity to use novel methods to enrich traditional self- and observer-based reports to understand the psychopathology in help-seeking populations.

    One novel method consists of integrating 2 distinct innovative ideas that have emerged in the field of psychopathology in recent years [28]. The first idea consists of intensive longitudinal measurements of symptoms and other relevant variables via the Experience Sampling Method (ESM), which has become increasingly feasible and accepted in recent years, especially with the advance of mobile technology such as smartphones [29,30]. ESM provides valid insights into psychopathology as it occurs in daily life by assessing the targeted phenomena repeatedly during the course of the day within a specific time period. ESM increases ecological validity compared to retrospective reporting, reduces biases resulting from false memory or aggregation processes of experience over a longer time period, and allows the collection of data at the within-person level [31].

    The second idea is the network approach mainly put forward by Borsboom et al [32-34] (recent overview [35]), in which psychopathology is conceived as a dynamic system of connected, interacting, and maintaining symptoms and other clinically relevant variables [32,36]. In line with a clinician’s perspective, symptoms are assumed to co-occur because of functional relations between them rather than due the common dependence on an underlying disorder entity [33,35,36]. With its inherently transdiagnostic outlook [34,37], the network approach is well suited for conceptualizing the psychopathology of help-seeking populations, where the patterns and strength of symptom expression is typically highly heterogeneous.

    The integration of network analyses with ESM data enables rich insights beyond those obtained by established assessment instruments. Specifically, the intensive time-series data that result from ESM can be used to model symptom networks that offer a promising gateway into understanding the dynamics of psychopathology on the group and individual levels [38]. On the group level, dynamic symptom networks allow us to exploratively map out the potential average causal relations among individual symptoms in the same measurement window and across measurement windows. Personalized symptom networks are of special interest, as they allow the conceptualization of psychopathology as a set of person-specific dynamic processes [36,39]. By revealing the symptoms and processes most relevant to each individual, these approaches hold the potential to personalize interventions [36,40].

    Due to these properties, many interesting studies have been published proving the potential of longitudinal symptom network models in advancing the psychopathological understanding of specific psychiatric conditions [41,42]. However, insights into the dynamic structure of psychopathology of a heterogeneous help-seeking population of a psychiatric early recognition center—the interactions of a broad, transdiagnostic set of symptoms, as well as the associations with risk and resilience factors and psychosocial functioning—are still lacking so far.

    Thus, with this proposed study, we aim to provide the first explorative, transdiagnostic phenotyping through the combination of ESM with network analyses. This will be the one of the first studies aimed at phenotyping the transdiagnostic help-seeking population of an early recognition center for mental disorders by applying ESM.

    Findings from this innovative approach integrated with those derived from established assessments represent a promising way to address a larger proportion of the help-seeking population as compared to current diagnosis-specific strategies aimed at preventing the burden of psychiatric disorders. Moreover, the results will have their core value in generating hypotheses regarding central dynamic psychopathological processes. These provide a basis for follow-up work dedicated to informing preventive interventions by testing experimentally whether the interventions on particular symptoms or processes lead to changes consistent with the estimated network model [43].

    Aim

    The PhenoNetz study aims to explore the transdiagnostic phenotyping of a help-seeking population of an early recognition center for mental disorders using innovative, intensive longitudinal data collection via a smartphone app. A better understanding of the relevant psychopathology in this population is of great relevance given the lack of adequate interventions [44]. Combining ESM with network analyses allows for unique insights into the as yet underresearched early transdiagnostic psychopathological processes in the help-seeking population of an early recognition center of mental disorders, as well as to explore their association with risk, resilience, and psychosocial functioning.


    Setting and Participants

    In total, 100 participants will be recruited from the help-seeking population presenting at the early recognition center of mental disorders at the University Hospital of Cologne (Früherkennungs- und Therapiezentrum; FETZ) [45], with an expected dropout rate of 25% leading to a total of 75 participants in the final sample. Dropouts include the participants that withdraw from the study, are no longer reachable, or terminate the study without a sufficient number of ESM measurements (for details, see the data analysis section). The FETZ offers specialist diagnostics for the early recognition of mental disorders, with a focus on severe mental illness, in particular psychotic disorders. However, the first contact is independent of this focus and accessible for all people aged 18-40 years that have noticed any changes in their experience and behavior. Most patients find out about the FETZ through internet research or are referred by health care practitioners.

    For a naturalistic characterization of the help-seeking population presenting at the FETZ using ESM, we will not impose specific inclusion criteria for participation in the PhenoNetz study. Similarly, to ensure the validity of the obtained data, only a small part of the help-seeking participants will be excluded based on the following criteria:

    • acute suicidal thoughts
    • IQ ≤ 70
    • aged >40 years
    • known previous illness of the central nervous system, as well as untreated, unstable somatic illnesses with known effects on the central nervous system (eg, untreated hypothyroidism)
    • insufficient knowledge of the German language

    Procedure and Materials

    All patients presenting at the FETZ not fulfilling any of the listed exclusion criteria will be addressed either directly at the FETZ or via telephone or email (given permission to contact was obtained by the clinical personnel at the FETZ) and informed about the background, goal, design, risks, benefits, and data security aspects of the study. Any open questions the participants might have will be answered directly by one of the primary investigators (MR and LTB). All willing participants will provide written informed consent prior to their participation in the study. All participants will be compensated with €40 (US $42.08) for their participation. Participants can withdraw from the study at any time without negative consequences.

    Figure 1 illustrates the study design. During the baseline assessment, data on sociodemographics, medication, substance use, psychopathology including psychosocial functioning, as well as risk and resilience factors will be assessed through both observer- and self-ratings (Table 1). All data will be collected via the Research Electronic Data Capture (REDCap) software [46]. In the baseline assessment, the mobile app used for ESM data collection in the study, insightsApp [47] (Figure 2a), will be installed on the personal smartphones of the participants. As the insightsApp only runs on Android devices, participants with personal smartphones using other operating systems (eg, iOS) will be provided with a study smartphone for the study period. Participants will be encouraged to complete as many surveys as possible without substantial inconvenience or compromising their personal safety (eg, disrupting sleep or while driving). Compensation for participation will not depend on the number of completed assessments.

    ‎
    Figure 1. Study design of the PhenoNetz study. Participants included will undergo baseline assessment with self- and observer-ratings, followed by a 14-day ESM data collection period. In the subsequent follow-up assessment, selected self- and observer-ratings will be collected again. If desired, the participants will receive personalized feedback on their ESM data after the 2 weeks of ESM data collection, such that the feedback does not interfere with ESM data collection. ESM: Experience Sampling Method.
    View this figure
    ‎
    Figure 2. Layout of the insightsApp. (a) Main menu; (b) In-app reminder; (c) Visual analogue scale for answering transdiagnostic items.
    View this figure
    Table 1. Constructs with scales assessed at the baseline and follow-up assessments (before and after the Experience Sampling Method [ESM] period, respectively) of the PhenoNetz study.
    ConstructQuestionnaireSelf- vs observer -ratingBaseline
    assessment    		Follow-up
    assessment
    SociodemographicsSelf-designed questionnaire assessing gender, age, primary language, nationality, current living or housing conditions, highest level of education, highest vocational degree, current employment/professional activity, marital status/partnership, number of siblings, highest level of education of primary caregivers, highest vocational degree of primary caregiversObserver-rating✓
    Psychopathology

    		Diagnostic classificationStructured Clinical Interview for DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, 5th Edition) [48]Observer-rating✓

    		Current substance useAnalogous to the Personalized Prognostic Tools for Early Psychosis Management study [49]Observer-rating✓✓

    		Current medicationAnalogous to the Personalized Prognostic Tools for Early Psychosis Management study [49]Observer-rating✓✓

    		DepressionBeck Depression Inventory [50]Self-rating✓✓

    		AnxietyState and Trait Anxiety Inventory [51]Self-rating✓✓

    		Social phobiaSocial Phobia Inventory [52]Self-rating✓✓

    		Psychotic symptomsCommunity Assessment of Psychic Experience [53]Self-rating✓✓

    		Quality of lifeWorld Health Organization Quality of Life Questionnaire [54]Self-rating✓✓
    Risk and resilience

    		Childhood traumaChildhood Trauma Questionnaire [55]Self-rating✓

    		BullyingBullying Scale [56]Self-rating✓

    		ResilienceResilience Scale for Adults [57]Self-rating✓

    		CopingCoping Inventory for Stressful Situations [58]Self-rating✓

    		PersonalityNEO-Five Factor Inventory [59]Self-rating✓

    		AttachmentAttachment Style Questionnaire [60]Self-rating✓

    		Expressed emotionLevel of Expressed Emotion Scale [61]Self-rating✓

    		Social supportMultidimensional Scale of Perceived Social Support [62]Self-rating✓

    		IntrospectionSelf-Reflection and Insight Scale [63,64]Self-rating✓✓

    		Self-efficacySelf-Efficacy Scale [65]Self-rating✓
    Psychosocial functioningGlobal Functioning Social and Role Scales [66]Observer-rating✓
    Experience with ESM periodAdapted from Frumkin et al [67]Self-rating
    		✓

    Using ESM, potentially relevant transdiagnostic (subthreshold) symptoms such as sadness, anxiety, psychotic experiences, and stress will be recorded (Textbox 1). The items are based on previous studies and questionnaires, given the lack of standardized ESM assessment in clinical populations [43,68]. In-app reminders will be sent out 5 times a day at fixed time points: 9:30 AM, 12:30 PM, 3:30 PM, 6:30 PM, and 9:30 PM, for a duration of 14 days (Figure 2b). Fixed sampling schemes are common in network applications to ESM data [43,67,69-71], given that they lead to equidistant measurements, an important assumption of 2-step multilevel vector autoregressive (mlVAR) modeling [38]. In psychiatric populations, fixed sampling schemes have also been associated with increased compliance [72]. In each survey, participants will be asked how much they endorse a certain feeling or behavior at the time of filling out the survey: “Wie sehr trifft die folgende Aussage im jetzigen Moment auf Sie zu?” (How much does the following statement apply to you at this moment?). Responses will be given on a visual analogue scale (as a percentage) from 0=“trifft überhaupt nicht zu” (does not apply at all) to 100=“trifft voll und ganz zu” (applies fully), with a slider that can be moved in 1-unit increments (Figure 2c). Participants will be asked to fill in the items as soon as possible after receiving the in-app reminder, but no later than 60 minutes afterwards, following prior research (eg, [43,73,74]). Filling in the items takes about 1-1.5 minutes in total. Similar ESM protocols were deemed acceptable for clinical populations in prior studies [31,67,75]. The insightsApp will be used only for the regular, active collection of transdiagnostic symptoms by means of the described self-report questions. No personal information (such as name and phone number, etc.) or passive data are accessed, stored, or transferred by the insightsApp. To maximize the number of completed surveys for each participant, the participants will be contacted at least once during the assessment period to assess instruction adherence, identify any concerns associated with the method, and help the participants with any problems in completing the ESM questionnaire.

    Experience Sampling Method (ESM) items assessed in the PhenoNetz study (along with the English translation).
    1. Ich bin traurig (I am sad).
    2. Ich nehme Dinge wahr, die andere Menschen nicht wahrnehmen können (I perceive things that other people cannot perceive).
    3. Ich habe Schwierigkeiten, mich zu konzentrieren (I have difficulties concentrating).
    4. Ich bin kontaktfreudig (I feel sociable).
    5. Ich fühle mich gestresst (I feel stressed).
    6. Ich bin zufrieden mit mir (I am satisfied with myself).
    7. Ich fühle mich ängstlich (I feel anxious).
    8. Es fällt mir schwer, mich zu Dingen zu motivieren (I find it hard to motivate myself to do things).
    9. Ich bin misstrauisch gegenüber anderen Menschen (I am suspicious of other people).
    10. Ich grüble (I am brooding).
    Textbox 1. Experience Sampling Method (ESM) items assessed in the PhenoNetz study (along with the English translation).

    In the follow-up assessment conducted after the 14 days of ESM data collection, information on psychopathology, medication, and substance use will be assessed again, referring to the 14 days during which ESM data were collected (Table 1). In addition, experiences and strain associated with the ESM data collection will be assessed via a questionnaire translated and adjusted from a previous study conducted in clinical participants [67] (Table S1 in Multimedia Appendix 1). If desired, participants will be provided with a personalized feedback report on their ESM data.

    Data Security

    Using a smartphone app installed on the personal smartphone of the participants for data assessment requires particular attention to data security (a broader discussion on ethical concerns regarding digital phenotyping procedures in the psychological and psychiatric sciences have been previously described [76,77]). Therefore, subjects must provide additional consent to allow data to be collected within the app and grant the necessary permissions to the app on the smartphones (such as being notified by the app about available surveys). The ESM data collected by the insightsApp are pseudonymized (16-digit alphanumeric codes) and sent directly to a server hosted and maintained by a professional web hosting service after each survey. Answers to the surveys are only stored temporarily locally on the smartphones and deleted once they are transmitted to the server. To secure the data transfer from the smartphone to the server, the connection between the insightsApp and the backend software on the server is encrypted by the use of a Secure Sockets Layer certificate.

    Safety

    Given that this study is observational, there are no direct risks associated with participation. Previous studies have demonstrated good acceptance of ESM protocols similar to the one implemented in this study. Even if participants become more aware of their symptoms due to high-frequency data collection, this does not have a negative effect in terms of worsening symptoms [31,67,78]. Participants can terminate the ESM data collection at any time without giving reasons. Participants who are acutely suicidal or a danger to others will immediately be presented to the service physician for further assessment. Should this become apparent in a telephone call, participants will be reported to the responsible social psychiatric service.

    Data Analytic Plan

    All statistical analyses will be conducted in the R statistical software (R Foundation for Statistical Computing) [79]. Descriptive analysis of the sample will include mean, SD, median, and IQR as appropriate. The participants included in the analysis will be compared to those that dropped out of the study or were excluded due to too few available measurements (see sample size and the required number of ESM observations) via appropriate classes of permutation tests [80]. Changes in measures that were assessed twice, pre- and post-ESM (see Table 1), will be compared via linear mixed modeling. Prior to the analyses of ESM data, we will detrend the ESM data by fitting fixed-effects linear regression models to each ESM item, regressing out a linear trend on time (ie, general increases/decreases in items over time) and mean-center ESM items per person. We will then generate group-level and personalized networks via a 2-step mlVAR modeling approach as described in detail below. These analyses will allow us to examine symptom dynamics within multiple individuals (n>1; fixed effects) and for individual participants (n=1; random effects). Originally, we planned to estimate and analyze “truly” personalized networks solely based on data from individual participants (such as those that could be derived via a graphical vector autoregressive model [28]). However, results from a simulation study [81], published as a preprint 1 month after our study commenced, suggest that our sampling scheme potentially lacks the power to detect a nonnegligible proportion of true edges in truly personalized networks, which is why we decided to refrain from this analytic approach.

    2-Step mlVAR Model

    We will use a mlVAR model, as implemented in the R package “mlVAR.” In the mlVAR model, the average dynamical relationships on the group level are modeled as fixed effects, whereas regression coefficients are allowed to vary between patients as random effects.

    First, we will estimate 3 group-level network structures including the 10 assessed symptoms, reflecting the average process of all participants (fixed effects): between-subject (an undirected partial correlation network between the means of participant’s scores, capturing, in general, whether participants high on a given node are also high on other nodes during the 2-week course of the study), contemporaneous (an undirected partial correlation network showing how symptoms relate to each other in the same window of measurement, controlling for temporal relationships), and temporal (a directed network displaying symptoms predicting each other across an approximately 3-hour lag, while controlling for all other experiences in the model at the prior measurement). Centrality will be assessed using strength centrality (indicating the summed absolute edge strengths connected to a specific node) in the contemporaneous network, and in-strength (indicating the summed absolute strengths of all incoming edges) and out-strength (indicating the summed absolute strengths of all outgoing edges) in the temporal network will be assessed using the R package “qgraph” [82].

    Second, we will generate 2 types of personalized networks for each participant based on estimated random effects of the mlVAR model: a contemporaneous network and a temporal network. These personalized networks are not truly idiographic, in the sense that they borrow information from other subjects [38,41]. However, in doing so, the mlVAR model can perform well in estimating personalized networks even if the number of ESM observations is comparatively low for a particular participant. Given that the mlVAR model does not perform participant-specific model selection, all estimated personalized networks will contain all edges [38].

    We will use orthogonal estimation for contemporaneous and temporal effects. For the contemporaneous and temporal group-level networks, we will use the conservative “AND-rule” approach in retaining and plotting significant edges. A detailed description of methodological details has been described previously [38,41].

    Specifically, we have planned the following analyses:

    1. We will compute group longitudinal networks (between-person, contemporaneous, and temporal [28]) as described above.
    2. We will identify symptom centrality and unique partial correlations among symptoms in the contemporaneous and temporal group-level networks. We hypothesize that on the group level, feeling stressed will be the most central symptom in the contemporaneous network and predict most other experiences in the temporal network, given that stress experience is frequently discussed as a transdiagnostic factor in psychopathological experiences [13-16]. For the temporal network, we have no a priori hypothesis with regard to the most central item.
    3. We will evaluate the degree of association between risk factors (eg, childhood trauma) and network connectivity, assessed by the global strength of personalized networks (temporal and contemporaneous) in a linear modeling approach. Based on prior research and theoretical considerations [33,83,84], we hypothesize that risk factors will be associated with increased network connectivity. Similarly, we hypothesize that poorer psychosocial functioning will be associated with increased network connectivity.
    4. We will explore how the strength of specific symptom-symptom connections in individual contemporaneous and temporal networks relates to the degree of presence of specific risk and resilience factors.

    Sample Size and the Required Number of ESM Observations

    Formal power analyses have not yet been worked out for group-level network models based on intensive longitudinal data. Power at the intraindividual level is a function of within-person variability; there should be sufficient variability such that the intraclass coefficient is not too close to 1, which should usually be the case when having a large number of assessments per person as in our study [85,86]. The performance of network estimation methods also depends on the unknown true network structure—the network equivalent of a true effect size in power analysis [41]. Supplementary materials from Epskamp et al [38] report simulation results for mlVAR models, showing that mlVAR models are excellent in recovering the fixed effect structures with a small amount of data, starting at 50 participants. With our targeted sample size of 75, which represents a realistic recruitment goal in the population of interest, we will surpass this threshold, leading to an adequately powered analysis for the estimation of a mlVAR model. Due to the methodological novelty of symptom networks based on intensive time-series data, there exist no guidelines on the number of ESM observations required [41]. More observations collected over a longer period of time improves the stability and validity of the results; however, this has to be balanced against the feasibility of the integration of the study into the daily lives of the participants. With 75 targeted observations collected over 14 days, our study is similar to the study designs of previous ESM projects conducted in psychiatric populations [67,70,73-75,87,88]. Following recommended guidelines [89] and prior studies [38,71], participants with fewer than one-third of the possible ESM observations (ie, 23) will be excluded from the network estimation.

    Ethics Approval

    Ethics approval was granted by the Ethics Committee of the University Hospital Cologne in October 2020 (reference number 20-1092).


    Study recruitment started on November 11, 2020, and was completed on November 10, 2021. Of the 258 participants who were screened, 93 (36%) fulfilled the inclusion criteria and were willing to participate in the study. Of these 93 participants, 86 (92%) completed the study. As of May 2022, data analysis is ongoing. The first results are expected to be published in 2022.


    Expected Findings

    This study aims to extract an explorative phenotyping of the heterogenous help-seeking population of a psychiatric early recognition center. Applying ESM, we will attempt to depict transdiagnostic symptom networks and explore their association with protective and risk factors, as well as psychosocial functioning.

    The diverse and transdiagnostic character of help-seeking populations [7] limits the potential of current, narrow concepts of prevention in psychiatry [17,19]. Our exploratory study might provide a first glimpse at the dynamics between transdiagnostic symptoms as well as the associations with outcome and preceding conditions independent of diagnostic categories. Such new insights might be more valuable for alternative preventive approaches targeting a broader patient group than currently established approaches [90]. The central transdiagnostic items and processes we will identify might represent anchor points for interventions [91], which might deviate from diagnosis-specific manuals only focusing on symptoms and processes covered by diagnostic criteria [92]. Furthermore, insights into potential etiological processes, identified by the association with risk and resilience factors as well as psychosocial functioning, might inform prevention strategies [44,92]. Dynamic models based on ESM data being more in line with the true nature of psychopathology instead of static models [25,27,92] might be more effective in the prediction of outcome. In particular, transdiagnostic symptomatology was not often depicted by ESM studies so far [72]. Hypotheses based on the findings of our explorative study might guide future research.

    Strengths and Limitations

    The atheoretical approach of our study facilitates truly innovative insights not biased or limited by established theories and structures. In addition, the choice for a naturalistic sample with only a limited set of inclusion and exclusion criteria is valuable for external validity.

    However, there are several limitations in the design of our study that need to be considered. First, we acknowledge that the use of study smartphones may result in the underrepresentation of iPhone users in our study, as well as less valid data collection than if the participants can use their own smartphones.

    The biggest challenge during the conceptualization of the study was the lack of officially validated ESM items. In general, as gold standards for the novel methodology of ESM are missing, researchers construct their own ESM items or refer to items used in previous studies [43,68,93]. Furthermore, most ESM studies focus on specific diagnoses (eg, major depressive disorder [72]). In a transdiagnostic ESM design, by contrast, it is difficult to cover the entire diversity of different disorders due to the further limited number of items per diagnosis-specific phenomenology. These difficulties underscore a recent call for valid and reliable scales suitable for investigating the short-term dynamics of emotions and state mental health problems [43].

    Future Directions

    ESM represents only one of the various powerful elements (eg, digital phenotyping [94,95]) used to gain insights into relevant variables collected in everyday life to improve prevention and targeted early intervention. Studying the digital footprints left by the human-smartphone interaction (eg, log-in frequency, the use of different apps, and calling behavior) can provide additional important insights into the psychopathological states in help-seeking individuals [96]. Exploring the potential of ESM as a self-monitoring intervention in help-seeking populations (similar to approaches in depressive disorder [26]) is another exciting avenue for future research.

    Conclusion

    In clinical science, intensive longitudinal assessments of symptoms in daily life are deservedly receiving more and more attention [36,40,41] that might result in enhanced patient benefit. By applying ESM and network analyses, our study intends to contribute a milestone toward innovation in understanding help-seeking populations in psychiatry, helping a greater proportion of this heterogeneous and crucial target group [40]. Subsequent impacts on early states and the progress of mental disorders might reduce the associated personal, familial, societal, clinical, and economic burden more effectively.

    Acknowledgments

    The study is funded by the Köln Fortune program, Faculty of Medicine, University of Cologne (grant 304/2020).

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Questionnaire to assess experiences and strain associated with the ESM data collection translated and adjusted from a previous study conducted in clinical participants. ESM: Experience Sampling Method.

    PDF File (Adobe PDF File), 99 KB
    1. Marshall M, Husain N, Bork N, Chaudhry IB, Lester H, Everard L, et al. Impact of early intervention services on duration of untreated psychosis: data from the National EDEN prospective cohort study. Schizophr Res 2014 Oct;159(1):1-6. [CrossRef] [Medline]
    2. Valmaggia LR, Byrne M, Day F, Broome MR, Johns L, Howes O, et al. Duration of untreated psychosis and need for admission in patients who engage with mental health services in the prodromal phase. Br J Psychiatry 2015 Aug;207(2):130-134 [FREE Full text] [CrossRef] [Medline]
    3. Fusar-Poli P, Bauer M, Borgwardt S, Bechdolf A, Correll CU, Do KQ, et al. European college of neuropsychopharmacology network on the prevention of mental disorders and mental health promotion (ECNP PMD-MHP). Eur Neuropsychopharmacol 2019 Dec;29(12):1301-1311 [FREE Full text] [CrossRef] [Medline]
    4. Schultze-Lutter F, Michel C, Schmidt SJ, Schimmelmann BG, Maric NP, Salokangas RKR, et al. EPA guidance on the early detection of clinical high risk states of psychoses. Eur Psychiatry 2015 Mar;30(3):405-416. [CrossRef] [Medline]
    5. Rosen M, Betz LT, Schultze-Lutter F, Chisholm K, Haidl TK, Kambeitz-Ilankovic L, PRONIA Consortium. Towards clinical application of prediction models for transition to psychosis: a systematic review and external validation study in the PRONIA sample. Neurosci Biobehav Rev 2021 Jun;125:478-492. [CrossRef] [Medline]
    6. Schultze-Lutter F, Ruhrmann S, Klosterkötter J. Early detection of psychosis - establishing a service for persons at risk. Eur Psychiatry 2009 Jan;24(1):1-10. [CrossRef] [Medline]
    7. Iorfino F, Scott EM, Carpenter JS, Cross SP, Hermens DF, Killedar M, et al. Clinical stage transitions in persons aged 12 to 25 years presenting to early intervention mental health services with anxiety, mood, and psychotic disorders. JAMA Psychiatry 2019 Nov 01;76(11):1167-1175 [FREE Full text] [CrossRef] [Medline]
    8. Rickwood DJ, Telford NR, Parker AG, Tanti CJ, McGorry PD. headspace - Australia's innovation in youth mental health: who are the clients and why are they presenting? Med J Aust 2014 Feb 03;200(2):108-111. [CrossRef] [Medline]
    9. Fusar-Poli P, Nelson B, Valmaggia L, Yung AR, McGuire PK. Comorbid depressive and anxiety disorders in 509 individuals with an at-risk mental state: impact on psychopathology and transition to psychosis. Schizophr Bull 2014 Jan;40(1):120-131 [FREE Full text] [CrossRef] [Medline]
    10. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol 2011 Sep;21(9):655-679. [CrossRef] [Medline]
    11. Wigman JTW, van Nierop M, Vollebergh WAM, Lieb R, Beesdo-Baum K, Wittchen H, et al. Evidence that psychotic symptoms are prevalent in disorders of anxiety and depression, impacting on illness onset, risk, and severity--implications for diagnosis and ultra-high risk research. Schizophr Bull 2012 Mar;38(2):247-257 [FREE Full text] [CrossRef] [Medline]
    12. Monroe SM. Modern approaches to conceptualizing and measuring human life stress. Annu Rev Clin Psychol 2008;4:33-52. [CrossRef] [Medline]
    13. Calcia MA, Bonsall DR, Bloomfield PS, Selvaraj S, Barichello T, Howes OD. Stress and neuroinflammation: a systematic review of the effects of stress on microglia and the implications for mental illness. Psychopharmacology (Berl) 2016 May;233(9):1637-1650 [FREE Full text] [CrossRef] [Medline]
    14. Betz LT, Penzel N, Rosen M, Kambeitz J. Relationships between childhood trauma and perceived stress in the general population: a network perspective. Psychol Med 2021 Nov;51(15):2696-2706. [CrossRef] [Medline]
    15. Myin-Germeys I, van Os J. Stress-reactivity in psychosis: evidence for an affective pathway to psychosis. Clin Psychol Rev 2007 May;27(4):409-424. [CrossRef] [Medline]
    16. Isvoranu A, van Borkulo CD, Boyette L, Wigman JTW, Vinkers CH, Borsboom D, Group Investigators. A network approach to psychosis: pathways between childhood trauma and psychotic symptoms. Schizophr Bull 2017 Jan;43(1):187-196 [FREE Full text] [CrossRef] [Medline]
    17. van Os J, Guloksuz S. A critique of the "ultra-high risk" and "transition" paradigm. World Psychiatry 2017 Jun;16(2):200-206 [FREE Full text] [CrossRef] [Medline]
    18. Addington J, Stowkowy J, Liu L, Cadenhead KS, Cannon TD, Cornblatt BA, et al. Clinical and functional characteristics of youth at clinical high-risk for psychosis who do not transition to psychosis. Psychol Med 2019 Jul;49(10):1670-1677. [CrossRef] [Medline]
    19. McGorry PD, Hartmann JA, Spooner R, Nelson B. Beyond the "at risk mental state" concept: transitioning to transdiagnostic psychiatry. World Psychiatry 2018 Jun;17(2):133-142. [CrossRef] [Medline]
    20. Rimvall MK, van Os J, Jeppesen P. Promoting a patient-centered, transdiagnostic approach to prevention of severe mental illness. Eur Child Adolesc Psychiatry 2021 May;30(5):823-824. [CrossRef] [Medline]
    21. Shah JL, Scott J, McGorry PD, Cross SPM, Keshavan MS, Nelson B, International Working Group on Transdiagnostic Clinical Staging in Youth Mental Health. Transdiagnostic clinical staging in youth mental health: a first international consensus statement. World Psychiatry 2020 Jun;19(2):233-242 [FREE Full text] [CrossRef] [Medline]
    22. Cross SP, Hickie I. Transdiagnostic stepped care in mental health. Public Health Res Pract 2017 Apr 27;27(2):2721712 [FREE Full text] [CrossRef] [Medline]
    23. Brandizzi M, Schultze-Lutter F, Masillo A, Lanna A, Curto M, Lindau JF, et al. Self-reported attenuated psychotic-like experiences in help-seeking adolescents and their association with age, functioning and psychopathology. Schizophr Res 2014 Dec;160(1-3):110-117. [CrossRef] [Medline]
    24. Michel C, Kaess M, Flückiger R, Büetiger JR, Schultze-Lutter F, Schimmelmann BG, et al. The Bern Early Recognition and Intervention Centre for mental crisis (FETZ Bern)-An 8-year evaluation. Early Interv Psychiatry 2022 Mar;16(3):289-301. [CrossRef] [Medline]
    25. van Os J, Lataster T, Delespaul P, Wichers M, Myin-Germeys I. Evidence that a psychopathology interactome has diagnostic value, predicting clinical needs: an experience sampling study. PLoS One 2014;9(1):e86652 [FREE Full text] [CrossRef] [Medline]
    26. Kramer I, Simons CJP, Hartmann JA, Menne-Lothmann C, Viechtbauer W, Peeters F, et al. A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry 2014 Feb;13(1):68-77 [FREE Full text] [CrossRef] [Medline]
    27. Myin-Germeys I, Oorschot M, Collip D, Lataster J, Delespaul P, van Os J. Experience sampling research in psychopathology: opening the black box of daily life. Psychol Med 2009 Sep;39(9):1533-1547. [CrossRef] [Medline]
    28. Epskamp S, van Borkulo CD, van der Veen DC, Servaas MN, Isvoranu A, Riese H, et al. Personalized network modeling in psychopathology: the importance of contemporaneous and temporal connections. Clin Psychol Sci 2018 May;6(3):416-427 [FREE Full text] [CrossRef] [Medline]
    29. Miller G. The smartphone psychology manifesto. Perspect Psychol Sci 2012 May;7(3):221-237. [CrossRef] [Medline]
    30. Markowetz A, Błaszkiewicz K, Montag C, Switala C, Schlaepfer TE. Psycho-informatics: Big Data shaping modern psychometrics. Med Hypotheses 2014 Apr;82(4):405-411. [CrossRef] [Medline]
    31. Verhagen SJW, Hasmi L, Drukker M, van Os J, Delespaul PAEG. Use of the experience sampling method in the context of clinical trials. Evid Based Ment Health 2016 Aug;19(3):86-89 [FREE Full text] [CrossRef] [Medline]
    32. Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol 2013;9:91-121. [CrossRef] [Medline]
    33. Borsboom D. A network theory of mental disorders. World Psychiatry 2017 Feb;16(1):5-13 [FREE Full text] [CrossRef] [Medline]
    34. Cramer AOJ, Waldorp LJ, van der Maas HLJ, Borsboom D. Comorbidity: a network perspective. Behav Brain Sci 2010 Jun;33(2-3):137-50; discussion 150. [CrossRef] [Medline]
    35. McNally RJ. Network analysis of psychopathology: controversies and challenges. Annu Rev Clin Psychol 2021 May 07;17:31-53. [CrossRef] [Medline]
    36. Hofmann SG, Curtiss J, McNally RJ. A complex network perspective on clinical science. Perspect Psychol Sci 2016 Sep;11(5):597-605 [FREE Full text] [CrossRef] [Medline]
    37. Borsboom D, Epskamp S, Kievit RA, Cramer AOJ, Schmittmann VD. Transdiagnostic networks: commentary on Nolen-Hoeksema and Watkins (2011). Perspect Psychol Sci 2011 Nov;6(6):610-614. [CrossRef] [Medline]
    38. Epskamp S, Waldorp LJ, Mõttus R, Borsboom D. The Gaussian graphical model in cross-sectional and time-series data. Multivariate Behav Res 2018;53(4):453-480. [CrossRef] [Medline]
    39. Fisher AJ, Boswell JF. Enhancing the personalization of psychotherapy with dynamic assessment and modeling. Assessment 2016 Aug;23(4):496-506. [CrossRef] [Medline]
    40. Hofmann SG, Hayes SC. The future of intervention science: process-based therapy. Clin Psychol Sci 2019 Jan;7(1):37-50 [FREE Full text] [CrossRef] [Medline]
    41. Jordan DG, Winer ES, Salem T. The current status of temporal network analysis for clinical science: considerations as the paradigm shifts? J Clin Psychol 2020 Sep;76(9):1591-1612. [CrossRef] [Medline]
    42. Robinaugh DJ, Hoekstra RHA, Toner ER, Borsboom D. The network approach to psychopathology: a review of the literature 2008-2018 and an agenda for future research. Psychol Med 2020 Feb;50(3):353-366 [FREE Full text] [CrossRef] [Medline]
    43. Fried EI, Papanikolaou F, Epskamp S. Mental health and social contact during the COVID-19 pandemic: an ecological momentary assessment study. PsyArXiv Preprint posted online on April 24, 2020. [CrossRef]
    44. Mei C, van der Gaag M, Nelson B, Smit F, Yuen HP, Berger M, et al. Preventive interventions for individuals at ultra high risk for psychosis: an updated and extended meta-analysis. Clin Psychol Rev 2021 Jun;86:102005. [CrossRef] [Medline]
    45. Früherkennungs- und Therapiezentrum für psychische Krisen (FETZ). University Hospital Cologne.   URL: http://fetz.uk-koeln.de [accessed 2022-06-10]
    46. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009 Apr;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
    47. Montag C, Baumeister H, Kannen C, Sariyska R, Meßner EM, Brand M. Concept, possibilities and pilot-testing of a new smartphone application for the social and life sciences to study human behavior including validation data from personality psychology. J 2019 Mar 27;2(2):102-115. [CrossRef]
    48. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22-33;quiz 34. [Medline]
    49. Koutsouleris N, Kambeitz-Ilankovic L, Ruhrmann S, Rosen M, Ruef A, Dwyer DB, PRONIA Consortium. Prediction models of functional outcomes for individuals in the clinical high-risk state for psychosis or with recent-onset depression: a multimodal, multisite machine learning analysis. JAMA Psychiatry 2018 Nov 01;75(11):1156-1172 [FREE Full text] [CrossRef] [Medline]
    50. Strunk KK, Lane FC. The Beck Depression Inventory, Second Edition (BDI-II): a cross-sample structural analysis. Meas Eval Couns Dev 2017;50(1-2):3-17. [CrossRef]
    51. Spielberger CD, Gorsuch RL, Lushene RE. STAI Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press; 1970.
    52. Sosic Z, Gieler U, Stangier U. Screening for social phobia in medical in- and outpatients with the German version of the Social Phobia Inventory (SPIN). J Anxiety Disord 2008 Jun;22(5):849-859. [CrossRef] [Medline]
    53. Schlier B, Jaya ES, Moritz S, Lincoln TM. The Community Assessment of Psychic Experiences measures nine clusters of psychosis-like experiences: A validation of the German version of the CAPE. Schizophr Res 2015 Dec;169(1-3):274-279. [CrossRef] [Medline]
    54. Angermeyer MC, Kilian R, Matschinger H. WHOQoL-100 und WHOQoL-BREF: Handbuch für die deutschsprachigen Versionen der WHO Instrumente zur Erfassung von Lebensqualität. Boston, MA: Hogrefe; 2000.
    55. Wingenfeld K, Spitzer C, Mensebach C, Grabe HJ, Hill A, Gast U, et al. [The German Version of the Childhood Trauma Questionnaire (CTQ):Preliminary Psychometric Properties.]. Psychother Psychosom Med Psychol 2010 Aug;60(8):e13. [CrossRef] [Medline]
    56. Haidl TK, Schneider N, Dickmann K, Ruhrmann S, Kaiser N, Rosen M, PRONIA-consortium. Validation of the Bullying Scale for Adults - results of the PRONIA-study. J Psychiatr Res 2020 Oct;129:88-97. [CrossRef] [Medline]
    57. Kaiser N, Seves M, Koutsouleris N, Ruhrmann S. Validierung einer deutschen Version der Resilience Scale for Adults (RSA). Diagnostica 2019 Oct;65(4):205-215. [CrossRef]
    58. Kälin W. Deutsche 24-Item Kurzform des „Coping Inventory for Stressful Situations(CISS)“ von N. S. Endler & J. D. A. Parker. Basierend auf der Übersetzung von N. Semmer, F.Tschan & V. Schade (unveröffentlichter Fragebogen). Bern, Switzerland: Bern Universität, Institut für Psychologie; 1995.
    59. Scandell DJ. Development and initial validation of validity scales for the NEO-Five Factor Inventory. Pers Individ Dif 2000 Dec;29(6):1153-1162. [CrossRef]
    60. Hexel M. Validierung der deutschen Version des Attachment Style Questionnaire (ASQ) bei Personen mit und ohne psychiatrische Diagnosen. Zeitschrift für Klinische Psychologie und Psychotherapie 2004 Apr;33(2):79-90. [CrossRef]
    61. Gerlsma C, Hale WW. Predictive power and construct validity of the Level of Expressed Emotion (LEE) scale. depressed out-patients and couples from the general community. Br J Psychiatry 1997 Jun;170:520-525. [CrossRef] [Medline]
    62. Zimet GD, Dahlem NW, Zimet SG, Farley GK. The Multidimensional Scale of Perceived Social Support. J Pers Assess 1988;52(1):30-41. [CrossRef]
    63. Grant A, Franklin J, Langford P. The Self-Reflection and Insight Scale: a new measure of private self-consciousness. Soc Behav Pers 2002 Jan 01;30(8):821-835. [CrossRef]
    64. Zygar C, Hagemeyer B, Pusch S, Schönbrodt FD. From motive dispositions to states to outcomes: an intensive experience sampling study on communal motivational dynamics in couples. Eur J Pers 2018 May 01;32(3):306-324. [CrossRef]
    65. Schwarzer R, Jersusalem M. SWE - Skala zur Allgemeinen Selbstwirksamkeitserwartung. ZPID (Leibniz Institute for Psychology) – Open Test Archive 2003. [CrossRef]
    66. Cornblatt BA, Auther AM, Niendam T, Smith CW, Zinberg J, Bearden CE, et al. Preliminary findings for two new measures of social and role functioning in the prodromal phase of schizophrenia. Schizophr Bull 2007 May;33(3):688-702 [FREE Full text] [CrossRef] [Medline]
    67. Frumkin MR, Piccirillo ML, Beck ED, Grossman JT, Rodebaugh TL. Feasibility and utility of idiographic models in the clinic: a pilot study. Psychother Res 2021 Apr;31(4):520-534 [FREE Full text] [CrossRef] [Medline]
    68. Kirley O, Hiekkaranta AP, Kunkels YK, Eisele G, Lüken M, Verhoeven D, et al. The experience sampling method (ESM) item repository. Open Science Framework. 2022 Apr 06.   URL: https://doi.org/10.17605/OSF.IO/KG376 [accessed 2022-06-10]
    69. Aalbers G, McNally RJ, Heeren A, de Wit S, Fried EI. Social media and depression symptoms: a network perspective. J Exp Psychol Gen 2019 Aug;148(8):1454-1462. [CrossRef] [Medline]
    70. Lutz W, Schwartz B, Hofmann SG, Fisher AJ, Husen K, Rubel JA. Using network analysis for the prediction of treatment dropout in patients with mood and anxiety disorders: a methodological proof-of-concept study. Sci Rep 2018 May 18;8(1):7819 [FREE Full text] [CrossRef] [Medline]
    71. Greene T, Gelkopf M, Epskamp S, Fried E. Dynamic networks of PTSD symptoms during conflict. Psychol Med 2018 Oct;48(14):2409-2417. [CrossRef] [Medline]
    72. Vachon H, Viechtbauer W, Rintala A, Myin-Germeys I. Compliance and retention with the experience sampling method over the continuum of severe mental disorders: meta-analysis and recommendations. J Med Internet Res 2019 Dec 06;21(12):e14475 [FREE Full text] [CrossRef] [Medline]
    73. Levinson CA, Hunt RA, Keshishian AC, Brown ML, Vanzhula I, Christian C, et al. Using individual networks to identify treatment targets for eating disorder treatment: a proof-of-concept study and initial data. J Eat Disord 2021 Nov 04;9(1):147 [FREE Full text] [CrossRef] [Medline]
    74. Schoevers RA, van Borkulo CD, Lamers F, Servaas MN, Bastiaansen JA, Beekman ATF, et al. Affect fluctuations examined with ecological momentary assessment in patients with current or remitted depression and anxiety disorders. Psychol Med 2021 Aug;51(11):1906-1915 [FREE Full text] [CrossRef] [Medline]
    75. Levinson CA, Vanzhula I, Brosof LC. Longitudinal and personalized networks of eating disorder cognitions and behaviors: targets for precision intervention a proof of concept study. Int J Eat Disord 2018 Nov;51(11):1233-1243. [CrossRef] [Medline]
    76. Montag C, Sindermann C, Baumeister H. Digital phenotyping in psychological and medical sciences: a reflection about necessary prerequisites to reduce harm and increase benefits. Curr Opin Psychol 2020 Dec;36:19-24. [CrossRef] [Medline]
    77. Dagum P, Montag C. Ethical considerations of digital phenotyping from the perspective of a healthcare practitioner. In: Baumeister H, Montag C, editors. Digital Phenotyping and Mobile Sensing: New Developments in Psychoinformatics. Cham, Switzerland: Springer; 2019:13-28.
    78. van Genugten CR, Schuurmans J, Lamers F, Riese H, Penninx BW, Schoevers RA, et al. Experienced burden of and adherence to smartphone-based ecological momentary assessment in persons with affective disorders. J Clin Med 2020 Jan 23;9(2):322 [FREE Full text] [CrossRef] [Medline]
    79. R Core Team. R: A Language and Environment for Statistical Computing Internet.: R Foundation for Statistical Computing   URL: https://www.R-project.org/ [accessed 2022-06-10]
    80. Hothorn T, Hornik K, van de Wiel MA, Zeileis A. Implementing a class of permutation tests: the coin package. J Stat Soft 2008;28(8):1-23. [CrossRef]
    81. Mansueto AC, Wiers R, van Weert JCM, Schouten BC, Epskamp S. Investigating the feasibility of idiographic network models. PsyArXiv Preprint posted online on December 2, 2020. [CrossRef]
    82. Epskamp S, Cramer AO, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph: network visualizations of relationships in psychometric data. J Stat Soft 2012 May 24;48(4):1-18. [CrossRef]
    83. Isvoranu A, Borsboom D, van Os J, Guloksuz S. A network approach to environmental impact in psychotic disorder: brief theoretical framework. Schizophr Bull 2016 Jul;42(4):870-873 [FREE Full text] [CrossRef] [Medline]
    84. van Nierop M, Viechtbauer W, Gunther N, van Zelst C, de Graaf R, ten Have M, Genetic RiskOUtcome of Psychosis investigators, et al. Childhood trauma is associated with a specific admixture of affective, anxiety, and psychosis symptoms cutting across traditional diagnostic boundaries. Psychol Med 2015 Apr;45(6):1277-1288. [CrossRef] [Medline]
    85. Snijders TAB. Power and sample size in multilevel modeling. In: Everitt BS, Howell DC, editors. Encyclopedia of Statistics in Behavioral Science. Hoboken, NJ: Wiley; Oct 15, 2005:1573.
    86. Gabriel AS, Podsakoff NP, Beal DJ, Scott B, Sonnentag S, Trougakos J, et al. Experience sampling methods: a discussion of critical trends and considerations for scholarly advancement. Organ Res Methods 2018 Oct 07;22(4):969-1006. [CrossRef]
    87. Telford C, McCarthy-Jones S, Corcoran R, Rowse G. Experience sampling methodology studies of depression: the state of the art. Psychol Med 2012 Jun;42(6):1119-1129. [CrossRef] [Medline]
    88. So SH, Peters ER, Swendsen J, Garety PA, Kapur S. Changes in delusions in the early phase of antipsychotic treatment - an experience sampling study. Psychiatry Res 2014 Mar 30;215(3):568-573. [CrossRef] [Medline]
    89. Palmier-Claus JE, Myin-Germeys I, Barkus E, Bentley L, Udachina A, Delespaul PAEG, et al. Experience sampling research in individuals with mental illness: reflections and guidance. Acta Psychiatr Scand 2011 Jan;123(1):12-20. [CrossRef] [Medline]
    90. Ajnakina O, David AS, Murray RM. 'At risk mental state' clinics for psychosis - an idea whose time has come - and gone!. Psychol Med 2019 Mar;49(4):529-534. [CrossRef] [Medline]
    91. Piccirillo ML, Rodebaugh TL. Foundations of idiographic methods in psychology and applications for psychotherapy. Clin Psychol Rev 2019 Jul;71:90-100. [CrossRef] [Medline]
    92. Roefs A, Fried EI, Kindt M, Martijn C, Elzinga B, Evers AW, et al. A new science of mental disorders: using personalised, transdiagnostic, dynamical systems to understand, model, diagnose and treat psychopathology. Behav Res Ther 2022 Jun;153:104096 [FREE Full text] [CrossRef] [Medline]
    93. Wright AGC, Zimmermann J. Applied ambulatory assessment: integrating idiographic and nomothetic principles of measurement. Psychol Assess 2019 Dec;31(12):1467-1480 [FREE Full text] [CrossRef] [Medline]
    94. Insel TR. Digital phenotyping: technology for a new science of behavior. JAMA 2017 Oct 03;318(13):1215-1216. [CrossRef] [Medline]
    95. Insel TR. Digital phenotyping: a global tool for psychiatry. World Psychiatry 2018 Oct;17(3):276-277 [FREE Full text] [CrossRef] [Medline]
    96. Baumeister H, Montag C, editors. Digital Phenotyping and Mobile Sensing: New Developments in Psychoinformatics. Cham, Switzerland: Springer; 2019.

    ‎
    ESM: Experience Sampling Method
    FETZ: Früherkennungs- und Therapiezentrum (the early recognition center of mental disorders at the University Hospital of Cologne)
    mlVAR: multilevel vector autoregressive

    Edited by T Leung; submitted 25.11.21; peer-reviewed by M Drukker, RP Rajkumar; comments to author 14.03.22; revised version received 11.05.22; accepted 12.05.22; published 01.08.22

    Copyright

    ©Marlene Rosen, Linda T Betz, Christian Montag, Christopher Kannen, Joseph Kambeitz. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 01.08.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.