This paper is in the following e-collection/theme issue:

Grant Proposals (funded, non-ehealth) (68)

Published on in Vol 9, No 10 (2020): October

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/18673, first published .
Determinants of Medical Practice Variation Among Primary Care Physicians: Protocol for a Three Phase Study

Determinants of Medical Practice Variation Among Primary Care Physicians: Protocol for a Three Phase Study

Determinants of Medical Practice Variation Among Primary Care Physicians: Protocol for a Three Phase Study

Authors of this article:

Sagi Shashar1 Author Orcid Image ;   Shlomi Codish2 Author Orcid Image ;   Moriah Ellen3, 4, 5 Author Orcid Image ;   Ehud Davidson6 Author Orcid Image ;   Victor Novack1 Author Orcid Image
Article Authors Cited by (4) Tweetations (1) Metrics

    Proposal

    1Clinical Research Center, Soroka University Medical Center and Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel

    2Soroka University Medical Center and Faculty of Health Sciences, Ben-Gurion University of the Negev, Beer-Sheva, Israel

    3Department of Health Services Management, Guilford Glazer Faculty of Business and Management, Ben Gurion University, Beer-Sheva, Israel

    4Institute of Health Policy Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada

    5McMaster Health Forum, McMaster University, Hamilton, ON, Canada

    6General Management, Clalit Health Services, Tel Aviv, Israel

    Corresponding Author:

    Sagi Shashar, MSc

    Clinical Research Center

    Soroka University Medical Center and Faculty of Health Sciences

    Ben-Gurion University of the Negev

    PO Box 151

    Beer-Sheva, 84101

    Israel

    Phone: 1 6244240

    Email: sagishas@post.bgu.ac.il


    Background: One of the greatest challenges of modern health systems is the choice and use of resources needed to diagnose and treat patients. Medical practice variation (MPV) is a broad term which entails the differences between health care providers inclusive of both the overuse and underuse. In this paper, we describe a 3-phase research protocol examining MPV in primary care.

    Objective: We aim to identify the potential targets for behavioral modification interventions to reduce the variation in practice patterns and thus improve health care, decrease costs, and prevent disparities in care.

    Methods: The first phase will delineate the variation in primary care practice over a wide range of services and long follow-up period (2003-2017), the second will examine the 3 determinants of variation (ie, patient, physician, and clinic characteristics), and attempt to derive the unexplained variance. In the third phase, we will assess a novel component that might contribute to the previously unexplained variance - the physicians’ personal behavioral characteristics (such as risk aversion, fear of malpractice, stress from uncertainty, empathy, and burnout).

    Results: This work was supported by the research grant from Israel National Institute for Health Policy Research (Grant No. 2014/134). Soroka University Medical Center Institutional Ethics Committee has approved the updated version of the study protocol (SOR-14-0063) in February 2019. All relevant data for phases 1 and 2, including patient, physician, and clinic, were collected from the Clalit Health Services data set in 2019 and are currently being analyzed. The evaluation of the individual physician characteristics (eg, risk aversion) by the face-to-face questionnaires was started on 2018 and remains in progress. We intend to publish the results during 2020-2021.

    Conclusions: Based on the results of our study, we aim to propose a list of potential targets for focused behavioral intervention. Identifying new targets for such an intervention can potentially lead to a decrease in the unwarranted variation in the medical practice. We suggest that such an intervention will result in optimization of the health system, improvement of health outcomes, reduction of disparities in care and savings in cost.

    International Registered Report Identifier (IRRID): DERR1-10.2196/18673

    JMIR Res Protoc 2020;9(10):e18673

    doi:10.2196/18673

    Keywords

    medical practice variation; variation determinants; primary care physicians; personal behavioral characteristics 


    Background

    Health care spending worldwide continues to increase and now accounts for approximately 17% of the gross domestic product in the United States, 9.8% in the Organisation for Economic Co-operation and Development (OECD) countries, and 7.5% in Israel [1]. Most experts consider the level of health care spending in the United States unsustainable [2]. Health economists identify unnecessary diagnostic and screening tests as a primary driver of this spending [2-5]. Moreover, many studies have shown that overuse neither benefits health care nor health outcomes [6-9] and may have adverse effects [10], leading to more unnecessary tests and treatment [11]. Major attempts to prevent the overuse of health services (HSs) include the British Medical Journal series Too Much Medicine [12], established in 2002, and Choosing Wisely campaigns [13], established in 2012. Increasing interest in this area is also reflected by the growing number of books, literature, and articles in the mainstream media [14].

    Medical Practice Variation

    In this study we chose to investigate medical practice variation (MPV), coined by the Dartmouth research group [15,16]. While MPV is based on a relative comparison between providers (Figure 1), overuse and underuse definitions call for a comparison between the individual provider practice and standard of care (absolute comparison) based on a “gold standard” or guideline recommendations [16,17]. Both overuse and underuse (eg, patients not receiving optimal care and resources used inefficiently) have negative consequences [14] and can contribute to MPV [15]. MPV is associated with poorer health outcomes, increased costs, disparities in care, and burden on medical systems [14,17-21]. Adopting the policy aimed to reduce variation is a central theme of quality management that has begun with industrial production and was recently adopted in medicine practice [19,22,23].

    ‎
    Figure 1. Two types of variation.
    View this figure

    Not all MPV has pernicious effects. One should distinguish between unwarranted and warranted MPV. Warranted MPV reflects patient-centered care as it takes into account patient differences such as clinical or patient-preference differences [20,24]. Unwarranted MPV is caused by many factors such as variable access to resources or differing physician opinions and preferences [15,16]. In our study, we try to focus on factors contributing to the unwarranted MPV.

    MPV Determinants

    MPV causes can be divided into 3 main domains: patient characteristics, health care system characteristics, and physician characteristics [25,26]. Existing research suggests that variation is mainly attributable to patient characteristics, rather than to physician, or clinic [27-31]. Patient-related factors frequently studied in primary care [32] included age [33,34], type and severity of illness [33-35], socioeconomic status [36-39], ethnicity/race [40-42], and expectations of treatment effect [34,35,43,44]. Clinic factors included size [38,39,45,46], workload [46-48], funding method [49], services availability [35,50,51], services cost [52,53], and rural/urban location [15,34,54-56].

    Factors related to the primary care physicians can be divided into demographic/professional and psychological characteristics. Demographic/professional characteristics include age, gender [33,42,46,47,57,58], specialty [38,58], area of expertise [36,47,57,59], and years of practice [33,46,58,60,61]. The psychological characteristics are discussed further on in the manuscript.

    Unexplained Variance

    It appears that the major part of the variation is unexplained [31,62,63], that is, there are more influential factors that were not adequately estimated and researched so far [64], such as system-level and physician-level psychological characteristics. Assessing the extent of the variance that can be explained by the physicians’ psychological characteristics is essential because it will allow us to develop behavior modification tools that might help in reducing MPV [25]. Targeted interventions that address these variables might successfully optimize test ordering. The physician psychological characteristics include personality [65], attitudes [66], or behavior [67].

    There is no generally agreed upon definition of personality, yet it is defined as person’s stable feelings, thoughts, and behavioral patterns [68]. The Big Five dimensions of personality are openness, conscientiousness, extraversion, agreeableness, and neuroticism [69]. Attitude refers to one’s opinions, beliefs, and feelings about aspects of his/her work environment. Two job attitudes have the greatest potential to influence how people behave at work: job satisfaction (feelings people have toward their job) and organizational commitment (the emotional attachment people have toward the company they work for) [68].

    Compared with personality and attitudes, behavior is less abstract and more measurable, objective, and quantified and also it encompasses the other variables as it is a derivative of them [67,70]. Therefore we chose to focus on the physicians’ behavior characteristics. Four types of behaviors have been extensively studied in the organizational behavior literature: job performance, organizational citizenship behaviors, absenteeism, and turnover [68]. Our research, which studies the referral rates of the physicians, is related to the job performance behavior. Job performance refers to the success that one accomplishes in the tasks listed in his/her job description. Factors related to a physician’s job performance and medical decision making are the way s/he is treated at work, cognitive shortcuts (heuristics), the level of stress experienced at work, work attitudes to risks, and emotion [68,70].

    Personal Behavioral Characteristics

    Personal behavioral characteristics studied to date with respect to unwarranted variation included risk attitudes [58,71-74], adherence to treatment guidelines [50,75-78], empathy [79], and fear of malpractice [80]. We believe that the comprehensive approach where we will investigate the effect of risk aversion, stress due to uncertainty, fear of malpractice, empathy, and burnout will bring a higher level of inference as each can be reliably measured and may uniquely and independently account for significant MPV.

    Risk Aversion

    Risk aversion is the tendency to minimize risk by choosing known options with more certain, but less beneficial, expected outcomes [81]. A risk averse physician, for example, might refer a patient for tests with an unclear, yet not urgent clinical presentation, despite the potential increase in cost and detrimental effect of unnecessary test. MPV studies show that longer cardiopulmonary resuscitation [74], higher use of laboratory services [71,72,82,83], more referrals [58,74], and higher admission rate to an intensive care unit [84] are associated with higher risk aversion. None to date, however, have examined the proportion of variance in the decision making that can be explained by risk aversion level.

    We believe that the increased understanding of the mechanisms of risk-taking and risk-aversion behavior (eg, reward sensitivity, impulsiveness, and social anxiety) may suggest ways in which intervention programs can be designed and administered to be sensitive to individual differences between the physicians [85].

    Stress From Uncertainty

    Uncertainty is common among physicians who must make decisions based on incomplete and imperfect data, with unpredictable patient responses to testing and treatment [86]. Primary care physicians experience more uncertainty than specialists due to the breadth and complexity of scope, generalist orientation, focus on continuity, and psychosocial factors [87]. Previous research has shown that physician uncertainty is associated with MPV [32,87,88], yet again the extent to which it explains variance in the practice patterns has not been studied.

    Fear of Malpractice Claims

    Defensive medicine is defined as the ordering of tests, procedures, and patient visits for the purpose of averting malpractice [89]. A nationwide study of Israeli physicians concluded that defensive medicine is prevalent, mostly resulting in unnecessary tests, referrals to consultants, and hospitalizations [90]. Primary care physicians have historically experienced low rates of malpractice claims, attributed to the high regard for them in their communities, low numbers of invasive procedures, and mutual trust and communication developing with patients over time. In the most recent Medscape Malpractice report [91], primary care was not on the list of the top 10 specialties for lawsuits. However, recent years have seen an increase in the incidence of the malpractice claims in primary care [92]. Therefore, estimating the contribution of malpractice to MPV may be important as it may influence the physicians’ practice patterns and thus the variation between them.

    Burnout

    Burnout is increasing among general physicians [93] and associated with self-reported errors among primary care physicians and longer consultations [94]. However, it has neither been associated with overuse nor examined as a determinant of MPV. We assume that physicians with higher levels of burnout may have less variation in their HS utilizations and may be overused. This is because their discretion is consistently influenced by their mood and lack of motivation than by their patients’ medical needs.

    Empathy

    It has been shown that perceptions of patient needs, feelings, and primary care physicians’ ability to recognize emotions affect how they order tests [95]. For instance, physicians rated higher for empathy had a greater preference for intubation, ordered more laboratory tests, and performed cardiopulmonary resuscitation for longer periods [79]. Yet, it has not been proved as a determinant of MPV.

    Why Primary Care?

    While most MPV research has focused on secondary and tertiary care in health regions and hospitals [15], this study examines MPV across primary care physicians. Primary care accounts for 14% of all health care spending on average across OECD countries with patient–physician consultations accounting for the majority (55% in the United States; 90% in the UK) [96]. Determining what accounts for MPV in primary care can help to develop targeted approaches for preventing unnecessary tests and treatment, better care coordination, cost containment, and improved health outcomes.

    Israel’s Health System

    In 2019, Israel was ranked the 10th healthiest country in the world by Bloomberg rankings, out of 169 countries [97]. The National Health Insurance Law of 1995 mandates all citizens resident in the country to join 1 of the 4 official not-for-profit health maintenance organizations, which are prohibited by law from denying any Israeli resident a membership [98]. The study is placed in the Southern District of Israel, the Negev, and includes physicians and patients of the Clalit Health Services health maintenance organizations, the largest health insuring organization in Israel (4.5 million insurees). Clalit Health Services is the largest health care provider in the area, covering approximately 70% of a population of 730,000 residents in the Negev.

    Health Services

    In this study we aimed to analyze HSs in the primary care in situations where the physician has the freedom of action to decide whether to utilize them [99], that is, clinical scenarios with discretionary decisions [100]. For instance, referring a patient with ST-elevation myocardial infarction to the hospital is not a discretionary decision as the physician’s findings reflect an undoubtable urgent condition of myocardial infarction which can be cured in a catheterization room. But ordering a thyroid-stimulating hormone (TSH) test for a patient with generalized weakness is discretionary, because weakness is a nonspecific symptom which can be caused by many factors such as an infection, anemia, inflammation. For these discretionary HSs, different choices carry different benefits and risks and therefore we believe that physicians will differ in the decisions [101,102], based on their knowledge, experience, beliefs, and thoughts. We hypothesize that the derivative of these components, the physician personal behavioral patterns, can significantly influence the utilization of the services in this category. Therefore, we identified the 16 most frequently utilized HSs in primary care that can be discretionary.

    • Four imaging tests: bone scans, computed tomography of the brain and spine, chest x-ray, magnetic resonance imaging;
    • A composite of cardiac tests including Holter electrocardiography (ECG), echocardiogram, stress test, and transesophageal echocardiography;
    • Six laboratory tests: vitamin B12, vitamin D, TSH, hemoglobin, carcinoembryonic antigen, prostate-specific antigen;
    • Three specialist consultation visits: rheumatology, pulmonary, and neurology;
    • Two emergency department visits due to chest pain or back pain.

    Objectives and Hypothesis

    This paper describes a 3-phase research protocol (Figure 2) of MPV of primary care physicians across 16 HSs in the largest health care network in Southern Israel (Clalit Health Services) between 2003 and 2017.

    ‎
    Figure 2. Study flowchart - medical practice variation assessment.
    View this figure

    The study’s objectives are to (1) describe the variation of HSs referrals among primary care physicians; (2) derive the unexplained variance after the adjustment for patient, physician, and clinic characteristics; (3) assess the extent to which the personal behavioral characteristics of the primary care physicians contribute to the explanation of the unexplained variance; and (4) identify the potential targets for behavioral modification interventions to reduce the variation in practice patterns and thus improve health care, decrease costs, and prevent disparities in care.

    We hypothesize that the physicians’ personal behavioral characteristics such as risk aversion, stress due to uncertainty, fear of malpractice level of empathy, and burnout are affecting the decision-making process as demonstrated by the different levels of their HSs referrals.

    Patient and Public Involvement

    This research was done without patient involvement. Patients were not invited to comment on the study design and were not consulted to develop patient-relevant outcomes or interpret the results. Patients were not invited to contribute to the writing or editing of this document for readability or accuracy.


    Study Phases

    The first phase will delineate the variation in primary care practice over a wide range of services and long follow-up period, the second will examine the 3 determinants of variation (ie, patient, physician, and clinic characteristics) and attempt to derive the unexplained variance. In the third phase, we will assess a novel component that might contribute to the previously unexplained variance—the physicians’ personal behavioral characteristics such as risk aversion, fear of malpractice, stress from uncertainty, empathy, and burnout.

    Data Collection

    Data will be collected from the computerized medical records of Clalit Health Services and will include (1) patient data (age, sex, marital status, residence type [urban, rural, or nomadic], number of annual visits by community physicians, background diseases, and socioeconomic status according to address); (2) primary care physician data (age, sex, years of active practice, area of expertise, specialty, country of birth, familial status, ethnicity, country where medical studies were completed, and number of insured patients in the physician’s unit); (3) clinic data (number of insured patients per doctor, number of physicians per 1000 patients, number of annual visits, location [rural/urban]); (4) HS data (annual referral number per physician per clinic for bone scan, computed tomography, chest x-ray, magnetic resonance imaging, Holter ECG, echocardiogram, stress test, transesophageal echocardiography, vitamin B12 test, vitamin D test, TSH test, hemoglobin test, carcinoembryonic antigen test, prostate-specific antigen test; specialist consultation visits for rheumatology, pulmonary, and neurology; and emergency department visits due to chest pain and back pain).

    The unit of analysis is physician/clinic/year. Each patient is assigned to 1 primary care physician and thus all data will be assigned annually to a physician per clinic. The HSs data will be extracted by numerical ID codes given for each HS.

    Phase 1: Measuring and Describing Variation Among the Primary Care Across 16 HSs

    In this initial phase of the research, we set out to identify MPV patterns by describing and comparing variation between HSs. Our first objective is to identify the main component of variation, that is, which variation is larger, between physicians or within the physician over time (interphysician vs. intraphysician variation). Additionally, we sought to identify which HSs have the highest variation and investigate their common characteristics.

    The interphysician variation is the difference in utilization rates between physicians for a given HS, and the intraphysician or within-physician variation is the difference in practice pattern of an individual physician over the years. The difference between the 2 is illustrated in Figure 1. Most research to date examines variation in practice behavior between health care providers at one point in time, not within-physician variation over time. By delineating the 2 (between vs within), we can determine which accounts for a greater proportion of MPV (ie, relative importance of between- and within-physician variation) and what factors predict each. This information is germane to the policy makers, helping them determine where to direct efforts to reduce MPV. For instance, if within-physician variation accounts for a significant proportion of MPV, resources and efforts should be directed at fostering consistent physician clinical behavior over time. However, if between-physician variation is greater, efforts should be directed to assist overusing and underusing physicians to accommodate their utilization patterns to the appropriate level.

    Statistical Analysis: Coefficient of Variation

    Operational definitions and methods used to describe variation are diverse and inconsistent. Different authors have defined variation as absolute values [103,104]; rates [105,106]; ratios between tests [107,108] or 90th/10th percentiles [108,109]; and percentages of the overuse/underuse [96,110] or utilization [109,111] or inappropriate use [112]. We instead will measure variation using the coefficient of variation (COV), which is the ratio of the SD to the mean (SD/mean × 100). It represents the percent of the dispersion out of the central tendency, where higher values indicate larger difference between values (ie, higher variation). The COV is a standardized measurement; however, determining high variation for low-utilized HSs is considered overestimation [26], and therefore should be interpreted with caution.

    The numerical levels (threshold) of COVs defining high versus low utilization differ across fields of science [113,114] and are not defined in MPV research literature [115]. Because it is a frequently used measure in the field of health policy research, there is a need for a consensus as to what represents high or low variation for each particular service [116].

    To compare the utilization levels between physicians in each HS, we plan to calculate annual utilization rates per 1000 patients: ([utilization levels/total insured patients affiliated to the physician] × 1000 patients). Further, for each HS we will calculate between-physician COVs based on the averaged physicians’ rates and within-physicians’ COVs by the averaged individual physicians rates over the years of practice.

    Correlation Between Variation and Utilization Levels

    To identify potential MPV patterns, we will examine correlations between the averaged between- and within-physician variations and utilizations at the HSs level. For this analysis, we will use the Spearman test and chart the HSs’ averaged utilizations and COVs to enable visual comparisons.

    In conclusion for this phase, we intend to describe the MPV pattern among primary care physicians, identify the source of a greater variation component (between vs within), and the HSs with higher variation and higher utilization rates.

    Phase 2: Determinants of the Variation

    After describing the MPV patterns in primary care, we will then assess its determinants. The primary objective of the second phase is to estimate the extent to which each determinant explains the variation and to deduce the overall unexplained variance (Figure 2). In this stage we will collect a wide range of variables related to the domains, calculate the adjusted variance, and the proportional change in the variance (PCV) [117].

    Statistical Analysis

    PCV will be computed to determine the proportion of variance accounted for by each domain (patient, physician, clinic) across all HSs, using the following formula: PCV=(Vn1–Vn2)/Vn1. First, for each HS we will calculate the crude variance (Vn1), then, we will compute 3 regression models, each including covariates related to the domain. According to the models’ predicted values, we will calculate the adjusted variance (Vn2), expecting a decrease from the crude variance. Then, for each HS we will calculate 3 PCVs, 1 for each domain, assessing the percent of the variance explained by each domain. The larger the PCV (ie, the larger the difference between crude and adjusted variances), the greater the variance explained by that domain. Consequently, we will determine which domain explains most of the variance across all HSs, and will be able to estimate the overall unexplained variance.

    Prediction Model

    As previously mentioned, we will perform regression model analysis to derive the adjusted variances for patient, physician, and clinic characteristics. We will utilize generalized linear negative binomial mixed models, the annual HSs utilizations as outcomes (nominator), and the annual insured patients per physician as the outcome’s offset (denominator), and thus, defining the rates, the “count” variable of the negative binomial distribution. Physicians, clinics, and years (to account for secular and trajectory trends) will be defined as random effect clusters and patient, physician, and clinic characteristics will be included as fixed covariates separately. We will use “glmmTMB” R package (R Foundation for Statistical Computing), version 1.0.136 and IBM SPSS, version 24 for statistical analysis.

    Phase 3: Personal Behavioral Characteristics Affecting the Variation

    In this phase we will visit the clinics and ask the physicians to fill 5 short, validated research questionnaires measuring risk aversion, stress from uncertainty, fear from malpractice, empathy, and burnout [74,118]. We assume that these behavior characteristics are substantially stable [119,120] as well as the practice habits [121]. For instance, burnout [122] or stress from uncertainty is not a temporary emotion, but rather stable, as both are incurred by the properties of the specialty and the physician’s capabilities and characteristics which tend to be fixed [122]. However, to be aligned with the most accurate and updated behaviors and practice habits, we chose in phase 3 to include physicians who worked also during 2017 (approximately 180) as we started to interview them in 2018. Furthermore, we will exclude physicians who worked starting from 2017, as the within-physician variation cannot be assessed for them. To increase the response rate, we plan to conduct face-to-face sessions during which the physicians will be asked to complete the questionnaires. We expect to achieve a response rate of more than 75%.

    Questionnaires Scales

    The risk-taking scale is a validated subset of the Jackson Personality Index that measures general risk-taking behavior in emergency physicians [89,123,124] and has 6 items, each rated on a 6-point Likert scale. Possible scores range from 6 to 36, and higher scores correspond to increased risk-taking [125,126]. The stress due to uncertainty is a validated psychometric tool, with a Cronbach alpha of .90 [127], that measures physician’s stress due to uncertainty in patient care. It has 13 items, each rated on a 6-point Likert scale. Possible scores range from 13 to 78, with higher scores corresponding to higher stress due to uncertainty. The Malpractice Fear Scale is a validated scale, with a Cronbach alpha of .88 [93] that measures fear of malpractice in primary care and emergency physicians [58,123,128,129]. It has 6 items, each rated on a 5-point Likert scale, while possible scores range from 5 to 30, with higher scores corresponding to increased fear of malpractice. Empathy will be assessed by the Jefferson Scale of Physician Empathy, which consists of 20 items, with each rated on a 7-point Likert scale. Higher sum-scores indicate higher levels of empathy. The scale has been validated by explorative factor analysis and test–retest reliability [130]. Burnout will be assessed by the Maslach Burnout Inventory Human-Services-Survey [131], which has been used in more than 90% of empirical studies on burnout globally [132]. The Maslach Burnout Inventory – Human Services Survey consists of 22 items scored on a 7-point Likert scale constituting 3 subscales: (1) emotional exhaustion (9 items); (2) depersonalization (5 items); and (3) personal accomplishment (8 items). Burnout is defined as either a high score on the emotional exhaustion subscale or a high score on the depersonalization subscale or a low score on the personal accomplishment scale [131].

    Statistical Analysis

    During the analytic phase we will first compare the patient case mix and clinic and demographic characteristics between respondents and nonrespondents. This will allow us to estimate the degree of the potential bias in the analysis of the practice patterns. Then, we will assess the extent to which personal behavioral characteristics (ie, risk aversion, stress due to uncertainty, fear of malpractice, empathy, and burnout) contribute to the explanation of the unexplained variance defined in the previous phase, using the PCV approach. We hypothesize that high rates of HSs referrals will be associated with high levels of risk aversion, stress due to uncertainty, fear of malpractice, empathy, and burnout.

    Ethics Approval and Consent to Participate

    The study was approved by the Soroka University Medical Center Institutional Ethics Committee (0063-14-SOR). The consent to participate was written as part of the questionnaires.

    Availability of Data and Material

    The data sets that will be used or analyzed during this study will be available following local Ethics Committee approval.


    This work is supported by the research grant from Israel National Institute for Health Policy Research (2014/134). The funding agency has no input on the study design or execution. Our study protocol has undergone peer review by the funding body.

    Soroka University Medical Center Institutional Ethics Committee has approved the updated version of the study protocol (SOR-14-0063) named “Determinants of Medical Practice Variation among Primary Care Physicians,” in February 2019. The approval is valid until March 2021 and can be extended by request.

    All the data for phase 1 (assessment of the cured variation) and phase 2 (derivation of the adjusted variation) including patient, physician, and clinic data were collected from the Clalit Health Services data set in 2019 and are currently being analyzed. The evaluation of the physicians’ personal behavioral characteristics by the face-to-face questionnaires (phase 3) was started in 2018 and remains in progress. We intend to publish the results during 2020-2021.


    Overview

    This study will allow us to approach the challenge of the targeted MPV reduction policies by answering a number of questions: What is the degree of the variation and what services have higher variation rates? Which variation is larger: between the physicians or within the physicians over time? What part of the variation cannot be explained by the patient case mix, clinic characteristics, or professional characteristics of the physician? Can physician personal behavioral characteristics explain part of the variation?

    Risks and Limitations

    Our current study focuses on the variation in the practice patterns, yet we cannot infer the clinical appropriateness of the HSs used. In more general terms we will be not able to deduce what physician is practicing “good” medicine—the one who sends patients to a lot of tests or the one who sends few. Yet, because MPVs have been previously shown to be associated with poorer health outcomes [14,17-19,21], we believe that focusing on the measurement and dissection of the variation itself can contribute to the development of the approaches to reduce the MPV.

    Another major limitation of the variation research in medicine is that acceptable values for variation are not defined. Therefore, we will be able only to have a relative comparison identifying factors associated with a higher variation (eg, physician characteristics, specific services).

    Furthermore, in some circumstances the utilization of the HSs we are assessing can be considered not discretionary; for example, emergency department visits due to ECG presenting ST elevations in the primary care clinic, vitamin B12 laboratory tests for macrocytic anemia, or chest X-rays for chest injuries. However, the inclusion of these events decreases the variation and thus results in the bias toward zero (null hypothesis).

    Moreover, our study precludes system-level factors such as resource constraints, process, workflow issues, funding, services accessibility. This is because we chose to focus on the physician level, not the system level. Therefore, we are only including patients and physicians belonging to 1 health care network (Clalit Health Services), thereby controlling for some of the system-level variation. However, it is possible that the variation between health care networks in the public health system in Israel is limited as the law controls their services’ provision and accessibility, and thus reduces disparities in care. These health care networks are not-for-profit and are prohibited by law from denying any Israeli resident a membership. Yet, between regions in Israel there is a variation in the mentioned factors and therefore our findings can be generalized onto other regions and countries only after accounting for the patterns of this region.

    At the final stage of our research we aim to identify behavioral characteristics associated with a higher variation by applying validated questionnaires. Physicians’ attitudes as assessed by the abstract questionnaires may not fully represent their action in real-life clinical practice. Future research should aim at developing more reliable tools for assessing behavioral components of physicians practice.

    The conventional risk of questionnaire-based research is a low response rate. To address this concern, we schedule face-to-face sessions with each one of the physicians enrolled into the study.

    Outcomes of the Research Program

    We expect to analyze a total of 3 million patient years and 6.5 million test utilizations across 16 diverse HSs, referred by 250 physicians in 170 clinics, over 15 years of practice. The size and comprehensiveness of the data will provide a good reassurance for the robustness and generalizability of the research program.

    Focusing on the physician personal behavioral characteristics as a major contributing factor to the variation is essential, because it may allow us to identify what are the likely sources of unwarranted variation that can be redressed. We believe that most of the variation explained by patient or clinic characteristics is generally reasonable (eg, greater use by ill and older patients) [20]. However, variation stemming from the physician personal behavior characteristics might be unwarranted and can be reduced without negatively affecting patient care.

    Based on the results of our study, we aim to propose a list of potential targets for focused behavioral intervention. The research of behavioral interventions designed for physicians is limited, and describes only a handful of strategies. The most common approaches focusing on changing the practice habits include clinical decision support, shared decision making, pay-for-performance, and insurer restrictions [133]. We believe that identifying new targets for such an intervention during the digital health era can potentially lead to a decrease in the unwarranted variation in the medical practice and thus to the improvement of health outcomes, reduction of disparities in care, and cost savings.

    Acknowledgments

    This work was supported by the research grant from Israel National Institute for Health Policy Research (Grant No. 2014/134). The funding agency has no input on the study design or execution. Our study protocol has not undergone peer review by the funding body.

    Authors' Contributions

    SS made substantial contributions to the design of the work and writing; SC and ED made substantial contributions to the conception and revision of the draft; VN and ME made substantial contributions to the design, substantively revised the work, and approved it.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Peer-review reports.

    PDF File (Adobe PDF File), 195 KB
    1. OECD. Health Resources/Health Spending/OECD Data. 2019.   URL: http://data.oecd.org/healthres/health-spending.htm [accessed 2020-09-02]
    2. Maurer D, Stephens M, Reamy B, Crownover B, Crawford P, Chang T. Family physicians' knowledge of commonly overused treatments and tests. J Am Board Fam Med 2014;27(5):699-703 [FREE Full text] [CrossRef] [Medline]
    3. Iglehart JK. Health insurers and medical-imaging policy--a work in progress. N Engl J Med 2009 Mar 05;360(10):1030-1037. [CrossRef] [Medline]
    4. Lang K, Huang H, Lee DW, Federico V, Menzin J. National trends in advanced outpatient diagnostic imaging utilization: an analysis of the medical expenditure panel survey, 2000-2009. BMC Med Imaging 2013 Nov 26;13:40 [FREE Full text] [CrossRef] [Medline]
    5. Smith-Bindman R, Miglioretti DL, Johnson E, Lee C, Feigelson HS, Flynn M, et al. Use of diagnostic imaging studies and associated radiation exposure for patients enrolled in large integrated health care systems, 1996-2010. JAMA 2012 Jun 13;307(22):2400-2409 [FREE Full text] [CrossRef] [Medline]
    6. Lehnert BE, Bree RL. Analysis of appropriateness of outpatient CT and MRI referred from primary care clinics at an academic medical center: how critical is the need for improved decision support? J Am Coll Radiol 2010 Mar;7(3):192-197. [CrossRef] [Medline]
    7. Chou R, Fu R, Carrino JA, Deyo RA. Imaging strategies for low-back pain: systematic review and meta-analysis. Lancet 2009 Feb 07;373(9662):463-472. [CrossRef] [Medline]
    8. Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL. The implications of regional variations in Medicare spending. Part 1: the content, quality, and accessibility of care. Ann Intern Med 2003 Feb 18;138(4):273-287. [CrossRef] [Medline]
    9. Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL. The implications of regional variations in Medicare spending. Part 2: health outcomes and satisfaction with care. Ann Intern Med 2003 Feb 18;138(4):288-298. [CrossRef] [Medline]
    10. Starfield B, Shi L, Grover A, Macinko J. The effects of specialist supply on populations' health: assessing the evidence. Health Aff (Millwood) 2005 Jun;Suppl Web Exclusives:W5-97. [CrossRef] [Medline]
    11. Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, et al. Appropriate use of screening and diagnostic tests to foster high-value, cost-conscious care. Ann Intern Med 2012 Jan 17;156(2):147-149. [CrossRef] [Medline]
    12. 2020.   URL: https://www.bmj.com/too-much-medicine [accessed 2019-05-01]
    13. 2020.   URL: http://www.choosingwisely.org/ [accessed 2019-05-01]
    14. Duddy C, Wong G. Explaining variations in test ordering in primary care: protocol for a realist review. BMJ Open 2018 Sep 12;8(9):e023117 [FREE Full text] [CrossRef] [Medline]
    15. Corallo AN, Croxford R, Goodman DC, Bryan EL, Srivastava D, Stukel TA. A systematic review of medical practice variation in OECD countries. Health Policy 2014 Jan;114(1):5-14. [CrossRef] [Medline]
    16. Goodman DC, Goodman AA. Medical care epidemiology and unwarranted variation: the Israeli case. Isr J Health Policy Res 2017 Feb 20;6(1). [CrossRef]
    17. Krumholz HM. Variations in health care, patient preferences, and high-quality decision making. JAMA 2013 Jul 10;310(2):151-152 [FREE Full text] [CrossRef] [Medline]
    18. John H. The Role of Clinical Variation in Medical Practice. Clinical Variation in Your Medical Organization?. 2020.   URL: https://www.healthcatalyst.com/role-clinical-variation-medical-practice
    19. Berwick DM. Controlling variation in health care: a consultation from Walter Shewhart. Med Care 1991 Dec;29(12):1212-1225. [CrossRef] [Medline]
    20. Mercuri M, Gafni A. Examining the role of the physician as a source of variation: Are physician-related variations necessarily unwarranted? J Eval Clin Pract 2018 Feb;24(1):145-151. [CrossRef] [Medline]
    21. KaiserFamFound. Disparities in Health and Health Care: Five Key Questions and Answers: @KaiserFamFound; 2018.   URL: https:/​/www.​kff.org/​disparities-policy/​issue-brief/​disparities-in-health-and-health-care-five-key-questions-and-answers/​ [accessed 2019-05-01] [WebCite Cache]
    22. Mullan F. Wrestling With Variation: An Interview With Jack Wennberg. Health Affairs 2004 Jan;23(Suppl2):VAR-73-VAR-80. [CrossRef]
    23. Fung V, Schmittdiel JA, Fireman B, Meer A, Thomas S, Smider N, et al. Meaningful variation in performance: a systematic literature review. Med Care 2010 Feb;48(2):140-148. [CrossRef] [Medline]
    24. Mercuri M, Gafni A. Medical practice variations: what the literature tells us (or does not) about what are warranted and unwarranted variations. J Eval Clin Pract 2011 Aug;17(4):671-677. [CrossRef] [Medline]
    25. Sood R, Sood A, Ghosh AK. Non-evidence-based variables affecting physicians' test-ordering tendencies: a systematic review. Neth J Med 2007 May;65(5):167-177 [FREE Full text] [Medline]
    26. O’Sullivan JW, Stevens S, Oke J, Hobbs FDR, Salisbury C, Little P, et al. Practice variation in the use of tests in UK primary care: a retrospective analysis of 16 million tests performed over 3.3 million patient years in 2015/16. BMC Med 2018 Dec 20;16(1). [CrossRef]
    27. Orueta JF, García-Alvarez A, Grandes G, Nuño-Solinís R. The Origin of Variation in Primary Care Process and Outcome Indicators: Patients, Professionals, Centers, and Health Districts. Medicine (Baltimore) 2015 Aug;94(31):e1314 [FREE Full text] [CrossRef] [Medline]
    28. Singh S, Lin Y, Kuo Y, Nattinger AB, Goodwin JS. Variation in the risk of readmission among hospitals: the relative contribution of patient, hospital and inpatient provider characteristics. J Gen Intern Med 2014 Apr;29(4):572-578 [FREE Full text] [CrossRef] [Medline]
    29. Beaulieu M, Haggerty J, Tousignant P, Barnsley J, Hogg W, Geneau R, et al. Characteristics of primary care practices associated with high quality of care. CMAJ 2013 Sep 03;185(12):E590-E596 [FREE Full text] [CrossRef] [Medline]
    30. Sándor J, Nagy A, Jenei T, Földvári A, Szabó E, Csenteri O, et al. Influence of patient characteristics on preventive service delivery and general practitioners’ preventive performance indicators: A study in patients with hypertension or diabetes mellitus from Hungary. European Journal of General Practice 2018 Aug 02;24(1):183-191. [CrossRef]
    31. Davis P, Gribben B, Lay-Yee R, Scott A. How much variation in clinical activity is there between general practitioners? A multi-level analysis of decision-making in primary care. J Health Serv Res Policy 2002 Oct;7(4):202-208. [CrossRef] [Medline]
    32. Davis P, Gribben B, Scott A, Lay-Yee R. The. Soc Sci Med 2000 Feb;50(3):407-418. [CrossRef] [Medline]
    33. Tan A, Zhou J, Kuo Y, Goodwin JS. Variation among Primary Care Physicians in the Use of Imaging for Older Patients with Acute Low Back Pain. J Gen Intern Med 2016 Feb;31(2):156-163 [FREE Full text] [CrossRef] [Medline]
    34. Langley GR, MacLellan AM, Sutherland HJ, Till JE. Effect of nonmedical factors on family physicians' decisions about referral for consultation. CMAJ 1992 Sep 01;147(5):659-666 [FREE Full text] [Medline]
    35. Christensen B, Sørensen HT, Mabeck CE. Differences in referral rates from general practice. Fam Pract 1989 Mar;6(1):19-22. [CrossRef] [Medline]
    36. Epstein AM, McNeil BJ. Physician characteristics and organizational factors influencing use of ambulatory tests. Med Decis Making 1985;5(4):401-415. [CrossRef] [Medline]
    37. Hartley RM, Charlton JR, Harris CM, Jarman B. Influence of patient characteristics on test ordering in general practice. Br Med J (Clin Res Ed) 1984 Sep 22;289(6447):735-738 [FREE Full text] [CrossRef] [Medline]
    38. Pham HH, Landon BE, Reschovsky JD, Wu B, Schrag D. Rapidity and modality of imaging for acute low back pain in elderly patients. Arch Intern Med 2009 May 25;169(10):972-981 [FREE Full text] [CrossRef] [Medline]
    39. Hawkey CJ, Cullen DJ, Greenwood DC, Wilson JV, Logan RF. Prescribing of nonsteroidal anti-inflammatory drugs in general practice: determinants and consequences. Aliment Pharmacol Ther 1997 Apr;11(2):293-298 [FREE Full text] [CrossRef] [Medline]
    40. Kressin NR, Lin M. Race/ethnicity, and Americans' perceptions and experiences of over- and under-use of care: a cross-sectional study. BMC Health Serv Res 2015 Oct 01;15:443 [FREE Full text] [CrossRef] [Medline]
    41. Kressin NR, Groeneveld PW. Race/Ethnicity and overuse of care: a systematic review. Milbank Q 2015 Mar;93(1):112-138 [FREE Full text] [CrossRef] [Medline]
    42. Wagner AC, Hann M, Ashcroft DM. Influence of population and general practice characteristics on prescribing of minor tranquilisers in primary care. Pharm Pract (Granada) 2010 Jul;8(3):193-200 [FREE Full text] [CrossRef] [Medline]
    43. Britten N, Ukoumunne O. The influence of patients' hopes of receiving a prescription on doctors' perceptions and the decision to prescribe: a questionnaire survey. BMJ 1997 Dec 06;315(7121):1506-1510 [FREE Full text] [CrossRef] [Medline]
    44. Haggerty J, Tudiver F, Brown JB, Herbert C, Ciampi A, Guibert R. Patients' anxiety and expectations: how they influence family physicians' decisions to order cancer screening tests. Can Fam Physician 2005 Dec;51:1658-1659 [FREE Full text] [Medline]
    45. McCarthy M, Wilson-Davis K, McGavock H. Relationship between the number of partners in a general practice and the number of different drugs prescribed by that practice. Br J Gen Pract 1992 Jan;42(354):10-12 [FREE Full text] [Medline]
    46. Davidson W, Molloy DW, Somers G, Bédard M. Relation between physician characteristics and prescribing for elderly people in New Brunswick. CMAJ 1994 Mar 15;150(6):917-921 [FREE Full text] [Medline]
    47. Haikio JP, Linden K, Kvist M. Outcomes of referrals from general practice. Scand J Prim Health Care 1995 Dec;13(4):287-293. [CrossRef] [Medline]
    48. Healey AT, Yule BF, Reid JP. Variations in general practice prescribing costs and implications for budget setting. Health Econ 1994;3(1):47-56. [CrossRef] [Medline]
    49. Wilson RP, Hatcher J, Barton S, Walley T. Influences of practice characteristics on prescribing in fundholding and non-fundholding general practices: an observational study. BMJ 1996 Sep 07;313(7057):595-599 [FREE Full text] [CrossRef] [Medline]
    50. Filan PM, Inder TE, Anderson PJ, Doyle LW, Hunt RW. Monitoring the neonatal brain: a survey of current practice among Australian and New Zealand neonatologists. J Paediatr Child Health 2007;43(7-8):557-559. [CrossRef] [Medline]
    51. Lysdahl KB, Børretzen I. Geographical variation in radiological services: a nationwide survey. BMC Health Serv Res 2007 Feb 15;7:21 [FREE Full text] [CrossRef] [Medline]
    52. Hart J, Salman H, Bergman M, Neuman V, Rudniki C, Gilenberg D, et al. Do drug costs affect physicians' prescription decisions? J Intern Med 1997 May;241(5):415-420 [FREE Full text] [CrossRef] [Medline]
    53. Weiss MC, Fitzpatrick R, Scott DK, Goldacre MJ. Pressures on the general practitioner and decisions to prescribe. Fam Pract 1996 Oct;13(5):432-438. [CrossRef] [Medline]
    54. Holm M, Olesen F. Factors affecting prescription of psychotropic drugs in general practice. Scand J Prim Health Care 1988 Sep;6(3):169-173. [CrossRef] [Medline]
    55. McDonald JT, Sherman A. Determinants of mammography use in rural and urban regions of Canada. Can J Rural Med 2010;15(2):52-60. [Medline]
    56. Niemann T, Lous J, Thorsgaard N, Nielsen TT. Regional variations in the use of diagnostic coronary angiography. A one-year population-based study of all diagnostic coronary angiographies performed in a rural and an urban Danish county. Scand Cardiovasc J 2000 Jun;34(3):286-292. [CrossRef] [Medline]
    57. Tan A, Kuo Y, Elting LS, Goodwin JS. Refining physician quality indicators for screening mammography in older women: distinguishing appropriate use from overuse. J Am Geriatr Soc 2013 Mar;61(3):380-387 [FREE Full text] [CrossRef] [Medline]
    58. Franks P, Williams GC, Zwanziger J, Mooney C, Sorbero M. Why do physicians vary so widely in their referral rates? J Gen Intern Med 2000 Mar;15(3):163-168 [FREE Full text] [CrossRef] [Medline]
    59. Vehviläinen AT, Kumpusalo EA, Voutilainen SO, Takala JK. Does the doctors' professional experience reduce referral rates? Evidence from the Finnish referral study. Scand J Prim Health Care 1996 Mar;14(1):13-20. [CrossRef] [Medline]
    60. Mehrotra A, Reid RO, Adams JL, Friedberg MW, McGlynn EA, Hussey PS. Physicians with the least experience have higher cost profiles than do physicians with the most experience. Health Aff (Millwood) 2012 Nov;31(11):2453-2463 [FREE Full text] [CrossRef] [Medline]
    61. Choudhry NK, Fletcher RH, Soumerai SB. Systematic review: the relationship between clinical experience and quality of health care. Ann Intern Med 2005 Feb 15;142(4):260-273. [CrossRef] [Medline]
    62. Seymour CW, Iwashyna TJ, Ehlenbach WJ, Wunsch H, Cooke CR. Hospital-level variation in the use of intensive care. Health Serv Res 2012 Oct;47(5):2060-2080 [FREE Full text] [CrossRef] [Medline]
    63. Hofer TP, Hayward RA, Greenfield S, Wagner EH, Kaplan SH, Manning WG. The unreliability of individual physician. JAMA 1999 Jun 09;281(22):2098-2105. [CrossRef] [Medline]
    64. Korenstein D. Medical Overuse as a Physician Cognitive Error: Looking Under the Hood. JAMA Intern Med 2019 Jan 01;179(1):26-27. [CrossRef] [Medline]
    65. Duberstein PR, Chapman BP, Epstein RM, McCollumn KR, Kravitz RL. Physician personality characteristics and inquiry about mood symptoms in primary care. J Gen Intern Med 2008 Nov;23(11):1791-1795 [FREE Full text] [CrossRef] [Medline]
    66. Morgan S, Morgan A, Kerr R, Tapley A, Magin P. Test ordering by GP trainees: Effects of an educational intervention on attitudes and intended practice. Can Fam Physician 2016 Sep;62(9):733-741 [FREE Full text] [Medline]
    67. Meidani Z, Mousavi GA, Kheirkhah D, Benar N, Maleki MR, Sharifi M, et al. Going beyond audit and feedback: towards behaviour-based interventions to change physician laboratory test ordering behaviour. J R Coll Physicians Edinb 2017 Dec;47(4):339-344. [CrossRef] [Medline]
    68. Mason CT. Berrin Erdogan. Management Principles. 2012.   URL: https://2012books.lardbucket.org/pdfs/management-principles-v1.0.pdf [accessed 2019-05-01] [WebCite Cache]
    69. Goldberg LR. An alternative. J Pers Soc Psychol 1990 Dec;59(6):1216-1229. [CrossRef] [Medline]
    70. Nelson-Piercy C, Vlaev I, Harris K, Fischer-Betz R. What factors could influence physicians' management of women of childbearing age with chronic inflammatory disease? A systematic review of behavioural determinants of clinical inertia. BMC Health Serv Res 2019 Nov 21;19(1):863 [FREE Full text] [CrossRef] [Medline]
    71. Holtgrave DR, Lawler F, Spann SJ. Physicians' risk attitudes, laboratory usage, and referral decisions: the case of an academic family practice center. Med Decis Making 1991;11(2):125-130. [CrossRef] [Medline]
    72. Nightingale SD. Risk preference and laboratory use. Med Decis Making 1987;7(3):168-172. [CrossRef] [Medline]
    73. Nightingale SD, Grant M. Risk Preference and Decision Making in Critical Care Situations. Chest 1988 Apr;93(4):684-687. [CrossRef]
    74. Pedersen AF, Carlsen AH, Vedsted P. Association of GPs' risk attitudes, level of empathy, and burnout status with PSA testing in primary care. Br J Gen Pract 2015 Dec;65(641):e845-e851 [FREE Full text] [CrossRef] [Medline]
    75. Santora LM, Mahoney MC, Lawvere S, Englert JJ, Symons AB, Mirand AL. Breast cancer screening beliefs by practice location. BMC Public Health 2003 Feb 04;3:9 [FREE Full text] [CrossRef] [Medline]
    76. Symons AB, Mahoney MC, Englert J, Mirand AL. Variations in approaches to breast cancer screening among primary care physicians. J Cancer Educ 2002;17(4):205-210. [CrossRef] [Medline]
    77. Bipat S, van Leeuwen MS, Ijzermans JNM, Bossuyt PMM, Greve J, Stoker J. Imaging and treatment of patients with colorectal liver metastases in the Netherlands: a survey. Neth J Med 2006 May;64(5):147-151 [FREE Full text] [Medline]
    78. Saigal CS, Pashos CL, Henning JM, Litwin MS. Variations in use of imaging in a national sample of men with early-stage prostate cancer. Urology 2002 Mar;59(3):400-404. [CrossRef] [Medline]
    79. Nightingale SD, Yarnold PR, Greenberg MS. Sympathy, empathy, and physician resource utilization. J Gen Intern Med 1991;6(5):420-423. [Medline]
    80. Cascade PN, Webster EW, Kazerooni EA. Ineffective use of radiology: the hidden cost. AJR Am J Roentgenol 1998 Mar;170(3):561-564. [CrossRef] [Medline]
    81. Oussedik E, Anderson MS, Feldman SR. Risk versus benefit or risk versus risk: Risk aversion in the medical decision making process. J Dermatolog Treat 2017 Feb;28(1):1-2. [CrossRef] [Medline]
    82. Nightingale SD. Risk preference and laboratory test selection. J Gen Intern Med 1987;2(1):25-28. [CrossRef] [Medline]
    83. Zaat JO, van Eijk JT. General practitioners' uncertainty, risk preference, and use of laboratory tests. Med Care 1992 Sep;30(9):846-854. [CrossRef] [Medline]
    84. Nightingale SD. Risk preference and admitting rates of emergency room physicians. Med Care 1988 Jan;26(1):84-87. [CrossRef] [Medline]
    85. Reniers RLEP, Murphy L, Lin A, Bartolomé SP, Wood SJ. Risk Perception and Risk-Taking Behaviour during Adolescence: The Influence of Personality and Gender. PLoS One 2016;11(4):e0153842 [FREE Full text] [CrossRef] [Medline]
    86. Simpkin AL, Schwartzstein RM. Tolerating Uncertainty - The Next Medical Revolution? N Engl J Med 2016 Nov 03;375(18):1713-1715. [CrossRef] [Medline]
    87. Evans L, Trotter DRM. Epistemology and uncertainty in primary care: an exploratory study. Fam Med 2009 May;41(5):319-326 [FREE Full text] [Medline]
    88. Ghosh AK. Dealing with medical uncertainty: a physician's perspective. Minn Med 2004 Oct;87(10):48-51. [Medline]
    89. Katz DA, Williams GC, Brown RL, Aufderheide TP, Bogner M, Rahko PS, et al. Emergency physicians' fear of malpractice in evaluating patients with possible acute cardiac ischemia. Ann Emerg Med 2005 Dec;46(6):525-533. [CrossRef] [Medline]
    90. Asher E, Greenberg-Dotan S, Halevy J, Glick S, Reuveni H. Defensive Medicine in Israel – A Nationwide Survey. PLoS ONE 2012 Aug 16;7(8):e42613. [CrossRef]
    91. Byrne G. MedScape. Nursing Standard 2015 Aug 19;29(51):29-29. [CrossRef]
    92. Blackston JW, Bouldin MJ, Brown CA, Duddleston DN, Hicks GS, Holman HE. Malpractice risk prevention for primary care physicians. Am J Med Sci 2002 Oct;324(4):212-219. [CrossRef] [Medline]
    93. Arigoni F, Bovier PA, Sappino AP. Trend of burnout among Swiss doctors. Swiss Med Wkly 2010;140:w13070. [CrossRef] [Medline]
    94. Williams ES, Manwell LB, Konrad TR, Linzer M. The relationship of organizational culture, stress, satisfaction, and burnout with physician-reported error and suboptimal patient care: results from the MEMO study. Health Care Manage Rev 2007;32(3):203-212. [CrossRef] [Medline]
    95. van der Weijden T, van Bokhoven MA, Dinant G, van Hasselt CM, Grol RPTM. Understanding laboratory testing in diagnostic uncertainty: a qualitative study in general practice. Br J Gen Pract 2002 Dec;52(485):974-980 [FREE Full text] [Medline]
    96. O’Sullivan JW, Albasri A, Nicholson BD, Perera R, Aronson JK, Roberts N, et al. Overtesting and undertesting in primary care: a systematic review and meta-analysis. BMJ Open 2018 Feb 11;8(2):e018557. [CrossRef]
    97. These Are the World?s Healthiest Nations 2019. Lee J Miller, Lu W. 2020.   URL: https:/​/www.​bloomberg.com/​news/​articles/​2019-02-24/​spain-tops-italy-as-world-s-healthiest-nation-while-u-s-slips [accessed 2019-05-01] [WebCite Cache]
    98. Rosen B, Waitzberg R, Merkur S. Israel: Health System Review. Health Syst Transit 2015;17(6):1-212 [FREE Full text] [Medline]
    99. Sirovich B, Gallagher PM, Wennberg DE, Fisher ES. Discretionary decision making by primary care physicians and the cost of U.S. Health care. Health Aff (Millwood) 2008;27(3):813-823 [FREE Full text] [CrossRef] [Medline]
    100. Glasson J. Essential vs Discretionary Health Care in System Reform-Reply. JAMA 1995 Mar 22;273(12):919. [CrossRef]
    101. Kuo RN, Lai C, Yeh Y, Lai M. Discretionary decisions and disparities in receiving drug-eluting stents under a universal healthcare system: A population-based study. PLoS ONE 2017 Jun 8;12(6):e0179127. [CrossRef]
    102. Pierre L Yong, Robert S Saunders, LeighAnne Olsen. The Healthcare Imperative: Lowering Costs and Improving Outcomes. The National Academies Collection: Reports funded by National Institutes of Health 2010. [CrossRef] [Medline]
    103. Verstappen WHJM, ter Riet G, Dubois WI, Winkens R, Grol RPTM, van der Weijden T. Variation in test ordering behaviour of GPs: professional or context-related factors? Fam Pract 2004 Aug;21(4):387-395. [CrossRef] [Medline]
    104. Sá L, Teixeira ASC, Tavares F, Costa-Santos C, Couto L, Costa-Pereira A, et al. Diagnostic and laboratory test ordering in Northern Portuguese Primary Health Care: a cross-sectional study. BMJ Open 2017 Nov 15;7(11):e018509. [CrossRef]
    105. Busby J, Schroeder K, Woltersdorf W, Sterne JAC, Ben-Shlomo Y, Hay A, et al. Temporal growth and geographic variation in the use of laboratory tests by NHS general practices: using routine data to identify research priorities. Br J Gen Pract 2013 Apr;63(609):e256-e266 [FREE Full text] [CrossRef] [Medline]
    106. Selby J, Grumbach K, Quesenberry CP, Schmittdiel JA, Truman AF. Differences in resource use and costs of primary care in a large HMO according to physician specialty. Health Serv Res 1999 Jun;34(2):503-518 [FREE Full text] [Medline]
    107. Larsson AP, Palmer M, Hultén G, Tryding N. Large differences in laboratory utilisation between hospitals in Sweden. Clin Chem Lab Med 2000 May;38(5):383-389. [CrossRef] [Medline]
    108. Lin DC, Straseski JA, Schmidt RL, The Thyroid Benchmarking Group. Multi-Center Benchmark Study Reveals Significant Variation in Thyroid Testing in United States. Thyroid 2017 Oct 01;27(10). [CrossRef] [Medline]
    109. Taroni F, Siass R, Traversa G, Raschetti R, Menniti-Ippolito F, Maggini M, et al. The nature, content and interpractice variation of general practice: A regional study in Italy. Eur J Epidemiol 1990 Sep;6(3):313-318. [CrossRef]
    110. Zhi M, Ding EL, Theisen-Toupal J, Whelan J, Arnaout R. The Landscape of Inappropriate Laboratory Testing: A 15-Year Meta-Analysis. PLoS ONE 2013 Nov 15;8(11):e78962. [CrossRef]
    111. Romain S, Schillaci MA. Childhood immunization: Availability of primary care providers in Ontario. Can Fam Physician 2009 Nov;55(11):1104-1105.e4 [FREE Full text] [Medline]
    112. Chami N, Simons JE, Sweetman A, Don-Wauchope AC. Rates of inappropriate laboratory test utilization in Ontario. Clin Biochem 2017 Oct;50(15):822-827. [CrossRef] [Medline]
    113. Kwanchai A, Gomez AAG. Statistical Procedures for Agricultural Research. Second Edition. New York: John Wiley and Sons Inc; 1984.
    114. Semenova VA, Schiffer J, Steward-Clark E, Soroka S, Schmidt DS, Brawner MM, et al. Validation and long term performance characteristics of a quantitative enzyme linked immunosorbent assay (ELISA) for human anti-PA IgG. J Immunol Methods 2012 Feb 28;376(1-2):97-107. [CrossRef] [Medline]
    115. Nguyen LT, Guo M, Hemmelgarn B, Quan H, Clement F, Sajobi T, et al. Evaluating practice variance among family physicians to identify targets for laboratory utilization management. Clin Chim Acta 2019 Oct;497:1-5. [CrossRef] [Medline]
    116. 2020.   URL: https://www.oecd.org/health/geographic-variations-in-health-care-9789264216594-en.htm
    117. Merlo J, Chaix B, Yang M, Lynch J, Råstam L. A brief conceptual tutorial of multilevel analysis in social epidemiology: linking the statistical concept of clustering to the idea of contextual phenomenon. J Epidemiol Community Health 2005 Jun;59(6):443-449 [FREE Full text] [CrossRef] [Medline]
    118. Melnick ER, O'Brien EGJ, Kovalerchik O, Fleischman W, Venkatesh AK, Taylor RA. The Association Between Physician Empathy and Variation in Imaging Use. Acad Emerg Med 2016 Aug;23(8):895-904 [FREE Full text] [CrossRef] [Medline]
    119. Harris MA, Brett CE, Johnson W, Deary IJ. Personality stability from age 14 to age 77 years. Psychol Aging 2016 Dec;31(8):862-874 [FREE Full text] [CrossRef] [Medline]
    120. Leon GR, Gillum B, Gillum R, Gouze M. Personality stability and change over a 30-year period--middle age to old age. J Consult Clin Psychol 1979 Jun;47(3):517-524. [CrossRef] [Medline]
    121. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, et al. Why don't physicians follow clinical practice guidelines? A framework for improvement. JAMA 1999 Oct 20;282(15):1458-1465. [Medline]
    122. Schaufeli W, Gerard H. Maassen, Arnold B. Bakker. Stability and change in burnout: A 10‐year follow‐up study among primary care physicians. Journal of Occupational and Organizational Psychology 2011;Volume84(Issue2):248-267. [CrossRef]
    123. Pines JM, Hollander JE, Isserman JA, Chen EH, Dean AJ, Shofer FS, et al. The association between physician risk tolerance and imaging use in abdominal pain. Am J Emerg Med 2009 Jun;27(5):552-557. [CrossRef] [Medline]
    124. Pines JM, Isserman JA, Szyld D, Dean AJ, McCusker CM, Hollander JE. The effect of physician risk tolerance and the presence of an observation unit on decision making for ED patients with chest pain. Am J Emerg Med 2010 Sep;28(7):771-779. [CrossRef] [Medline]
    125. Pearson SD, Goldman L, Orav EJ, Guadagnoli E, Garcia TB, Johnson PA, et al. Triage decisions for emergency department patients with chest pain: do physicians' risk attitudes make the difference? J Gen Intern Med 1995 Oct;10(10):557-564. [CrossRef] [Medline]
    126. Jackson D. Jackson personality inventory manual. Goshen NRPP 1975.
    127. Gerrity MS, DeVellis RF, Earp JA. Physicians' reactions to uncertainty in patient care. A new measure and new insights. Med Care 1990 Aug;28(8):724-736. [CrossRef] [Medline]
    128. Fiscella K, Franks P, Zwanziger J, Mooney C, Sorbero M, Williams GC. Risk aversion and costs: a comparison of family physicians and general internists. J Fam Pract 2000 Jan;49(1):12-17. [Medline]
    129. Wong AC, Kowalenko T, Roahen-Harrison S, Smith B, Maio RF, Stanley RM. A survey of emergency physicians' fear of malpractice and its association with the decision to order computed tomography scans for children with minor head trauma. Pediatr Emerg Care 2011 Mar;27(3):182-185. [CrossRef] [Medline]
    130. Hojat M, Gonnella JS, Nasca TJ, Mangione S, Vergare M, Magee M. Physician empathy: definition, components, measurement, and relationship to gender and specialty. Am J Psychiatry 2002 Sep;159(9):1563-1569. [CrossRef] [Medline]
    131. Maslach CJ, Susan E. Jackson, Michael Leiter. Leiter MP . Maslach burnout inventory manualrd edn. Palo Alto, CA: Consulting Psychologists Press, Inc;; 1996:3.
    132. Kristensen TB, Villadsen E, Christensen K. The Copenhagen burnout inventory: a new tool for the assessment of burnout. Work and Stress 2005;19(3):192-207 [FREE Full text] [CrossRef]
    133. Colla CH, Mainor AJ, Hargreaves C, Sequist T, Morden N. Interventions Aimed at Reducing Use of Low-Value Health Services: A Systematic Review. Med Care Res Rev 2017 Oct;74(5):507-550. [CrossRef] [Medline]

    ‎
    CHS: Clalit Health services
    HS: health service
    MPV: medical practice variation
    TSH: thyroid-stimulating hormone

    Edited by G Eysenbach; submitted 16.03.20; peer-reviewed by M Bestek, L Damschroder; comments to author 16.04.20; revised version received 04.06.20; accepted 14.06.20; published 20.10.20

    Copyright

    ©Sagi Shashar, Shlomi Codish, Moriah Ellen, Ehud Davidson, Victor Novack. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 20.10.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.