Protocol
Abstract
Background: Aboriginal and Torres Strait Islander (Indigenous) peoples living in remote Australia experience a heavy burden of ill health and multiple barriers to accessing health care. Digital health technologies (DHTs) have the potential to help overcome some of these challenges and increase access to comprehensive primary health care (CPHC), thereby improving equity of health outcomes. However, little is known about the community and provider preferences for the use of digital technologies for improving health and wellness.
Objective: The study aims to co-design, implement, and evaluate how DHTs can improve access to CPHC in remote Indigenous communities in the Northern Territory (NT), Australia.
Methods: This multiphased project will take a participatory action research approach to co-design and optimize digital health solutions with local community members and health service staff in 2 communities. Our mixed methods approach will include pre- and postimplementation focus group discussions, interviews, quantitative analysis of CPHC utilization administrative data, and surveys administered by Indigenous community-based researchers to understand the use of digital devices and connectivity, eHealth literacy, preferences for different attributes of DHTs using best-worst scaling, and consumer satisfaction and experiences with DHT interventions. Priority DHTs will be selected for implementation based on consumer and health staff preferences. Focus group discussions and interview data will explore community and health service staff preferences, experiences, and satisfaction with implemented DHTs. A realist approach will be taken to identify how DHT interventions work, for whom, and in what circumstances, so that the understanding of why some interventions work while others do not is expanded. Economic analyses will be conducted to calculate the incremental costs and benefits of implemented DHT interventions. The scalability of digital health solutions will be tested in two additional communities. Project partners include key funding, service, and support agencies in the NT and nationally.
Results: As of November 2024, we have selected two implementation sites. Digital health initiatives are underway at the implementation sites, and evaluation activities are progressing. The initial findings from these sites have informed our scalability assessment in an additional two sites.
Conclusions: Knowledge translation is integral to the study design, which involves partnering with consumers, CPHC service providers, and a range of key stakeholders to inform health service providers and policy makers about which DHTs work for which groups of consumers, and under what circumstances, to improve access to CPHC. This unique study will accommodate consumer and provider preferences regarding the use of DHTs to improve CPHC access and address the lack of knowledge about how to deploy digital solutions to best support CPHC in remote Indigenous Australia.
International Registered Report Identifier (IRRID): DERR1-10.2196/68892
doi:10.2196/68892
Keywords
Introduction
Comprehensive primary health care (CPHC) is the delivery of essential health care services from the first point of contact, enabling equitable access to health and well-being for all residents in a community []. In the context of Australian Aboriginal Community Controlled Health Services (ACCHSs), CPHC has four domains for delivering core services: governance, clinical services, community health promotion and empowerment, and policy direction and partnerships []. In common with primary health care services, such as those delivered by Northern Territory (NT) Health, ACCHSs deliver a broad range of clinical services. However, ACCHSs have governance structures that support the expression of self-determination and offer services that include community development, advocacy to improve determinants of health that are outside the health system, and fostering partnerships to optimize action addressing those determinants. CPHC is characterized by the achievement of more equitable health outcomes in line with the Alma-Ata Declaration of 1978 on primary health care [,]. CPHC is also the most inclusive and cost-effective approach to delivering health care services and involves identifying local health needs and responding to health provision gaps []. Strong CPHC systems are therefore essential for optimizing health outcomes for high-needs, dispersed, and marginalized communities.
Remote Aboriginal and Torres Strait Islander (respectfully referred to as Indigenous throughout this protocol) Australians experience the heaviest burden of ill health and the highest rates of preventable hospital admissions and potentially avoidable deaths of all Australians []. Overall, Indigenous Australians have 2.3 times the burden of disease compared to the non-Indigenous population []. Responding adequately to this burden of disease and the associated need for CPHC in remote Indigenous communities of the NT is challenging []. The NT spans a large geographical area (1,347,791 km2), all classified as rural or remote, and population density is sparse []. In Australia, geographical remoteness has been associated with long-standing health workforce issues, including poor supply, low retention, and high turnover, with associated adverse impacts on access to CPHC, especially continuity of care [-]. In addition, high proportions of nurses are employed on casual or short-term agency contracts []. On average, only 20% of remote area nurses and Aboriginal health practitioners (AHPs) remain working in the same clinic 12 months after commencing their employment [,,]. While the use of temporary staff provides a short-term solution to address dire need, there are trade-offs regarding the skills and suitability of these staff, with consumers preferring to have their complex chronic conditions managed by health care professionals they know [,,]. High mobility of remote populations is also a feature of remote communities and is a further barrier to continuity and access to care.
Digital health technologies (DHTs) such as telehealth, wearable devices, and mobile health apps can help to address barriers to CPHC for people living in remote Indigenous communities as well as support remote area health care professionals [,]. Telehealth has been shown to reduce the need to travel, decrease waiting periods to see a clinician, and improve continuity of care [,]. DHTs can also increase flexibility of employment and provide enhanced training opportunities for remote clinicians [], thereby promoting workforce retention. DHTs may also improve communication between different service providers [], which can improve coordination of health care, improve decision-making, and strengthen communications between specialists and primary health care providers. DHTs also have the potential to increase cultural security and minimize disparities in access to health care []. For instance, a recent systematic review reported that in some circumstances, Indigenous people may feel more comfortable using telehealth and thereby avoid embarrassment, which might arise from a face-to-face interaction with a health provider who lives in their community []. Nevertheless, Indigenous peoples are diverse and have different needs. For cultural safety to be in place, trusting and respectful relationships must first be created. Therefore, the vision of the NT Virtual Care Strategy [] is that DHTs will facilitate improved access, result in greater choice for consumers, reduce travel time to get to appointments, and increase convenience for consumers.
Several studies have developed and applied digital tools such as apps and programs to promote health and wellness in rural and remote communities, but these are often not developed in collaboration with communities and, when they have been, are rarely evaluated [,]. In the NT, DHTs being used include telehealth (audio with video), electronic patient management information systems, and a range of mobile apps. However, despite existing use and the potential for more widespread adoption of DHTs, it is not well understood which DHTs might work well, how, and for whom to improve access to CPHC for remote Indigenous populations in the NT. While some health services in the NT have used DHTs to deliver CPHC and support follow-up of specialist care, DHTs generally remain underutilized and have neither been systematically implemented nor evaluated [,]. The use and type of DHTs in the NT have primarily been driven by providers’ preferences [], with limited focus on consumer preferences and experiences. Likewise, there is little evidence of consumer involvement in the design and delivery of health care using DHTs in remote Indigenous settings elsewhere in Australia, which stand to benefit most from this technology. In light of these important gaps, this research will co-design, implement, and evaluate the use of DHTs to strengthen the evidence about how DHTs can best support access to CPHC for remote Indigenous communities, considering consumer and remote health staff preferences. This protocol is reported in line with the iCHECK-DH (Guidelines and Checklist for the Reporting on Digital Health Implementations) reporting guideline, with some adaptations in subheadings [].
Methods
Setting
This project is being conducted (July 2022-June 2025) in two remote Indigenous communities in the NT, where health care is provided by either NT Government-run health services or ACCHSs. Health services across the NT were invited to express their interest in participating in the project. A project advisory committee, consisting of key decision-makers from the NT and Commonwealth Health Departments, ACCHSs, and stakeholder partners, selected the sites based on community size, remoteness, location (Top End, Central Australia), health service delivery and governance model (government, ACCHS), and estimated readiness to engage with DHTs. This approach sought to maximize the opportunity to evaluate and compare the findings from diverse communities with different governance structures. The clinics in these communities are mostly staffed by remote area nurses, AHPs, and nonclinical administrative staff based in the community, with visiting (and sometimes telehealth) services provided by general practitioners, Allied Health Professionals, and various medical specialists. The NT has unique cultural, social, and language considerations, with 26.3% of the population identifying as Aboriginal or Torres Strait Islander (compared to 3.2% across Australia) []. In remote and very remote communities of the NT, more than 90% of the population identify as Aboriginal, and for many, English is not their first language []. The participating communities in our project meet this unique NT profile: they are small (<400 population), very remote, and have a predominantly Indigenous population. They face numerous health care delivery challenges and have differing usable technological infrastructure, such as the presence of a 4G mobile network, the presence of microwave, satellite, or cable internet, and the presence of community Wi-Fi.
Theoretical Frameworks
A participatory action research (PAR) methodology actively involves key stakeholders, including patients (consumers), health care providers, caregivers, and community members in the research process. This methodology emphasizes collaboration, shared decision-making, and engagement of those directly affected by the research [,]. The intention is that a network of participants who are actively engaged in the project can help bridge the gap between research and practice to create sustained system change.
We will apply three theoretical frameworks in the design, implementation, and evaluation of DHT solutions in the 2 communities. First, an overarching logic model ( []) for CPHC will be used to provide a systematic approach for data collection across the different components of a CPHC system (context, inputs, enablers, outputs, and immediate, intermediate, and outcomes), and the contribution of each component will be monitored against relevant outcome measures [].
Second, the six dimensions of the modified theory of access—acceptability, accommodation, affordability, accessibility, availability, and awareness (including digital health literacy)—will be used to evaluate the impact of DHTs in providing enhanced access to CPHC [,].
Third, a realist approach will be used to explore which DHTs work, for whom, and under what circumstances [,]. Realist evaluations go beyond simply determining whether an intervention is effective or not; they provide insight into underlying mechanisms and the context of causal relationships between interventions and outcomes.
This tri-part approach is likely to be especially useful to unpack the complex interplay of factors operating within remote and Indigenous health care environments [,].
Specific research questions include:
- What technologies are available to support CPHC, including prevention and health promotion programs, in remote communities?
- How can existing technologies be modified or enhanced to support CPHC, and what new technologies are needed?
- What are the consumer and provider preferences for the use of digital technologies to support CPHC in remote communities?
- How can technologies be used to promote access to care and support a holistic approach to social and emotional well-being in remote communities?
- How can digital technologies support coordination of, and access to, CPHC in a highly mobile population, as well as collaboration between providers?
- What skills are required for remote providers to use digital technologies to support CPHC in remote communities?
- What is the impact of deploying different digital technologies to support CPHC on consumer and staff experiences in remote communities?
- What are the potential cost consequences of deploying different digital technologies to support CPHC in remote communities?
- How can the deployment of digital technologies improve the efficiency of CPHC in remote communities?

Project Co-Design, Implementation, and Evaluation
The project will be conducted in multiple phases, including investigation and co-design of DHTs with consumers and health service staff, iterative implementation of different DHTs in two community sites, and evaluation of these DHTs on consumer and staff experiences and access to CPHC (refer to ).
Preimplementation Activities and Co-Design of Digital Health Interventions
A desktop review will identify existing DHTs being applied in the NT and elsewhere that can be applied to support CPHC in remote Indigenous communities. A concurrent realist review will develop initial program theories about how and for whom DHTs affect access to CPHC in remote Indigenous communities [,]. Initial program theories developed from the existing literature will be refined using data collected from thought leader interviews (refer to the interview guide in ). Some of these theories may subsequently be tested during the evaluation phase (depending on preferences for DHTs to be implemented).
A technology-enabled patient journey map will be prepared and refined iteratively for use during interviews and community interactions. It will be a tool to assist with identifying the facilitators and barriers for remote residents accessing CPHC during different stages of their health care journey.
Initial community-engagement activities will entail consulting local elders in the two selected sites. This will inform the employment of local community-based Indigenous researchers. Elders will be consulted throughout the project. Male and female local community-based Indigenous researchers will be employed at each site. These researchers will be key to ensuring locally responsive and culturally appropriate data collection and for developing and maintaining relationships between the research team and local stakeholders []. Aboriginal researchers will actively participate in all stages of the project and all phases of the data lifecycle, including data tool creation, data collection, access analysis, co-design, analysis, interpretation of results, and dissemination of findings, including publications and presentations to key stakeholder groups.
Baseline data will be collected on general communities’ views on the use of technology for health and wellness, digital health coverage [], eHealth literacy [], and consumer satisfaction with current use of telehealth to access health services and group health promotion sessions [-].
Qualitative semistructured interviews and focus group discussions (FGDs) with consumers and providers will be undertaken to explore preferences for DHTs and to inform the attributes of DHT interventions [,]. Community-based researchers will actively identify and recruit participants for FGDs and interviews. We will use a yarning method to conduct these FGDs and interviews. Discussions will be led by community-based Indigenous researchers to ensure that FGDs and interviews are conducted in a culturally safe way. The information obtained from the FGDs and interviews will be used to identify the key attributes of DHT interventions, which will inform the preimplementation quantitative survey. The survey will quantify the best and worst attributes of DHTs using best-worst scaling (BWS), digital technology coverage, eHealth literacy, and satisfaction of consumers who have used DHTs. The BWS will quantify consumer and local primary health care staff members’ priorities for key attributes of DHTs and any differences in preferences among different groups of respondents. These findings will be used to further refine and target DHT development and implementation []. Local elders will be consulted at each stage of the project, ideally before employing local community-based Indigenous researchers and before each stage of the project.
Implementation
Information regarding the candidate DHTs identified during the co-design phase will be presented to the consumers, local health staff, and the leaders in government and community sectors. An integrated set of candidate DHTs will be implemented based on their feasibility and anticipated impact on access to CPHC. Interventions will be tailored to the local context using the PAR design approach led by community-based researchers who will support intervention implementation and lead the collection of feedback.
Evaluation
Postintervention data will be collected as the interventions are implemented and iteratively refined. We will use quantitative administrative data and qualitative data from interviews and FGDs with consumers and stakeholders about their experiences with DHTs in order to identify what works for whom, in what context, and by which mechanism [].
An economic analysis will investigate the incremental costs of implementing DHTs and the associated benefits. The incremental resource use will be calculated based on different patterns of digital solution uptake in terms of additional resources required, and staff costs are based on assumptions around how many extra staff hours would be required per patient per unit of time. Whether a cost-effectiveness or cost-benefit analysis is conducted will be determined through consultations with key stakeholders.
Scalability Analysis
Scalability analyses will be conducted in two additional communities, using a previously published framework []. The objectives of such analysis will be to (1) identify core and adaptable features of implemented DHTs and (2) explore the feasibility of scaling DHTs to additional community sites, including cost implications. The scalability analysis will enable the evaluation team and participating organizations and their respective health boards to assess the suitability of the developed DHTs for scale and further implementation. This component will have strong translational implications.
Participants
Community partnership is an important aspect of this project. It is crucial to understand how remote communities experience access to CPHC and how DHTs may improve or deter their access to and experiences with health services. A total of 6 stakeholder groups were identified as crucial partners in this project (refer to for details). Briefly, group 1 includes community leaders, group 2 includes consumers, and group 3 includes health service staff, health board members, and clinical and nonclinical staff at the participating sites. Likewise, group 4 includes project partner organization staff, group 5 includes technology provider organization staff, and group 6 includes other stakeholders and thought leaders. Participants must be aged 18 years or older and able to provide informed consent.
This is a multi-institutional collaboration that includes government and industry partners []. The key partners include the Digital Health Cooperative Research Centre, the Commonwealth Department of Health and Aged Care, the NT Government, the NT Primary Health Network (NTPHN), the Aboriginal Medical Services Alliances NT, Healthdirect, the Australian Digital Health Agency, the Menzies School of Health Research, and the University of Sydney. Representatives from each partner provide substantial research and industry input at all stages of the project.
| Data source | Example participants | Sample | Recruitment method | Data collection method | Time | |
| Primary data | ||||||
| Workshops with remote NTa health service providers | GPsb, allied health professionals, remote area nurses, and health service managers | 60 | Invitation; convenience sampling | Group discussions | Preimplementation | |
| Group 1: community leaders at the two participating sites | Traditional owners, mayors, religious and cultural leaders, and local council board members | 8 | Purposive sampling via local contacts | Individual interviews | Co-design, implementation, and evaluation | |
| Group 2: consumers at the two participating sites | Consumers (or their carers) who have used local health care services | 100 | Purposive sampling to ensure representativeness | Survey administered in person (digital technology coverage, best-worst scaling survey, consumer satisfaction, and eHealth literacy) | Co-design, implementation, and evaluation | |
| Group 2: consumers at the two participating sites | Consumers (or their carers) who have used local health care services | 40 | Purposive sampling to ensure various perspectives are included | Individual interviews and focus group discussions | Co-design, implementation, and evaluation | |
| Group 3: health service staff at the two participating sites | CEOsc, managers, board members (where applicable), clinical staff (eg, doctors, remote area nurses, and Aboriginal health workers), and nonclinical staff (eg, drivers and administrative staff) | 25 | Purposive sampling from the local sites | Individual interviews and small group discussions | Co-design, implementation, and evaluation | |
| Group 4: partner organization staff | NT health staff members and other partner organizations such as AMSANTd and NT PHNe | 25 | Purposive and snowball sampling | Workshop, small group discussion, individual interviews, and system usability surveys | Preimplementation | |
| Group 5: technology provider organization staff (nonpartners) | Current staff of technology providers such as NBN Cof and Telstra | 5 | Purposive and snowball sampling | Meeting minutes and documents, interviews | Implementation | |
| Group 6: other stakeholders and thought leaders | Staff at other remote clinics or those who have an in-depth understanding of the remote CPHCg context | 25 | Purposive and snowball sampling | Individual interviews and workshops | Preimplementation and co-design | |
| Secondary data | ||||||
| Comprehensive primary health service usage data | All consumers of participating health care services | All consumers | NT Healthh and ACCHSsi | Clinic records and activity, CPHC service utilization data, hospitalization data, and patient travel data | Baseline and end-line (01/01/2022 to 02/28/2025) | |
| Economic data | The key data source will be health personnel and technology-related costs. | All expenditure relevant to DHTsj | NT Health and ACCHSs | Expenditure and personnel data from participating institutions. Obtain data from NT Health for the participating clinic and from the ACCHSs | Baseline and end-line (01/01/2022 to 02/28/2025) | |
aNT: Northern Territory.
bGP: general practitioner.
cCEO: chief executive officer.
dAMSANT: Aboriginal Medical Services Alliances Northern Territory.
eNT PHN: Northern Territory Primary Health Network.
fNBN Co: National Broadband Network Company.
gCPHC: comprehensive primary health care.
hNT Health: Northern Territory Department of Health.
iACCHS: Aboriginal Community Controlled Health Services.
jDHT: digital health technology.
Data Collection
provides a summary of data sources used at each stage as the project progresses.
Primary Data
Initial workshops and key informant interviews with thought leaders will be used to develop primary health care journey maps that depict how different DHTs are being used. Barriers and enablers of access to CPHC and the role of DHTs in improving access will be discussed to identify initial outcomes and mechanisms.
Interviews with stakeholders will be used to explore their perspectives on various barriers and enablers of access to CPHC and the role of DHTs in improving various aspects of access. Focus group discussions with consumers in the communities will explore key challenges and identify their preferences. A baseline survey, including the BWS survey, will collect data on DHT coverage, consumer experiences with DHT use [,], eHealth literacy [], and consumers and health staff preferences for DHT implementation [,].
Once preferences of consumers and health care providers regarding DHTs are identified and feasible DHTs are implemented and optimized, focus group discussions, interviews, and surveys will be used to collect data about consumer use and satisfaction. This will be an iterative process and will inform scalability to other remote Indigenous communities.
Secondary Data
Secondary administrative data will be retrieved from multiple sources, including CPHC data at the two intervention sites, such as utilization data, hospitalization, and patient transport data. These analyses will complement scalability and economic analyses. Expenditure and personnel data (eg, workforce composition and supply) required for economic analyses will be obtained from the participating organizations. Further secondary data needs will be determined once the DHTs are prioritized (refer to ).
Data Analysis
Qualitative Data
All interviews, focus group discussions, and workshops will be audio-recorded (if acceptable at the time) and transcribed; detailed field notes will also be used to inform analysis and understanding. Transcripts will be thematically analyzed [,] using a combined inductive and deductive approach and the six phases suggested by Braun and Clarke [], that is, familiarizing with the data, initial coding and agreeing on codes, identifying themes, reviewing them, finalizing themes, and writing the results. The analysis will also be informed by realist approaches [] to examine what works for whom and in which contexts. Data collection and analysis will be guided by multiple theoretical frameworks. For instance, the modified theory of access [,] will be used to identify the barriers faced by remote communities in accessing CPHC. The Systems Engineering Initiative for Patient Safety (SEIPS) framework will be used to identify system factors that influence how care is delivered in digitally enabled models of care and lead to better outcomes for patients and remote health service staff []. Due to the co-design nature and unique complexities of each digital health initiative, some flexibility remains in adapting theoretical frameworks specific to each initiative. Lumivero NVivo software will be used during data analysis to identify barriers and facilitators to DHT across different domains of access and the mechanisms by which interventions impact access to CPHC for different groups of consumers. Case studies will be used to understand what DHTs work (or do not) for CPHC in remote Indigenous communities, for whom, in what circumstances, and by what mechanism to improve access to health care [,].
A total of two community-based Indigenous researchers from each site will be involved throughout the project. They will accompany other experienced qualitative researchers to conduct each stage of data collection and analysis. Various data sources, such as consumer, provider, observation, and quantitative data, will be used to triangulate the findings. Multiple researchers will be involved in coding, refining, and summarizing data. Results will be shared with community members and the respective community-based researchers to validate the findings. The community engagement and data collection will happen over many months; therefore, trust building and longitudinal relationships are kept at the center of the data collection process.
The researchers come from diverse backgrounds, with expertise covering health services, clinical practice, remote care, digital health, human factors, and community engagement. The project leaders are non-Indigenous; however, they have spent significant time in the Indigenous health space. The community-based researchers will be the key bridge between the community and the rest of the project team. This will allow the non-Indigenous researchers to remain conscious of their viewpoints and biases and remain intentional to ensure the voice of participants is heard while interacting with the community, collecting and analyzing data, and presenting the findings. Findings of the study will be shared with key community stakeholders and community-based researchers to confirm that it aligns with the community’s view.
Quantitative Data
Pre- and post-intervention data will be compared to investigate the changes in the use of primary health care services. Descriptive statistics using frequency tables and visualization, along with, where possible, univariate and multivariable regression analyses, will determine the association between the DHT interventions and revealed access to CPHC.
The economic analysis will present disaggregated incremental costs and consequences of different DHT uptakes relative to the status quo. In addition, changes in patient satisfaction and outcomes, use of primary care, hospitalizations, and patient transport will be assessed to determine the impact on incremental costs and outcomes of changing values of cost or outcome variables and alternative ways of delivering care.
Data Management
A central data repository of quantitative and qualitative data will be maintained on a secure university server. These data will also be stored on the university and health service organizations’ password-protected computers of individual researchers who have ethical clearance to access these data during the study. Collaborators will ensure that their IT network infrastructure complies with Australian IT security standards and the General Data Protection Regulation.
Principles of Indigenous data sovereignty will be adhered to, including the involvement of Aboriginal people in all stages of data acquisition, use, and reuse.
Project Governance
This project is situated within the governance of the Strengthening Our Health System Strategy, an established collaboration of Aboriginal Medical Services Alliances NT Health (the state health department), and NT Primary Health Network. It focuses on crucial aspects of the NT Virtual Care Strategy [] relating to improving equity, delivering culturally safe services, and providing support, resources, and guidance for staff about how and when digital health care is effectively provided. It is overseen by a Project Control Group and a Project Advisory Group, each having representation across all partner organizations and the Commonwealth Department of Health. Around 3 additional working groups (the research working group, project operational team, and technical working group) hold responsibilities for guiding research activities, ensuring smooth project delivery, and navigating technology issues in the implementation and adaptation of DHTs for CPHC in remote NT.
This implementation project has Indigenous leadership and representation, including as chief investigators, and at all stages, including design and implementation. This project also uses 1 male and 1 female community-based Indigenous researcher at each study site. The community-based researchers are mentored by experienced research team members and have been provided with training on ethical conduct in research, data collection, and analysis, and they provide reciprocal cultural mentoring for non-Indigenous research team members.
Knowledge Translation
Knowledge translation is an integrated feature of the project and is of particular interest to stakeholders and other partners in the project. The governance structure enables rapid feedback on project developments and outcomes. Sharing findings with stakeholders, health services, funders, and executive groups (eg, NT Health and the Commonwealth Department of Health) will be prioritized to inform the scalability and suitability of DHTs for CPHC in other remote Indigenous communities. Customized reports will be provided to each of the stakeholder groups and participating services. A one-page, plain-language report will also be distributed to the participating communities and all NT remote health services. The lead researchers and local community-based Indigenous researchers will present findings to key members of the community. Where necessary, Aboriginal community-based researchers will help interpret the findings in the local language. Dissemination will include peer-reviewed publications and presentations at conferences and professional workshops.
Ethical Considerations
The project was reviewed and approved by the Human Research Ethics Committee of the Northern Territory Department of Health and the Menzies School of Health Research (HREC approval no 2022-4275). Administrative approval was also obtained from the Research Governance Office, NT Health (EFILE2023/8720), and from the Boards of any participating ACCHS. Research project approval was also sought from the respective land councils, and appropriate travel and work permits were obtained for each site to support community-based research activities.
Results
As of November 2024, more than 70 consumers, 17 thought leaders, and 20 health care professionals have been interviewed to assess the feasibility of various digital health initiatives to improve access to health care in the two implementation sites. Researchers have spent more than 50 days at each implementation site. Several digital health initiatives have been co-designed and optimized, which include telehealth from the primary health care clinics to outpatient services, telehealth for aged care allied health services, an SMS text messaging program on selected topics identified by the community, and exploring the feasibility of teledentistry. An economic analysis is also underway to help inform the financial benefit (or loss) of the initiatives. Initial findings from these sites have informed scalability assessments in two additional sites. Data analysis is progressing. The findings will be reported in reports and peer-reviewed publications.
Discussion
Principal Findings
This project aims to optimize the use of DHTs to improve access to CPHC in remote Indigenous communities. DHTs, including telehealth, have been used ad hoc or as pilot projects rather than for mainstream ongoing health care delivery []. While there are promising findings from other studies in the NT [,], to the best of our knowledge, our project will be the first to co-design DHT interventions with consumers and remote health providers and to systematically evaluate the acceptability and effectiveness in remote Indigenous communities.
Key findings from this project will include community preferences and priorities for digital health, the co-design process of the digital health initiatives, and learnings from implementation and evaluation. The findings will provide evidence on the impact of digital health initiatives on access to health care and remote community and health provider experiences. Barriers and facilitators to implementing these initiatives will help inform learnings for future DHT implementations in remote communities.
The involvement of multiple stakeholders, including consumers, health service providers, technology partners, and policy and funding partners, is critical to improving the knowledge about and skills for using DHTs to provide CPHC in remote communities [,]. The use of one DHT (telehealth) to improve access to CPHC has been examined in remote NT, and it has been reported that the doctors were able to provide more clinical care because less of their time was consumed traveling to each community [,]. This project considers a broader range of DHTs, extending beyond telehealth to include, for example, SMS text messaging for appointment reminders, medication reminders, health promotion messages, community health portals, and use of the Australian Government’s My Health Record. The intention is to improve access to CPHC, promote equity, and improve health outcomes in the two remote communities through improved continuity of care and fewer avoidable hospitalizations and patient transfers. Effective and acceptable CPHC also capitalizes and contributes to increased trust and long-term relationships with health service providers to increased cultural security, greater convenience in receiving health care, a reduction in health care disparities, and stronger community engagement in health management and well-being [,].
The economic analysis is unique, as previous studies have not reported such systematic evaluations. The virtual care strategy of NT Health [] has reported that digital health has the potential to save AU $6.3 million (US $4.095 million) on annual travel costs and AU $950,000 (US $617,500) on the cost of appointment cancellations in the NT (1 AU$ =0.65 USD). However, these estimates are not based on community-based studies from the NT. Our economic evaluation intends to show the financial benefit at the local level for the clinic and patient, which will inform decision-making about implementing DHTs in CPHC.
Unintended consequences are not uncommon in the digital health space, and one such risk is the additional administrative and clinical workload that the resident staff may bear and the concern for burnout [,]. The co-design and PAR approach is expected to help identify such issues proactively and address them on time. For instance, additional workload needs to be accounted for when telehealth consultations with outpatient hospital services or health promotion sessions are offered in the community [].
A second issue is managing the “digital divide” [,]. Cautious and informed DHT identification and implementation will minimize the impact of broad-stroke DHT interventions that widen the gap in access to CPHC experienced by disadvantaged populations who may not have digital devices, connectivity, or digital literacy or skills for such consultations [,]. The realist approach, by identifying how DHTs work and who needs support, why, and in what circumstances within the available provisions, adds further critically important information regarding approaches to DHT implementation in marginalized populations such as those living in remote Indigenous communities [,].
A third issue is managing perceptions that telehealth may be “a cheaper option” for CPHC in remote communities []. In an ideal situation, the same clinical staff would always be available face-to-face for consultations, but in many remote communities, this is not realistic due to high staff turnover, declining general practitioner training enrollments, vast geographical distribution of the smaller communities, and the inequitable distribution of resources [,,]. This project will identify opportunities to implement DHTs that do not take away existing face-to-face services but rather complement and enhance CPHC in remote communities. The DHT interventions may be catalysts to improve health and well-being in remote Indigenous communities.
Limitations
There are important limitations to consider in this study. Due to the small remote community population sizes, the sample included in the studies will have limited statistical power but will have inclusive consideration for the remote communities. Poor digital connectivity and high staff turnover, including changes in the health service administration, are also beyond the control of our project team. The use of secondary administrative data that have not been collected for the express purpose of the study is likely to present additional challenges. For example, the ACCHSs and government health services use different patient information management systems, limiting the ability to link datasets and the comparability of data available at different sites. Despite its strengths, the PAR approach is time-consuming, needs additional efforts to focus on processes, and has the potential to lead to friction among the stakeholders due to competing priorities [,]. While it can be counterproductive if not handled with care and expertise, this has been accounted for in the project design and development strategies, which are founded on the considerable expertise of the research team. The credibility and local ownership offered by the PAR approach outweigh these limitations.
Conclusions
Digital innovations have affected every aspect of our lives. It is unlikely that the current health system and health service delivery can remain isolated from such a rapid proliferation of innovative DHTs. This project provides a unique opportunity to optimize and systematically evaluate key digital health interventions. It will also highlight why DHTs work for some but not for others, identifying risk groups to create appropriate supports within the community. Furthermore, the economic analysis will help the local health board and other stakeholders make an informed decision to adopt, refine, or reject DHTs in the future. In conclusion, the project has the potential to substantially improve access to CPHC services for the remote Indigenous communities of the NT. Such improved access will help improve the health outcomes of those living in remote communities.
Acknowledgments
We acknowledge the contributions of all the project partners. We also acknowledge the ongoing guidance from our community-based colleagues and cultural mentors: Hilda Bert and Elaine Wills. This project is supported by Digital Health CRC Limited (DHCRC). DHCRC is funded under the Australian Commonwealth’s Cooperative Research Centres Program. This is a collaborative project among multiple partners across Australia, including the Commonwealth Department of Health, Northern Territory Government, Northern Territory Primary Health Network, Aboriginal Medical Services Alliances Northern Territory, Healthdirect, Australian Digital Health Agency, Menzies School of Health Research, and the University of Sydney.
Authors' Contributions
VK led the conceptualization, formal analysis, methodology, project administration, and supervision of the study and drafted, reviewed, and edited the original manuscript. DR and ES contributed to the formal analysis, methodology, supervision, and reviewing and editing of the manuscript. NN, TS, KC, AP, SN, AH, TC, PB, and JW provided significant input in drafting, revising, and editing the protocol. TS, JW, and DR served as project leads and were responsible for funding acquisition, resource allocation, project administration, and supervision. SN and AH led the conceptualization and investigation of the economic evaluation and reviewed and edited the related content.
Conflicts of Interest
None declared.
Interview guide sample.
DOCX File , 18 KBReferences
- WHO. Primary health care. Primary health care. Jan 01, 2025. URL: https://www.who.int/health-topics/primary-health-care#tab=tab_1 [accessed 2025-05-28]
- The model of Aboriginal and Torres Strait Islander community-controlled comprehensive primary health care. National Aboriginal Community Controlled Health Organisation (NACCHO). URL: https://csof.naccho.org.au/ [accessed 2025-05-28]
- NTAHF, NTG, AMSANT, DoHAC. Core functions of primary health care: a framework for the Northern Territory. Northern Territory Government. Darwin, NT. Northern Territory Government; Jan 01, 2011. URL: https://www.pc.gov.au/__data/assets/pdf_file/0003/243579/sub020-nt-children-attachment2.pdf [accessed 2025-06-02]
- Lawless A, Freeman T, Bentley M, Baum F, Jolley G. Developing a good practice model to evaluate the effectiveness of comprehensive primary health care in local communities. BMC Fam Pract. May 15, 2014;15:99. [FREE Full text] [CrossRef] [Medline]
- Australian Institute of Health and Welfare. Health and wellbeing of First Nations people. Health and wellbeing of First Nations people. Canberra. Australian Institute of Health and Welfare; Jul 02, 2024. URL: https://www.aihw.gov.au/reports/australias-health/indigenous-health-and-wellbeing [accessed 2025-05-28]
- Northern Territory Government. NT health virtual care strategy. NT health virtual care strategy. Darwin. Northern Territory Government; 2021. URL: https://health.nt.gov.au/__data/assets/pdf_file/0016/1035223/nt-health-virtual-care-strategy.pdf [accessed 2025-05-28]
- Commonwealth of Australia (Geoscience Australia). Area of Australia - states and territories. Area of Australia - states and territories. Canberra. Commonwealth of Australia (Geoscience Australia); Jun 27, 2014. URL: https://www.ga.gov.au/scientific-topics/national-location-information/dimensions/area-of-australia-states-and-territories [accessed 2025-05-28]
- Wakerman J, Humphreys J, Russell D, Guthridge S, Bourke L, Dunbar T, et al. Remote health workforce turnover and retention: what are the policy and practice priorities? Hum Resour Health. 2019;17(1):99. [FREE Full text] [CrossRef] [Medline]
- Zhao Y, Russell DJ, Guthridge S, Ramjan M, Jones MP, Humphreys JS, et al. Costs and effects of higher turnover of nurses and Aboriginal health practitioners and higher use of short-term nurses in remote Australian primary care services: an observational cohort study. BMJ Open. 2019;9(2):e023906. [FREE Full text] [CrossRef] [Medline]
- Mathew S, Fitts MS, Liddle Z, Bourke L, Campbell N, Murakami-Gold L, et al. Telehealth in remote Australia: a supplementary tool or an alternative model of care replacing face-to-face consultations? BMC Health Serv Res. Apr 05, 2023;23(1):341. [FREE Full text] [CrossRef] [Medline]
- Mullan L, Armstrong K, Job J. Barriers and enablers to structured care delivery in Australian rural primary care. Aust J Rural Health. Jan 13, 2023;31(3):361-384. [CrossRef] [Medline]
- Northern Territory Government. Remote area nurse safety: on-call after hours security. Northern Territory Government. Darwin, NT. Department of Health; 2016. URL: https://digitallibrary.health.nt.gov.au/entities/publication/cc2a3842-ee98-4e25-8ae2-48dad05810a2 [accessed 2025-05-28]
- Russell DJ, Zhao Y, Guthridge S, Ramjan M, Jones MP, Humphreys JS, et al. Patterns of resident health workforce turnover and retention in remote communities of the Northern Territory of Australia, 2013-2015. Hum Resour Health. Aug 15, 2017;15(1):52. [FREE Full text] [CrossRef] [Medline]
- St Clair M, Murtagh D, Kelly J, Clark J, Wallace R, Ford LP, et al. A collaborative approach in remote Aboriginal communities: why has telehealth worked in the Laynhapuy Homelands? 2019. Presented at: Proceedings of the 15th National Rural Health Conference Hobart; March 24-27, 2019; Hobart, Australia. URL: https://www.nintione.com.au/resources/nol/a-collaborative-approach-in-remote-aboriginal-communities-why-has-telehealth-worked-in-the-laynhapuy-homelands/
- Clair MS, Murtagh DP, Kelly J, Cook J. Telehealth a game changer: closing the gap in remote Aboriginal communities. Med J Aust. 2019;210 Suppl 6:S36-S37. [CrossRef] [Medline]
- St Clair M, Murtagh D. Barriers to telehealth uptake in rural, regional, remote Australia: what can be done to expand telehealth access in remote areas? Stud Health Technol Inform. Jan 01, 2019;266:174-182. [CrossRef] [Medline]
- Borges do Nascimento IJ, Abdulazeem HM, Vasanthan LT, Martinez EZ, Zucoloto ML, Østengaard L, et al. The global effect of digital health technologies on health workers' competencies and health workplace: an umbrella review of systematic reviews and lexical-based and sentence-based meta-analysis. Lancet Digit Health. Aug 01, 2023;5(8):e534-e544. [FREE Full text] [CrossRef] [Medline]
- Thomas LT, Lee CMY, McClelland K, Nunis G, Robinson S, Norman R. Health workforce perceptions on telehealth augmentation opportunities. BMC Health Serv Res. Feb 21, 2023;23(1):182. [FREE Full text] [CrossRef] [Medline]
- Terrill K, Woodall H, Evans R, Sen Gupta T, Ward R, Brumpton K. Cultural safety in telehealth consultations with Indigenous people: a scoping review of global literature. J Telemed Telecare. Oct 18, 2023;31(4):515-522. [CrossRef] [Medline]
- Canuto KJ, Aromataris E, Burgess T, Davy C, McKivett A, Schwartzkopff K, et al. A scoping review of Aboriginal and Torres Strait Islander health promotion programs focused on modifying chronic disease risk factors. Health Promot J Austr. Nov 14, 2019;32(1):46-74. [FREE Full text] [CrossRef] [Medline]
- Brusse C, Gardner K, McAullay D, Dowden M. Social media and mobile apps for health promotion in Australian Indigenous populations: scoping review. J Med Internet Res. Dec 01, 2014;16(12):e280. [FREE Full text] [CrossRef] [Medline]
- Perrin Franck C, Babington-Ashaye A, Dietrich D, Bediang G, Veltsos P, Gupta PP, et al. Correction: iCHECK-DH: guidelines and checklist for the reporting on digital health implementations. J Med Internet Res. May 18, 2023;25:e49027. [FREE Full text] [CrossRef] [Medline]
- Australian Bureau of Statistics. Census of population and housing - counts of Aboriginal and Torres Strait Islander Australians. Australian Bureau of Statistics. Canberra. Australian Bureau of Statistics; Aug 31, 2022. URL: https://tinyurl.com/mpnt32v2 [accessed 2025-05-28]
- Cornish F, Breton N, Moreno-Tabarez U, Delgado J, Rua M, de-Graft Aikins A, et al. Participatory action research. Nat Rev Methods Primers. Jan 01, 2023;3(1):34. [CrossRef]
- Cornwall A, Jewkes R. What is participatory research? Soc Sci Med. Jan 01, 1995;41(12):1667-1676. [CrossRef] [Medline]
- Watson DE, Broemeling AM, Wong ST. A results-based logic model for primary healthcare: a conceptual foundation for population-based information systems. Healthc Policy. Nov 01, 2009;5 Spec no(Spec No):33-46. [FREE Full text] [Medline]
- Humphreys J, Wakerman J, Kuipers P, Russell D, Siegloff S, Homer K. Improving workforce retention: developing an integrated logic model to maximise sustainability of small rural and remote health care services. The Australian National University. Canberra. The Australian National University; Nov 01, 2009. URL: https://openresearch-repository.anu.edu.au/items/97f18d93-de08-4ce8-86c2-a8b7bf9f9dbb [accessed 2025-06-02]
- Saurman E. Improving access: modifying Penchansky and Thomas's Theory of Access. J Health Serv Res Policy. Jan 01, 2016;21(1):36-39. [CrossRef] [Medline]
- Penchansky R, Thomas JW. The concept of access: definition and relationship to consumer satisfaction. Med Care. Jan 01, 1981;19(2):127-140. [CrossRef] [Medline]
- Westhorp G, Prins E, Kusters C, Hultink M, Guijt I. Realist evaluation. BetterEvaluation. Jan 01, 2025. URL: https://www.betterevaluation.org/methods-approaches/approaches/realist-evaluation [accessed 2025-05-28]
- Wong G, Westhorp G, Manzano A, Greenhalgh J, Jagosh J, Greenhalgh T. RAMESES II reporting standards for realist evaluations. BMC Med. Jun 24, 2016;14(1):96. [FREE Full text] [CrossRef] [Medline]
- Ranmuthugala G, Cunningham FC, Plumb JJ, Long J, Georgiou A, Westbrook JI, et al. A realist evaluation of the role of communities of practice in changing healthcare practice. Implement Sci. May 23, 2011;6:49. [FREE Full text] [CrossRef] [Medline]
- Wong G, Pawson R, Owen L. Policy guidance on threats to legislative interventions in public health: a realist synthesis. BMC Public Health. Apr 10, 2011;11:222. [FREE Full text] [CrossRef] [Medline]
- Wong G, Pawson R, Owen L. Policy guidance on threats to legislative interventions in public health: a realist synthesis. BMC Public Health. Apr 10, 2011;11:222. [FREE Full text] [CrossRef] [Medline]
- Perkes SJ, Bonevski B, Hall K, Mattes J, Chamberlain C, Bennett J, et al. Aboriginal and Torres Strait Islander women's access to and interest in mHealth: national web-based cross-sectional survey. J Med Internet Res. Jun 03, 2023;25:e42660. [FREE Full text] [CrossRef] [Medline]
- Richtering SS, Morris R, Soh SE, Barker A, Bampi F, Neubeck L, et al. Examination of an eHealth literacy scale and a health literacy scale in a population with moderate to high cardiovascular risk: Rasch analyses. PLoS One. Apr 27, 2017;12(4):e0175372. [FREE Full text] [CrossRef] [Medline]
- Banbury A, Taylor M, Caffery L, Der Vartanian C, Haydon H, Mendis R, et al. Consumers' experiences, preferences, and perceptions of effectiveness in using telehealth for cancer care in Australia. Asia Pac J Clin Oncol. Dec 01, 2023;19(6):752-761. [CrossRef] [Medline]
- Thomas E, Lee CMY, Norman R, Wells L, Shaw T, Nesbitt J, et al. Patient use, experience, and satisfaction with telehealth in an Australian population (Reimagining Health Care): web-based survey study. J Med Internet Res. Aug 17, 2023;25:e45016. [FREE Full text] [CrossRef] [Medline]
- Stevens JA, Dixon J, Binns A, Morgan B, Richardson J, Egger G. Shared medical appointments for Aboriginal and Torres Strait Islander men. Aust Fam Physician. Jun 01, 2016;45(6):425-429. [FREE Full text] [Medline]
- Toll K, Spark L, Neo B, Norman R, Elliott S, Wells L, et al. Consumer preferences, experiences, and attitudes towards telehealth: qualitative evidence from Australia. PLoS One. Aug 31, 2022;17(8):e0273935. [FREE Full text] [CrossRef] [Medline]
- von Huben A, Howell M, Norris S, Wong KC, Tang J, Kazi S, et al. Stakeholder preferences for attributes of digital health technologies to consider in health service funding. Int J Technol Assess Health Care. Feb 14, 2023;39(1):e12. [CrossRef] [Medline]
- Milat A, Lee K, Conte K, Grunseit A, Wolfenden L, van Nassau F, et al. Intervention scalability assessment tool: a decision support tool for health policy makers and implementers. Health Res Policy Syst. Jan 03, 2020;18(1):1. [FREE Full text] [CrossRef] [Medline]
- Digital Health CRC. Optimising digital solutions to improve access to comprehensive primary health care services in remote Indigenous communities. Digital Health CRC. Feb 01, 2024. URL: https://digitalhealthcrc.com/projects/optimising-digital-solutions-to-improve-access-to-comprehensive-primary-health-care-services-in-remote-indigenous-communities/ [accessed 2025-05-28]
- Braun V, Clarke V. Toward good practice in thematic analysis: avoiding common problems and be(com)ing a researcher. Int J Transgend Health. 2023;24(1):1-6. [FREE Full text] [CrossRef] [Medline]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. Jul 21, 2006;3(2):77-101. [CrossRef]
- Carayon P, Schoofs Hundt A, Karsh BT, Gurses AP, Alvarado CJ, Smith M, et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care. Dec 01, 2006;15 Suppl 1(Suppl 1):i50-i58. [FREE Full text] [CrossRef] [Medline]
- Fisher K, Davey AR, Magin P. Telehealth for Australian general practice: the present and the future. Aust J Gen Pract. Aug 01, 2022;51(8):626-629. [FREE Full text] [CrossRef] [Medline]
- Digital Health and Rights Project Consortium, Davis SLM. Towards digital justice: participatory action research in global digital health. BMJ Glob Health. May 17, 2022;7(5):e009351. [FREE Full text] [CrossRef] [Medline]
- Foo D, Spanos S, Dammery G, Ellis LA, Willcock SM, Braithwaite J. The rise of direct-to-consumer telemedicine services in Australia: implications for primary care and future research. Med J Aust. Aug 02, 2023;219(8):344-347. [CrossRef] [Medline]
- Warr D, Luscombe G, Couch D. Hype, evidence gaps and digital divides: telehealth blind spots in rural Australia. Health (London). Jul 01, 2023;27(4):588-606. [CrossRef] [Medline]
- Lythreatis S, Singh SK, El-Kassar A. The digital divide: a review and future research agenda. Technol Forecast Soc Change. Feb 01, 2022;175:121359. [CrossRef]
- Mishori R, Antono B. Telehealth, rural America, and the digital divide. J Ambul Care Manage. 2020;43(4):319-322. [CrossRef] [Medline]
- Koh A, Swanepoel DW, Ling A, Ho BL, Tan SY, Lim J. Digital health promotion: promise and peril. Health Promot Int. Dec 01, 2021;36(Supplement_1):i70-i80. [FREE Full text] [CrossRef] [Medline]
- Fitts MS, Russell D, Mathew S, Liddle Z, Mulholland E, Comerford C, et al. Remote health service vulnerabilities and responses to the COVID-19 pandemic. Aust J Rural Health. Nov 01, 2020;28(6):613-617. [FREE Full text] [CrossRef] [Medline]
Abbreviations
| ACCHS: Aboriginal Community Controlled Health Service |
| AHP: Aboriginal health practitioner |
| BWS: best-worst scaling |
| CPHC: comprehensive primary health care |
| DHT: digital health technology |
| iCHECK-DH: Guidelines and Checklist for the Reporting on Digital Health Implementations |
| NT: Northern Territory |
| PAR: participatory action research |
| SEIPS: Systems Engineering Initiative for Patient Safety |
Edited by A Schwartz; submitted 16.11.24; peer-reviewed by S Osman, K Tapia; comments to author 31.01.25; revised version received 13.02.25; accepted 02.05.25; published 17.09.25.
Copyright©Vishnu Khanal, Emily Saurman, Deborah J Russell, Nicki Newton, Karina Coombes, Alexandar Puruntatameri, Sarah Norris, Amy von Huben, Tamsin Cockyane, Paul Burgess, John Wakerman, Timothy Shaw. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 17.09.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.

