The NASSS framework for ex post theorisation of technology-supported change in healthcare: worked example of the TORPEDO programme.
Complexity of innovations
Diffusion of innovation
Ex post evaluation
Implementation
Innovation adoption
NASSS framework
Non-adoption, abandonment, scale-up, spread, sustainability framework
Programme sustainability
Scale-up
Theory-driven evaluation
Journal
BMC medicine
ISSN: 1741-7015
Titre abrégé: BMC Med
Pays: England
ID NLM: 101190723
Informations de publication
Date de publication:
30 12 2019
30 12 2019
Historique:
received:
01
08
2019
accepted:
05
11
2019
entrez:
1
1
2020
pubmed:
1
1
2020
medline:
24
4
2020
Statut:
epublish
Résumé
Evaluation of health technology programmes should be theoretically informed, interdisciplinary, and generate in-depth explanations. The NASSS (non-adoption, abandonment, scale-up, spread, sustainability) framework was developed to study unfolding technology programmes in real time-and in particular to identify and manage their emergent uncertainties and interdependencies. In this paper, we offer a worked example of how NASSS can also inform ex post (i.e. retrospective) evaluation. We studied the TORPEDO (Treatment of Cardiovascular Risk in Primary Care using Electronic Decision Support) research programme, a multi-faceted computerised quality improvement intervention for cardiovascular disease prevention in Australian general practice. The technology (HealthTracker) had shown promise in a cluster randomised controlled trial (RCT), but its uptake and sustainability in a real-world implementation phase was patchy. To explain this variation, we used NASSS to undertake secondary analysis of the multi-modal TORPEDO dataset (results and process evaluation of the RCT, survey responses, in-depth professional interviews, videotaped consultations) as well as a sample of new, in-depth narrative interviews with TORPEDO researchers. Ex post analysis revealed multiple areas of complexity whose influence and interdependencies helped explain the wide variation in uptake and sustained use of the HealthTracker technology: the nature of cardiovascular risk in different populations, the material properties and functionality of the technology, how value (financial and non-financial) was distributed across stakeholders in the system, clinicians' experiences and concerns, organisational preconditions and challenges, extra-organisational influences (e.g. policy incentives), and how interactions between all these influences unfolded over time. The NASSS framework can be applied retrospectively to generate a rich, contextualised narrative of technology-supported change efforts and the numerous interacting influences that help explain its successes, failures, and unexpected events. A NASSS-informed ex post analysis can supplement earlier, contemporaneous evaluations to uncover factors that were not apparent or predictable at the time but dynamic and emergent.
Sections du résumé
BACKGROUND
Evaluation of health technology programmes should be theoretically informed, interdisciplinary, and generate in-depth explanations. The NASSS (non-adoption, abandonment, scale-up, spread, sustainability) framework was developed to study unfolding technology programmes in real time-and in particular to identify and manage their emergent uncertainties and interdependencies. In this paper, we offer a worked example of how NASSS can also inform ex post (i.e. retrospective) evaluation.
METHODS
We studied the TORPEDO (Treatment of Cardiovascular Risk in Primary Care using Electronic Decision Support) research programme, a multi-faceted computerised quality improvement intervention for cardiovascular disease prevention in Australian general practice. The technology (HealthTracker) had shown promise in a cluster randomised controlled trial (RCT), but its uptake and sustainability in a real-world implementation phase was patchy. To explain this variation, we used NASSS to undertake secondary analysis of the multi-modal TORPEDO dataset (results and process evaluation of the RCT, survey responses, in-depth professional interviews, videotaped consultations) as well as a sample of new, in-depth narrative interviews with TORPEDO researchers.
RESULTS
Ex post analysis revealed multiple areas of complexity whose influence and interdependencies helped explain the wide variation in uptake and sustained use of the HealthTracker technology: the nature of cardiovascular risk in different populations, the material properties and functionality of the technology, how value (financial and non-financial) was distributed across stakeholders in the system, clinicians' experiences and concerns, organisational preconditions and challenges, extra-organisational influences (e.g. policy incentives), and how interactions between all these influences unfolded over time.
CONCLUSION
The NASSS framework can be applied retrospectively to generate a rich, contextualised narrative of technology-supported change efforts and the numerous interacting influences that help explain its successes, failures, and unexpected events. A NASSS-informed ex post analysis can supplement earlier, contemporaneous evaluations to uncover factors that were not apparent or predictable at the time but dynamic and emergent.
Identifiants
pubmed: 31888718
doi: 10.1186/s12916-019-1463-x
pii: 10.1186/s12916-019-1463-x
pmc: PMC6937726
doi:
Types de publication
Journal Article
Research Support, Non-U.S. Gov't
Langues
eng
Sous-ensembles de citation
IM
Pagination
233Références
N Engl J Med. 2006 Dec 28;355(26):2725-32
pubmed: 17192537
BMC Med. 2018 May 14;16(1):66
pubmed: 29754584
J Med Internet Res. 2009 Dec 17;11(4):e51
pubmed: 20018588
Clin Psychol (New York). 2017 Sep;24(3):223-240
pubmed: 28966479
Int J Med Inform. 2017 Jan;97:86-97
pubmed: 27919399
J Med Internet Res. 2017 Nov 01;19(11):e367
pubmed: 29092808
BMJ Qual Saf. 2012 Nov;21(11):948-55
pubmed: 22791694
BMJ Health Care Inform. 2019 Apr;26(1):0
pubmed: 31039121
BMJ. 2004 Oct 30;329(7473):1013
pubmed: 15514347
Lancet. 2016 May 21;387(10033):2074-2075
pubmed: 27301809
Br J Gen Pract. 1991 Oct;41(351):428-30
pubmed: 1777300
J Am Heart Assoc. 2017 Oct 24;6(10):
pubmed: 29066447
Implement Sci. 2013 Jun 20;8:70
pubmed: 23786847
Int J Health Policy Manag. 2017 Jan 25;6(9):509-518
pubmed: 28949463
N Engl J Med. 2014 May 15;370(20):1944-9
pubmed: 24827040
J Med Internet Res. 2019 Mar 29;21(3):e11761
pubmed: 30924785
J Am Med Inform Assoc. 2009 May-Jun;16(3):271-3
pubmed: 19407078
Trials. 2015 May 31;16:242
pubmed: 26026849
Health Promot Int. 2020 Jun 1;35(3):598-609
pubmed: 30982066
BMJ. 2016 Jun 28;353:i3283
pubmed: 27353418
Soc Sci Med. 2010 May;70(9):1285-94
pubmed: 20185218
Implement Sci. 2018 Nov 12;13(1):140
pubmed: 30419934
J Med Internet Res. 2011 Dec 28;13(4):e124
pubmed: 22204896
Lancet. 1971 Feb 27;1(7696):405-12
pubmed: 4100731
Int J Med Inform. 2013 May;82(5):e73-86
pubmed: 23146626
Circ Cardiovasc Qual Outcomes. 2015 Jan;8(1):87-95
pubmed: 25587090
PLoS Med. 2010 Nov 02;7(11):e1000360
pubmed: 21072245
Sociol Health Illn. 2011 Nov;33(7):1002-18
pubmed: 21671947
Bull World Health Organ. 2012 May 1;90(5):357-64
pubmed: 22589569
Milbank Q. 2011 Jun;89(2):167-205
pubmed: 21676020
Milbank Q. 2004;82(4):581-629
pubmed: 15595944
J Med Internet Res. 2018 Apr 17;20(4):e150
pubmed: 29625956
Implement Sci. 2014 Dec 17;9:187
pubmed: 25515217
BMJ Open. 2012 Nov 28;2(6):
pubmed: 23192245