TABLE 13

Proposed quantitative outcome measures for assessment of alternatives to the face-to-face consultation

ParameterPotential sourceFeasibility
Patients: measures of access to care
 Awareness of availabilityQuestionnaire: PROMSuitable questions may need to be developed
 Time taken to contact the practicePROMSuitable questions exist (e.g. in the GP Patient Survey163)
 Ability to get consultation type of choice (or one at all)PROM and/or auditSuitable questions exist (e.g. in the GP Patient Survey163)
 Ability to get consultation with clinician of choicePROMSuitable questions exist (e.g. in the GP Patient Survey163)
 Ability to get appointment/consultation as soon as patient would likePROMSuitable questions exist (e.g. in the GP Patient Survey163)
 Time taken up by consultation (including getting to the surgery and waiting, time completing online questionnaire or time waiting for a telephone call, as relevant)PROMQuestions can be adapted from existing questionnaires, including the GP Patient Survey163
 Satisfaction with convenience of appointmentPROMSuitable questions exist (e.g. in the GP Patient Survey163)
 Satisfaction with interpersonal nature of the consultationPROMSuitable questions exist (e.g. in the GP Patient Survey163)
 Perceptions of support for self-carePROMValidated questions exist
 Health-related quality of lifePROMValidated measures exist (e.g. the EQ-5D or the SF-36), but lack sensitivity for primary care consultations
 Satisfaction with the outcome of the consultationPROMThere is a lack of generic measures of the outcome of primary care consultations, but a suitable measure has recently been developed164
 Quality of the consultationObserved or recorded consultationsThere are approaches to the assessment of consultation quality, although they are very labour intensive
Practices: measures of workload, cost and staff satisfaction
 Number of patient requests for different types of appointmentAuditAudit may require bespoke data collection at reception or via portals for e-consultation
 Length of consultationsRoutine data from GP systemDifficult to extract for analysis at present (see Chapter 6). Prone to errors if clinicians do not open and close patients records at the beginning and end of consultations – this is likely to be a particular problem with some forms of alternatives to the face-to-face consultation
 Total number of consultations of different types in the practice over 12 monthsRoutine data from GP systemFeasible, as demonstrated in Chapter 6. Dependent on all forms of consultation being reliably entered in patient records
 Total number of consultations with different types of staff over 12 monthsRoutine data from GP systemDependent on reliability of recording of all consultations and staff type
 Number of consultations completed with advice or prescription onlyRoutine data from GP systemMay have to be derived indirectly from lack of subsequent consultations
 Number of problems dealt with in each consultationAudit of sampleIn theory, this should be available from routine data, but because many problems are entered as free text rather than coded, this would require manual analysis of individual consultations
 Content of consultationsEstablished consultation analysis tools following direct observation or recordings; analysis of computer recordsObservation or recording of a sufficient number of consultations is laborious. Analysis of GP records may not fully represent consultation content
 Number of patients directed to other sources of careAudit of sample or routine dataCould be collected from routine data if practices use structured data entry for each consultation
 Number of follow-up consultations within 14 daysRoutine data from GP systemWe have demonstrated the feasibility of doing this and associated difficulties in Chapter 6
 Number of patients who do not attendRoutine data from GP systemFeasible from routine appointment systems
 Total consultation time per annum, taking account of number and duration of all consultationsRoutine data from GP systemLimitations relating to data about duration apply
 Cost of primary care at the practice levelRoutine data from GP systemBased on data about consultation numbers and duration and staff type. Limitations relating to data about duration apply
 Staff perceptions of training and competence to use alternativesStaff surveySuitable questions may need to be developed
 Staff satisfaction and moraleStaff surveyValidated questions can be used or adapted from existing questionnaires
The NHS
 Rates of use of out-of-hours services, emergency departments, outpatient consultations, emergency admissionsRoutine dataAll available from Hospital Episode Statistics,165 except out-of-hours services. Data may be available in GP records, but not standardised and difficult to extract
 Quality and safety of careAudit of sampleWill require expert review, sometimes difficult to achieve agreement
 Number and cost of investigationsGP recordsCan be difficult to extract and cost reliably
 Number and cost of prescriptionsGP records or NHS Prescription ServicesFeasible
 Cost of care from all NHS sourcesCombining data sources described aboveDependent on reliability and completeness of all data

EQ-5D, EuroQol-5 Dimensions; PROM, patient-reported outcome measure; SF-36, Short Form questionnaire-36 items.

From: Chapter 7, Synthesis and framework for future evaluation

Cover of The potential of alternatives to face-to-face consultation in general practice, and the impact on different patient groups: a mixed-methods case study
The potential of alternatives to face-to-face consultation in general practice, and the impact on different patient groups: a mixed-methods case study.
Health Services and Delivery Research, No. 6.20.
Atherton H, Brant H, Ziebland S, et al.
Southampton (UK): NIHR Journals Library; 2018 Jun.
Copyright © Queen’s Printer and Controller of HMSO 2018. This work was produced by Atherton et al. under the terms of a commissioning contract issued by the Secretary of State for Health and Social Care. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journals provided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should be addressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton Science Park, Southampton SO16 7NS, UK.

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.