Web-based Feedback's Potential for Quality Improvement
•
1 j'aime•1,628 vues
The document evaluates Patient Opinion, a web-based patient feedback platform, as a case study to assess its potential for driving quality improvement in healthcare. It finds that while the platform meets patients' needs for accessible, responsive and independent feedback, there is little evidence it systematically leads to quality improvement. For the platform to better support quality goals, organizations need to embed feedback into governance, learning, and change processes and promote customer-focused behaviors. The success of the platform also depends on maintaining traffic, subscriptions and champions within subscriber organizations.
![What we will cover ,[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (15)
En vedette
En vedette (15)
Similaire à Web-based Feedback's Potential for Quality Improvement
Similaire à Web-based Feedback's Potential for Quality Improvement (20)
Plus de The Tavistock Institute of Human Relations
Plus de The Tavistock Institute of Human Relations (20)
Dernier
Dernier (20)
Web-based Feedback's Potential for Quality Improvement
- 1. Assessing the potential and progress of web-based feedback for quality improvement: an evaluation using Patient Opinion as a case study Deborah Davidson, University of Birmingham Olivia Joyner, Tavistock Institute Joe Cullen, Tavistock Institute
- 6. Dual focus Individual facing: access and utilization (use by patients and public) System facing: leading to impact on quality (organisation subscribers)
- 11. Analytical Framework Research Questions Research Criteria Accessibility, Usability & choice Responsiveness Redress Independence Accountability Standards Change processes M&E Competence development Benchmarks Technical platform Service model Timeliness Governance Best practice Performance Functional attributes Response time User satisfaction SLA’s Training policy Discursive attributes Open-ness Knowledge co-production Participatory culture Values
- 19. In practice, how far are web-based systems actually overcoming existing limitations?
- 20. Impacts? Different aims and agendas? Individual facing: Wanting a voice, help others, access and utilization (use by patients and public) System facing: leading to impact on quality (organisation subscribers) Feedback platform: wanting to give service users a voice through technology- lead to impact on quality
- 21. Web-based platform for patient feedback Rationale If there is sufficient real time feedback traffic in the public domain it will lead to change. (reputational systems theory) Issue it seeks to address Lack of opportunities for service users to relate experience/to be heard. Need for public, independent, transparent feedback platform. Activities Feedback website Local Delivery Subscribers Outputs Outcomes Impacts Website- provides opportunity to publicly tell a story. Power of web to share positive and negative experiences. Engage NHS organisations as subscribers. Provide training and guidance, access to posting feedback. Subscribers inform service users of the web based platform and encourage its use. Subscribers (and non subscribers ) receive email alerts when feedback has been given. Organisation responds to feedback in a timely and considered manner. Organisation passes on feedback to services. Improvements in quality of care take place. Praise leads staff to be open to learning when later feedback is negative.
- 22. Individual Service User Level : actual experience Rationale Service users with voice = enhanced experience and satisfaction. Help others. Issue it seeks to address Lack of opportunities for service users to relate experience/to be heard Activities Feedback website Local Delivery Subscribers Outputs Outcomes Impacts Website- provides opportunity to write/tell story Local champion with commitment becomes a subscriber. Services inform service users of the web based feedback mechanism Or/and User finds mechanism on internet Individual stories/ feedback posted Feedback appears on public platform. User may receive a response from health organisation. Service user has satisfaction of voice being ‘heard’. May hear if changes have occurred.
- 23. Subscriber level: Theory of Change map Rationale Services improved by having better quality assurance and feedback mechanisms More feedback mechanism choice for service users (greater accessibility) Need to fulfil patient experience and choice agendas. ‘Tick boxes’ Issue it seeks to address Inadequacy of complaints procedures re: encouraging learning rather than encouraging contestation, defensiveness and resistance. Little choice of independent feedback mechanisms. Greater patient choice.
- 25. What factors need to be present in a healthcare organisation for platforms to allow both user objectives and quality improvement objectives to be met? Are there particular advantages or disadvantages to an independent as compared with an NHS-run feedback platform?
Notes de l'éditeur
- At a time when there is an increasing policy emphasis on patient experience, there is also increasing evidence that much of the NHS lacks effective systems for either gathering or acting upon patient feedback. This is due to a number of reasons including public cynicism about the impact of involvement (Smith, 2005); certain groups being significantly under-represented and the need for encouragement of Black and Ethnic Minority communities (Sheldon and Rasul, 2006); the need to use a range of methods as not all people have the same preferences (Ipsos MORI 2008, Entwistle et al 2003); and information developed for patients and the public is written at an above average reading ability, making it difficult for many people to understand (Coulter and Ellins, 2006). In addition, research suggests that the existing channels do not produce a satisfactory experience for those who wish to offer feedback or make a complaint. Since 1996, numerous reviews of the NHS complaints procedure have taken place, each highlighting problems and identifying improvements, for example ( Being Heard , 1994; NHS Complaints Procedure National Evaluation, 2001; Spotlight on Complaints, 2007; Is anyone listening? A report on complaints handling in the NHS, 2007; Feeding back? Learning from complaints handling in health and social care , 2008; Making Experiences Count , 2008; and more recently government policy has shifted its focus to a customer relations approach ( Listening, Improving, Responding: A guide to better customer care , 2009 ) . All of these reviews highlight the NHS complaints procedure as flawed, serving neither patients nor providers. Furthermore, they provide compelling evidence to show that in the NHS, complaints often become escalated, and positions entrenched as a result of poor initial handling of complaints by front-line staff or managers. This leads to a protracted process and a dynamic of contestation and defensiveness, instead of learning and resolution, and has led to rising litigation costs for the NHS ( Making amends. A consultation paper setting out proposals for reforming the clinical negligence system , 2005). Lastly, it seems to be clear that the proactive use of feedback to inform and drive quality improvement is far from being achieved in the NHS not just because of ineffective feedback mechanisms (Vingerhoets, 2001; Wensing, 2003; Davies and Cleary, 2005; Rogut and Hudson, 1995; and Tasa et al, 1996).
- Five research questions were posed: On the basis of existing research, in what ways do current NHS complaints and feedback mechanisms fall short in meeting the needs of users, and in realising the potential of user feedback to drive quality improvement in the NHS? In principle, how might web-based approaches offer an opportunity to overcome the limitations of existing systems for feedback? In particular, what might be the capacity of web-based feedback mechanisms to lead directly to improvements in the quality of care? In practice, how far are web-based systems actually overcoming existing limitations and helping users to give feedback when, how and if they choose to do so and to secure any action by the NHS organisation where that was their motivation for providing feedback, and being used by NHS as a contributing or indeed a driving factor in their work to improve the quality of care? If this is happening, what is the mechanism by which it is happening within those organisations? (process evaluation) What factors need to be present in a healthcare organisation for platforms like Patient Opinion to allow both user objectives and quality improvement objectives to be met? How far is the impact of such a platform within any particular healthcare organisation dependent on potentially vulnerable factors, such as key individuals or a favourable organisational context? How far is the causal chain between receipt of feedback and steps taken to improve the quality of care sustainable, strong and replicable across the constituent parts of each NHS organisation and between NHS organisations? Is there any evidence that there are particular advantages or disadvantages to an independent as compared with an NHS-run feedback platform? How significant are the underlying values and positioning of the platforms in determining the value of different feedback sites to patients and NHS stakeholders? Is there any evidence of a differential impact on feedback as a driver of quality improvement?
- Reflects a range of different evaluation ‘purposes’, balancing the need to demonstrate outcomes and impacts with the need to capture and apply learning in order to support the future development of patient review and service user feedback initiatives Incorporates a ‘theory of change’ model, aimed at identifying the explicit and implicit ‘visions’ of change that underpin these initiatives and reflecting these in evaluation methods and instruments uses a context-sensitive approach. An important challenge for the evaluation is to explore the importance of context – for example how different service user environments, involving different types of user – shape the use of such systems and their value Uses triangulation. This allows for the synthesis of evidence of different types and from different sources, and representing different stakeholder positions, in order to arrive at research conclusions. In practice, this means: multiple sources of data, including secondary data (drawn from existing studies and databases, and primary data (acquired, for instance, through case studies implemented by the evaluation); a multi-methodological approach - the research will include an element of quantitative analysis, together with qualitative data. Has an evolutionary focus and is aimed at applying the learning from the evaluation to supporting operational improvements and future strategic development
- \\
- 1. Identifying the assumptions behind them 2. Writing a narrative to explain the logic of the initiative. Connect the preconditions or requirements necessary to achieve that goal. i.e. without taking the actions you wouldn’t have the outputs, and without these outputs you would be able to achieve the outcomes or impacts.
- TOC articulates the assumptions the feedback organisation, health organisation and the individual service user has in relation to giving or managing feedback and its impacts. External factors: policy agendas, funding, other feedback mechanisms- PALS, Complaints, NHS Choices. How they impact?
- Cowan and Anthony (2008) suggest that there are two interlinked elements that lead to a decision to complain: The reason (what gave rise to the complaint) The motivation (the emotional response and expectations about what will be achieved) Reasons The HCC report suggests that issues have remained broadly consistent, with main concerns being the “fundamentals of healthcare, such as safe care and clinical treatment, and the essential elements of a considerate, customer-focused approach to complaints – such as communication and the way that the complaint was handled overall” (HCC, 2009:45) Motivation The key motivation for making a complaint is that people want to make sure that their bad experience doesn’t happen to others in the future i.e. making it better for the next person (Bark, et al, 1994; Vincent et al, 1994; Friele and Sluijs, 2006). The literature in general shows that a formal complaint is usually something that people do when they have exhausted other possibilities for redress - it is not a default option but a last resort (ref). This suggests that complaints are not being adequately well dealt with (e.g. by PALS, services) when initially raised , and this is leading them to escalate into something formal One third of trusts deal with complaints without assessing the expectations of the complainants Process April 2003: NHS complaints reform, making things right (DH, 2003) . The changes – although not radically different - set out their intention that the procedure be: open and easy to access fair and independent responsive provide an opportunity for learning and developing Friele and Sluijs (ibid) concluded that the dimensions of communication and outcome (change) are equally, if not more, important than the complaint itself.
- Use of websites to provide feedback is quick, easy and convenient, though this method may be more appropriate for certain types of feedback such as general comments and opinions rather than concerns or specific issues. Online communities are useful for generating large volumes of qualitative data from people on a specific topic or theme. They are quick and convenient and their use can increase response rates. This method is also useful for gathering ongoing feedback over longer periods of time. These communities require a significant amount of management and maintenance however. Recruiting the right members will be an important issue for organisations to address. Samples cannot be representative as internet coverage is not universal.
- Elements: business model; theory of change; drivers for change; service model; awareness raising and engagement approach: independence; traffic levels; and key success factors Customer discussion forums: Cisco systems -telecommunications supplier; Alzheimers Associaiton (USA) Market research communities: Institute of Directors Democracy and transparency websites: Mysociety.org; fixmystreet.com; writetothem.com; whatdotheyknow.com; theyworkforyou.com; planningalerts.com; Review and purchasing/booking websites: toptable.com Content submission and rating: threadless.com Multichannel contact centres: Rotherham Streetpride; irobot.com; Black & Decker Social tools and services: BBC; Topeka and Shawnee County Public Library Joining other forums: Topeka and Shawnee County Public Library
- Example for today: The model of using an external and independent web based platform for patient feedback requires the organisation to have a dual facing function: Individual facing: access, having a voice and utilization System/ NHS organisation facing: impact on quality In fact 3 way facing: 3. Has own agenda- using web 2.0 technology to give voice to services users (primary?) leading to improvements in quality. Most important is citizens, giving voice I will display The 3 TOC models, which have levels of complementarity but also some tensions. TOC helps us to evaluate if the case study site (web feedback platform) is able to facilitate both sets of needs/goals or if they have a preference/ leaning towards the individual or organisations needs?
- Overall Aims: wanted to make the wisdom and insights of patients, available to the NHS through “Web 2.0 technology. to enable citizens to engage with, and perhaps improve, their health services, by providing feedback Rationale: That the mechanism will improve quality of care because it is independent, public and transparent. referring to Reputation capital - which relies on critical mass of voice to . 1. improve services by organisations listening to what users want. 2. provided legitimacy to services through involvement of users. Local delivery: automated email alerts, tagging of relevant information i.e service and type of feedback-concern, suggestion, thank you, responding, reporting and analysis of the feedback information. Subscribers : their responsibility to promote the web based feedback platform. Outputs: after moderation of the post (based on editorial policy- remove names, offensive language). Outcomes: web based feedback platform provides training on how to respond (tone, no jargon, personal, informal) and to do so as soon as possible- Improved flow of communication/dialogue between NHS and its users. Impacts: · Feedback helps organisations: To plan how to develop and improve services; · To give doctors, nurses and managers a feel for what patients are saying about the service they manage.
- From interviewing service users and from online survey: Rationale: around 50% of postings are positive, 25 % are critical and the rest mixed. Motivation varies- gratitude, anxiety, anger and altruism (PO report). Range of Impacts: weight off my mind, feel I may have helped others, to stop it happening again Main Barrier- FEAR of reprisal
- Great variance between case study organisations
- Local delivery- Director of Nursing. bespoke and friendly responses Champion- is on Board so has authority when replying. If they went then the role would be given to someone less senior. Does not want to devolve the responsibility of replying and managing posts- only him and Head of Midwifery. Web based feedback platform aimed for as many as possible front line staff to receive emails and to respond. Outputs: If a complaint it does not go into complaint report. “doesn’t want people to start soliciting responses”. Outcomes: when issues was resolved at meeting it was not put on website- journey was not in public anymore. Changes were not seen on website. End of public dialogue. Impacts: Quality improvement is embedded in the organisation- monthly meetings. But how embedded is the feedback mechanism in the organisations quality improvement process? Not a main tool: For improvements be sustained? Need staff engagement. Knowledge of mechanism (subscribers role) and links with other feedback tools. Service users generally trust the website but do staff trust it? Issue of trust of website- due to a negative post which had the staff name in it (issue of moderation)- felt it was untrue. But Head of Nursing (PPE?) said that “staff do trust the feedback mechanism”. Tensions between front line staff and champion of web based feedback mechanisms. Need for more posts to make real changes- need more evidence before making a change. (+ to be value for money)- also need critical mass for Reputation capital to work (feedback mechanism aim)
- For external organisations, there is a dual focus – so the influencing of the healthcare organisation is difficult – key to effectiveness is proactive customer relations management
- “ the real challenge appears not to be in identifying the feedback approaches to be used, but in equipping organisations to be able to put that feedback into practice to improve services. In other words – how are different sources of feedback brought together to give organisations an overall view of the patient experience, how is feedback reported upwards (to SMTs, boards etc) and downwards (to wards, teams etc), who is responsible for actioning feedback, how do organisations monitor what they do with feedback once its gathered etc.”