Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Case Report
Clinical research study
Current Issue
Editorial Board
Literature Review
Narrative review
Original Article
Research Article
Review Article
Short Report
Surgical techniques
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Case Report
Clinical research study
Current Issue
Editorial Board
Literature Review
Narrative review
Original Article
Research Article
Review Article
Short Report
Surgical techniques
View/Download PDF

Translate this page into:

37 (); 59-63
doi:
10.1016/j.jor.2023.02.009

A cross sectional survey exploring the awareness and familiarity regarding patient reported outcome measures (PROMs) among joint reconstruction surgeons in India

Orthopedics, All India Institute of Medical Sciences, Rishikesh, India
Orthopedics, All India Institute of Medical Sciences, Deoghar, India
Orthopedics, All India Institute of Medical Sciences, Bhatinda, India
Orthopedics, Fortis Hospital, Mohali, Punjab, India
Orthopedics, Kerala Institute of Medical Sciences, Thiruvananthapuram, India

∗Corresponding author: Sitanshu Barik. sitanshubarik@gmail.com

Disclaimer:
This article was originally published by Reed Elsevier India Pvt. Ltd. and was migrated to Scientific Scholar after the change of Publisher.

Abstract

Abstract

The aim of this study is to describe the usage of PROM, its use or lack of use, barriers in using it and its future prospect among the arthroplasty surgeons from a developing country like India.

An online survey was conducted by emailing an anonymous questionnaire to orthopaedic surgeons working in three tertiary care academic institutions and two tertiary care private hospitals. All orthopaedic surgeons or residents who have been performing or assisting in arthroplasty and arthroscopy were included in the study. The study was cross-sectional in design based on a single response from all surgeons.

The mean age of the 87 surgeons participating in this study was 38.6 ± 4.7 years. 62.1% of surgeons had used PROMs for both clinical as well as research purposes at some point. 25.9% of surgeons had an adequate understanding of the function, benefits, and drawbacks of PROMs. Among the barriers against using PROMs, time constraint was agreed upon by most of the surgeons (59.5%). 64.3% of surgeons were willing to incorporate the PROMs into their daily practice if the barriers are overcome.

The limitations of use of PROM should also be borne in mind before embarking on its widespread implementation. Involvement of regulatory and professional societies as well as substantial investment in manpower, money and time is required for making the use of PROMs regular.

Keywords

Patient reported outcome measure
PROM
Arthroplasty
Survey
1

1 Introduction

The need for arthroplasty surgery by patients is more subjective than objective. Patient reported outcome measures (PROMs) are an ideal way to objectively assess the pre-operative and post-operative condition of the patient with the efficacy of the intervention being indirectly documented.1 Although useful, they come with their own set of challenges like choosing the right PROM, lack of standardization and readability which can impact the score.2

Although literature is awash with studies on PROM in orthopedics, there is paucity of information regarding the perception about PROM and its usage among arthroplasty surgeons from a developing country like India. Previous studies have shown North America and Europe having the most widespread usage of PROM in orthopedics.3 Lack of time and usage barriers in their institutes were cited as the most common reasons for not using PROM in North America and Europe.3 These reasons may or may not be same in a developing country where the standard of healthcare is vastly different from the developed world.4 The aim of this study is to describe the usage of PROM, its use or lack of use, barriers in using it and its future prospect among the arthroplasty surgeons from a developing country like India.

2

2 Methods

An online survey was conducted by emailing an anonymous questionnaire to orthopaedic surgeons who have been performing or assisting in arthroplasty and arthroscopy. The study was cross-sectional in design based on a single response from all surgeons. The questionnaire was designed by five independent orthopaedic surgeons after exploring all the literature regarding the use of PROMs in joint surgeries in PubMed/MEDLINE, EMBASE, and Google scholar using the keywords “PROs”, “PROMs”, “survey”, “arthroplasty”, “arthroscopy”, “joint replacement”, “sports injury”, “orthopaedics”. Of the five surgeons who prepared the questionnaire, three belonged to a public run teaching institutes of national importance and two belonged to private sector hospitals. The articles were thoroughly reviewed to note the utility, limitations, and barriers in using PROMs. The surveys conducted in different regions on the same or related topics were also reviewed to form the final questionnaire.

2.1

2.1 Study questionnaire

The survey was conducted online based on questionnaires distributed as Google Forms. The objectives of the study were explained at the beginning of the questionnaire. All of the participants were also assured of the confidentiality and anonymity of the data. Informed consent was obtained from the participants before conducting the study. The study questionnaire consisted of forty questions in total divided into four sections. The first section was about acquiring the basic details regarding the surgeon and his practice. It has basic questions regarding age, gender, place of work, specialty, and years of experience. The next section was about familiarity and current use of PROMs consisting of four questions. The following section has been formulated to provide us with an idea about the beliefs regarding PROMs. This section has been subdivided to know the perception of the surgeons regarding preoperative and postoperative use of PROMs which consisted of sixteen questions. Moreover, five questions addressed other common beliefs on PROMs. This section had five responses provided in all questions to assess the degree of acceptance of the statement provided namely- Strongly agree, Agree, Neutral, Disagree, and Strongly disagree. The last section addressed the concepts regarding barriers in using PROMs. These questions were aimed at exploring the obstacles faced by all surgeons while using PROMs so that they can be overcome. Lastly, one question was added to know if all obstacles were obliterated whether the surgeon is willing to use PROMs in his daily practice.

A pilot study was conducted including 10 orthopaedic surgeons for testing comprehensibility, ease of reading, and acceptability of questionnaires. Each question was assessed for suitability on a Likert scale of 1–5 (1: suitable to 5 highly suitable). Missing responses for each question was also assessed. Data from the pilot study were not included in the main study.

2.2

2.2 Statistical analysis

The data collection took a period of one month by emailing the questionnaires. The responses were assessed by converting them into excel sheets. The percentages of all responses to individual questions (excluding the missing responses) was computed. All other categorical variables were expressed as percentages. The Chi-square test was used to find an association between categorical variables. All of the statistical analyses will be performed in SPPS v 26.0.

3

3 Results

The pilot study among the 10 surgeons showed good comprehensibility. The mean Flesch reading ease score was 91 ± 4.3. None of the questions underwent any change after the pilot study. The mean time to answer the questionnaire was 6.2 ± 0.9 min. There were no missing responses in the pilot study.

The mean age of the 87 surgeons participating in this study was 38.6 ± 4.7 years. The majority of the surgeons were aged between 30 and 40 years (39.7%) (Table 1). A total of 42.9% of respondent surgeons were working in an academic institution, 35.7% in a government medical college, 9.5% in corporate hospitals, 7.1% in private owned medical colleges, and 4.8% surgeons were working in a standalone clinic of their own. The majority of respondents (35.4%) were having a work experience of 10–15 years in the field of orthopaedics. Among the total respondents, 73.6% (64 out of 87) surgeons were familiar with one or more of the existing PROMs (Table 2). Only 2.4% of these surgeons were using PROMs for daily clinical purposes and 14.9% were using them for research purposes. Surprisingly, a total of 62.1% of surgeons had used PROMs for both clinical as well as research purposes at some point. PROMs were being used for a duration of 1–3 years by 35.7% of participants, less than 1 year by 26.4%, and more than 3 years by 17.2% of participants. Although the majority of the PROMs were being filled at the clinic (66.7%), 11.5% of PROMs were online based and custom-built methods of collecting PROMs were being used by 4.6% of participants. The Visual Analog Scale (VAS) was used for assessing the pain by 47.1% of surgeons. The Harris Hip Score (HHS) was used for assessing functional assessment of hip pathologies by 11.3% of surgeons. The most commonly used knee functional score was Oxford Knee Score (33.4%), followed by WOMAC score (21.7%), and Knee Society Score (20.9%) in descending order. The forgotten joint score was being used by 5.6% of surgeons and 15.1% of surgeons were using the Short Form 12 score for quality of life assessment.

Table 1 Table showing basic details of the participants of this study (The numbers are expressed as percentages of total respondents).
Gender
Male 94.6
Female 5.4
Age
<30 17.6
30–40 39.7
40–50 34.8
>50 7.9
Place of work
Institution 42.9
Government medical college 35.7
Private medical college 7.1
Corporate hospital 9.5
Private clinic of their own 4.8
Years of experience in orthopaedics
<1 year 3.6
1–5 years 31.8
5–10 years 21.9
10–15 years 35.4
>15 years 7.3
Table 2 Table showing pattern of use of PROMs among the arthroplasty surgeons (The numbers are expressed as percentages of total respondents).
Familiarity with the existing PROMs
Yes 73.6
No 26.4
Current use of PROMs
For daily clinical purposes 2.3
For research purposes only 14.9
For both clinical and research purposes 62.1
Never used PROMs 20.7
Duration of using PROMs
<1 year 26.4
1–3 years 35.7
>3 years 17.2
Never used PROMs 20.7
Method of using PROMs
Clinic-based collection (PROM filled at clinics) 66.7
Online based (PROM sent and received online) 11.5
Custom-built 4.6
Never used PROMs 17.2
If using PROMs at present, what are they?
VAS 47.1
HHS 11.3
FJS 5.6
WOMAC 21.7
KSS 20.9
OKS 33.4
SF 12 15.1

The majority of the surgeons agreed that the PROMs can be a useful tool to identify a patient in need of a procedure (57.1%) and help the surgeon set a baseline functional status (59.1%) or prioritize the clinical problems to be addressed (61.9%) (Table 3). Most of the participants had a strong agreement about PROM's ability to facilitate doctor-patient communications (42.9%) and agree with the fact that it can also increase patient engagement in treatment plans (57.1%). Another advantage of PROM can be predicting the potential benefits from the planned treatment according to 59.5% of surgeons. A total of 42.9% of surgeons agreed that legal aspects of the practice can also be benefited if the surgeon is documenting a proper PROM.

Table 3 Table denoting use of PROMs in preoperative and postoperative period (The numbers are expressed as percentages of total respondents).
Preoperatively PROMs can … Strongly agree Agree Neutral Disagree Strongly disagree
identify a patient in need of a procedure 26.2 57.1 16.7
help set a baseline patient functional status 31.3 59.1 9.6
detect patient's expectations from the treatment 33.3 42.9 21.4 2.4
help prioritize which clinical problems to address in a patient 21.3 61.9 14.3 2.5
facilitate the communication between the patient and the doctor 42.9 38.1 16.7 1.3 1.1
increase the patient engagement in the treatment plan 21.4 57.1 21.4
predicting potential benefits from the planned treatment 14.3 59.5 14.3 9.3 2.6
help the surgeon on a legal background to support correct indications 28.6 42.9 26.2 2.4
Postoperatively PROMs can … Strongly agree Agree Neutral Disagree Strongly disagree
monitor the response to the treatment 26.2 54.1 14.3 2.1 3.3
assess the satisfaction of the patient 31 54.8 11.9 1.7 0.7
assess the need for any modification in rehabilitation or plan additional procedures 33.3 47.6 14.3 2.4 2.4
help to monitor a surgeon's performance 19 23.8 45.2 8.4 3.6
help to monitor the quality of healthcare 14.3 57.1 19 7.1 2.4
help to monitor patient outcomes from their home 54.8 23.8 21.4
help to detect complications from the procedure 9.5 47.6 31.3 4.8 6.8

A strong agreement was observed among most of the surgeons (54.8%) regarding the benefits of PROM in the assessment of the patients from home during the postoperative period (Table 3). Most of the surgeons agreed that the PROM can help in monitoring the response to treatment (54.1%), assess the satisfaction of the patient (54.8%), help in monitoring the quality of healthcare (57.1%), and help to detect any complications (47.6%). However, a neutral response was observed from most of the surgeons (45.2%) regarding the role of PROMs in assessing a surgeon's performance.

Only 25.9% of surgeons had an adequate understanding of the function, benefits, and drawbacks of PROMs, while the majority of them (57.1%) were neutral about their knowledge regarding the same (Table 4). However, a total of 66.7% of surgeons agreed that PROMs can be a valuable addition to the management plan, and 64.3% of surgeons believed that PROMs are a transparent way to assess patient outcomes. Although very few of the surgeons (19% agreed, 20.5% strongly agreed) agreed that their patients can accurately and honestly report their health status by PROMs, a large proportion of surgeons disagreed on the same (21.4% agreed, 16.6% strongly disagreed). The majority of the respondents (50%) believed that PROMs are the best way to report outcomes of a procedure while publishing research.

Table 4 Table depicting trends regarding beliefs about PROMs (The numbers are expressed as percentages of total respondents).
Belief regarding PROMs Strongly agree Agree Neutral Disagree Strongly disagree
I believe I have an adequate understanding of PROMs with regards to their function, benefits, and drawbacks 25.9 57.1 14.3 2.7
I believe PROMs can be a valuable addition to the management plan 19 66.7 11.9 2.4
I believe PROMs are an important and transparent way to assess the patient outcomes 11.4 64.3 14.3 4.9 5.1
I believe that my patients have the ability to accurately and honestly represent their health with PROMs 20.5 19 22.5 21.4 16.6
I believe PROMs are the best way to report our outcomes in the field of research 23.8 50 21.4 2.4 2.4

Among the barriers against using PROMs, time constraint was agreed upon by most of the surgeons (59.5%) (Table 5). A large proportion of respondents agreed that PROMs interpretation can be difficult for patients due to the language barrier (14.3% strongly agree, 42.9% agree) as well as the IQ barrier (5.8% strongly agree, 36.7% agree). However, there was an equivocal response among surgeons regarding the difficulty in interpretation of PROMs by a healthcare worker (7.1% strongly agree, 31% agree, 4.8% strongly disagree, and 21.4% disagree). In addition, 26.2% of respondents strongly agreed and 35.7% of respondents agreed that PROMs may be too subjective. The lack of infrastructure was reported as a barrier to incorporating PROM into their practice by many surgeons (11.9% strongly agree, 35.7% agree). Lastly, 64.3% of surgeons were willing to incorporate the PROMs into their daily practice if the barriers are overcome and 14.3% of surgeons were in doubt if they would be able to incorporate the PROMs or not.

Table 5 Table depicting trends regarding barriers about using PROMs (The numbers are expressed as percentages of total respondents).
Barriers in using PROMs Strongly agree Agree Neutral Disagree Strongly disagree
There is a time constraint 15.3 59.5 12.4 12.8
There is manpower constraint 28.6 33.3 31 7.1
There is difficulty in interpretation for the healthcare worker 7.1 31 35.7 21.4 4.8
There is difficulty in interpretation for patients due to the language barrier 14.3 42.9 28.6 14.3
There is difficulty in interpretation for patients due to the IQ barrier 5.8 36.7 32.4 19.4 5.7
PROMs are too subjective 26.2 35.7 31 7.1
There is a lack of infrastructure in my setup to incorporate PROM 11.9 35.7 19 26.2 7.1
Already incorporated Yes No Maybe
If all barriers are removed, would you be interested in incorporating PROMs in daily life practice 21.4 64.3 14.3
4

4 Discussion

The measure of outcomes in healthcare can be subjective or objective and PROMs are objective tools to measure health outcome. The development, validation and testing of PROMs have become an integral part of modern medicine. PROMs are validated questionnaires filled by the patients during the treatment phase to assess the outcomes objectively. They usually comprise various sections on general, physical and mental health as well as on quality of life. It can also be focussed on a particular disease or particular joint of the body. Healthcare values have been defined as a balance between costs and health outcomes and hence this need to focus on PROMs in the last few years.5

India currently lacks any study or objective data regarding the use of PROMs among the arthroplasty and arthroscopy surgeons. The aim of this study is to describe the usage of PROM, its use or lack of use, barriers in using it and its future prospect among the arthroplasty surgeons from a developing country like India. This study showed numerous interesting facts. A few worth mentioning about are.a)62.1% of surgeons had used PROMs for both clinical as well as research purposes at some pointb)majority of the PROMs were being filled at the clinic (66.7%)c)facilitate doctor-patient communications (42.9%)d)42.9% of surgeons agreed that legal aspects of the practice can also be benefited if the surgeon is documenting a proper PROMe)help in monitoring the response to treatment (54.1%)f)help in monitoring the quality of healthcare (57.1%)g)25.9% of surgeons had an adequate understanding of the function, benefits, and drawbacks of PROMsh)Among the barriers against using PROMs, time constraint was agreed upon by most of the surgeons (59.5%)i)64.3% of surgeons were willing to incorporate the PROMs into their daily practice if the barriers are overcome

The field of practice has been seen to influence the usage of PROMs, e.g., orthopedics has more validated PROMs than maxillofacial surgery thus leading to more orthopedicians being aware of and using PROMs rather than maxillofacial surgeons.3,6 This is proved in this study where 62.1% of arthroplasty surgeons had used PROM at one point or the other, either for clinical or research purposes. The increased familiarity may be due to increasing number of post graduate residency seats in the country and PROM being used in some form or other to assess outcomes in the dissertation of the residents. Also, many reputed publications and journals now insist on standardized and validated PROMs to assess outcomes objectively in submitted manuscripts. Apart from these, with growing litigation in the urban centers of the country, these tools are handy as evidence in the court of law. Furthermore, many researchers have undertaken to translate and validate the regional versions of many tools for which would lead to its widespread use in India even in patients not literate in English.

It has been noted that there are various logistical and perceptual barriers to widespread PROM use in orthopedics practice.7 Logistical barriers are examples like time constraints and accessing PROMs in the electronic records while perceptual barriers are the understanding capability of the patient and surgeons concerns regarding the validity of the PROM tool. Surgeons usually believe speaking directly to patients is of much greater benefit than using PROMs in assessing outcomes.3,7–9 For widespread incorporation of PROM into clinical care, well designed PROM with good psychometric properties is the need of the hour and from the patient's perspective, these tools should enhance patient-doctor communication rather than curtailing them. Substantial investment in terms of resources and time have to be done by researchers, surgeons and patients for making PROM more widespread.

Predicting patient benefit from arthroplasty has also been seen as one of the top current use by a previous study.10 There is a need to increase usage among the surgical care team as well as to complete all the surveys among the patients within the required time frame for PROMs to become an effective prognostic tool.11 Successful incorporation PROM have been reported by institutes in the Western world and this would require apart from the apparent stakeholders, involvement of regulatory agencies and professional societies like Indian Orthopedic Association (IOA), state chapters of IOA, Indian Society of Hip and Knee Surgeons and Indian Arthroplasty Association.12

Similarly, before embarking on a widespread use, the limitations of use of PROM should also be borne in mind. Choosing the correct tool which is validated for the specific population is crucial. The history of the tools should also be noted because many had been developed for research purposes and its extrapolation to routine clinical use may be controversial. Data collection is another aspect which needs to be thought into. On site feedback collection is a popular method but patients may not be in an ideal physical or mental state to give correct and true responses and they also may be concerned about the quality of care they might receive post such feedback. Post-contact information collection may lead to low response rates. All the patients might not be well fluent in the language of the validated tool which places the need for translated and validated versions for its widespread use.

This cross-sectional study is the first study assessing and analysing the use of PROM among Indian arthroplasty surgeons. The research was led by researchers from a variety of workplaces such as academic institutions of national repute as well as well-known private hospitals. This would have taken care of the opinion of the public sector and private sector surgeons equally. The researchers are from different parts of the country implying widespread dissemination of the questionnaire and fairly generalised response analysis. The small sample size may be a limiting factor for a huge country like India but nevertheless, the findings of this study would let us analyse more about PROMs and how to put into use more effectively and on a widespread way, both for clinical and research purposes.

5

5 Conclusion

Though a fairly large number of surgeons were aware of PROMs, the surgeons regularly using it for clinical or research purpose is low. Majority of the surgeons did not have adequate understanding of the function, benefits, and drawbacks of PROMs. Time constraint was the major barrier restricting its widespread use. Involvement of regulatory and professional societies as well as substantial investment in manpower, money and time is required for making the use of PROMs regular.

Funding/sponsorship

This research did not receive any specific grant from funding agencies in the public, commercial or not-for-profit sectors.

Informed consent (patient/guardian), mandatory only for case reports/clinical images

NA.

Institutional ethical committee approval (for all human studies)

Obtained 2022-28-IND-02 (AIIMS Deoghar).

Authors contribution

a) Dr Souvik Paul – Methodology, Formal analysis, Data Curation

b) Dr Sitanshu Barik - Methodology, Formal analysis, Data Curation, Writing - Original Draft, Writing - Review & Editing.

c) Dr Vikash Raj – Conceptualization, Supervision, Project administration, Writing - Review & Editing.

d) Dr Manish Raj - Conceptualization, Supervision, Project administration, Writing - Review & Editing.

e) Dr Roop Bhushan Kalia - Conceptualization, Supervision, Project administration, Writing - Review & Editing.

f) Dr Tarun Goyal - Conceptualization, Supervision, Project administration, Writing - Review & Editing.

g) Dr Manit Arora - Conceptualization, Supervision, Project administration, Writing - Review & Editing.

h) Dr Muhammed Nazeer - Conceptualization, Supervision, Project administration, Writing - Review & Editing.

References

  1. , , , , . Achieving satisfaction with patient-reported outcomes: PROMS. 2020:311-327.
    [Google Scholar]
  2. , , , , , , . Current trends in patient-reported outcome measures in total joint arthroplasty: a study of 4 major orthopaedic journals. J Arthroplasty. 2018;33(11):3416-3421.
    [Google Scholar]
  3. , , , , , , . Use of patient-reported outcome measures (PROMs) by orthopedic surgeons in Saudi Arabia. J Orthop Surg Res. 2020;15(1):598.
    [Google Scholar]
  4. , . Access and barriers to health care delivery in Arab countries: a review. East Mediterr Health J. 2012;18(12):1239-1246.
    [Google Scholar]
  5. , . Meaningful clinical applications of patient-reported outcome measures in orthopaedics. J Bone Jt Surg. 2021;103(1):84-91.
    [Google Scholar]
  6. , , , et al . Large variation in use of patient-reported outcome measures: a survey of 188 foot and ankle surgeons. Foot Ankle Surg. 2018;24(3):246-251.
    [Google Scholar]
  7. , , , et al . What do orthopaedists believe is needed for incorporating patient-reported outcome measures into clinical care? A qualitative study. Clin Orthop Relat Res. 2022;480(4):680-687.
    [Google Scholar]
  8. , , , . The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf. 2014;23(6):508-518.
    [Google Scholar]
  9. , , , . Current challenges in using patient-reported outcomes for surgical care and performance measurement: everybody wants to hear from the patient, but are we ready to listen? JAMA Surg. 2014;149(6):505-506.
    [Google Scholar]
  10. , , , et al . Orthopedic surgeon and care team perceptions and use of patient-reported outcomes in total joint replacement patients. Bull Hosp Jt Dis. 2021;79(3):176-186.
    [Google Scholar]
  11. , , . Using patient-reported outcomes in clinical practice: challenges and opportunities. Qual Life Res. 2009;18(1):99-107.
    [Google Scholar]
  12. , . Building a patient-reported outcome metric database: one hospital's experience. J Arthroplasty. 2016;31(6):1151-1154.
    [Google Scholar]
Show Sections