Choosing Wisely Canada Explained

Choosing Wisely Canada (CWC) is a Canadian-based health education campaign launched on April 2, 2014 under the leadership of Wendy Levinson, in partnership with the Canadian Medical Association, and based at Unity Health Toronto and the University of Toronto.[1] The campaign aims to help clinicians and patients engage in conversations about unnecessary tests, treatments and procedures, and to assist physicians and patients in making informed and effective choices to ensure high quality care.[2]

The campaign is based on the notion that unnecessary tests, treatments, and procedures often do more harm than good, resulting in poor clinical outcomes and significant waste in the Canadian healthcare system.[3] These unnecessary tests and procedures take away from care by potentially exposing patients to harm, leading to more testing to investigate false positive tests, and contributing to unnecessary anxiety and avoidable costs for patients.[4] Choosing Wisely Canada aims to encourage and empower physicians to assimilate, evaluate, and implement the ever-increasing amount of evidence on current best practice. The campaign also supports the equally important role of patient education and the need to dispel the false notion that "more care is better care".

Central to the campaign are lists of "Things Clinicians and Patients Should Question" developed by more than eighty Canadian specialty societies. These lists are intended to encourage clinicians to adopt a "think twice" attitude to avoid unnecessary and potentially harmful tests and procedures, and to foster discussions between patients and clinicians about inappropriate care. The campaign also uses patient-friendly education materials to complement these lists, as well as teaches medical trainees about resource stewardship. As of June 2, 2021, 400 clinician recommendations and 39 lay language patient educational materials have been released.

Choosing Wisely Canada leads an international community, made up of nations who are implementing similar programs in their respective countries. At present, this community includes representation from Australia, Austria, Brazil, Denmark, England, France, Germany, India, Israel, Italy, Japan, Netherlands, New Zealand, South Korea, Switzerland, United States and Wales.

Motivation

Choosing Wisely Canada stems from worldwide concern around providing unnecessary treatment when the risk of harm exceeds its potential benefit ("medical overuse").[5] A number of studies have highlighted the prevalence of medical overuse in Canada, which include findings that approximately 50% of prescriptions for respiratory infections in Saskatchewan are inappropriate,[6] 28% of lumbar spine MRIs in Alberta and Ontario are unnecessary,[7] and 28% of bone mineral density scans are inappropriate.[8] These unnecessary invasive procedures and low-value care are major causes of preventable harm and increased waste of medical resources.[9] Medical overuse has been associated with decreased patient satisfaction and poor clinical outcomes, including higher mortality.[10] A systematic survey of patients in seven countries revealed that 10–20% of patients believed that their physicians had provided treatment of little or no value in the past two years.[11] Further studies highlighted the financial strain of medical overuse, such as the analysis conducted by the Institute of Medicine, which found that up to 30% of American health care spending is on unnecessary tests and procedures.[12] In 2017, a joint report between Choosing Wisely Canada and the Canadian Institute for Health Information found up to 30% of tests and treatments were unnecessary based on eight campaign recommendations. [13] In light of these concerns, Choosing Wisely Canada hopes to optimize value, reduce waste and improve patient outcomes by promoting patient-physician conversations about low-value care.

History

Choosing Wisely Canada is modeled after the Choosing Wisely campaign launched by the ABIM Foundation of the American Board of Internal Medicine in the United States in 2012.[14] Wendy Levinson, a Canadian physician and previous chair of the ABIM Board of Directors, was involved in launching the Choosing Wisely campaign in the United States.[15] After its successful launch, she decided to bring the movement to Canada and partnered with the Canadian Medical Association and the University of Toronto to launch Choosing Wisely Canada on April 2, 2014.[1] In the first wave of the campaign, nine national medical specialty societies released evidence-based lists of 41 tests, treatments and procedures that provided no benefit or potentially caused harm to patients.

Under the leadership of Wendy Levinson and the Canadian Medical Association, Choosing Wisely Canada initially gained momentum in Ontario and subsequently became a national movement.[16] The second and third waves of physician recommendation lists and patient education materials were launched on October 29, 2014, and June 2, 2015, respectively.[17] As of June 2, 2015, more than 80 Canadian medical specialty societies are engaged and at various stages of recommendations development. In total, 400 clinician recommendations and 39 lay language patient educational materials have been released in the three waves from 2014–2015.

Campaign

Choosing Wisely Canada has adopted a multi-faceted campaign approach, engaging clinicians, patients, and medical trainees at all levels. The campaign has partnered with more than 80 Canadian medical specialty societies to develop evidence-supported lists of "Things Clinicians and Patients Should Question", hoping to promote conversation about inappropriate care. The underlying premise is that clinicians must lead such conversations, since they determine the appropriate or inappropriate use of resources. CWC has also developed complementary patient-friendly education materials, and has begun to embed lessons focusing on resource stewardship in undergraduate and postgraduate medical curricula.[17] In order to unify grassroots projects occurring across Canada to implement clinician recommendations, CWC additionally developed the Early Adopters Collaborative, which serves as a "learning platform for sharing knowledge, tools and experiences among participating organizations".[18]

Clinician Recommendations Lists

At the core of the campaign are lists of "Things Clinicians and Patients Should Question" developed by national specialty societies representing a broad spectrum of clinicians. These lists contain tests, treatments or procedures commonly used in their specialty, but which are not supported by evidence, and/or could expose patients to unnecessary harm.[19]

List items recommend practices to be avoided and typically begin with the word "Don't" or "Avoid"; for example, one of the recommendations released in the first wave of the campaign was Don't order screening chest X-rays and ECGs for asymptomatic or low risk outpatients.[20] National specialty societies are free to determine the process for generating their lists, as long as they are done in accordance with the following principles:

  1. The development process is thoroughly documented and publicly available
  2. Each recommendation is within the specialty's scope of practice (and not pertaining to other specialties such as family medicine)
  3. Tests, treatments or procedures included are those that (a) are frequently used, and, (b) may expose patients to harm or stress.
  4. Each recommendation is supported by evidence

Choosing Wisely Canada recommendations are not intended to be used to establish payment and coverage decisions. Rather, the lists are meant to spur conversation about what is appropriate and necessary treatment. As each patient situation is unique, Choosing Wisely Canada recommends that its materials be used as guidelines for clinicians and patients to determine an appropriate treatment plan together.[21]

Patient education

In order to encourage patients to initiate conversations about unnecessary care, Choosing Wisely Canada uses patient-friendly materials with lay language to complement the lists of "Five Things Clinicians and Patients Should Question". These patient educational materials are meant to inform patients about the tests, treatments and procedures used within various medical specialties, when they may or may not be necessary, and what patients can do to improve their overall health.[22] For example, one of the patient educational materials released on June 2, 2015, addressed concerns regarding the amount of bed rest required to treat lower back pain, advising that staying in bed longer than 48 hours will not help, and in fact, may actually delay recovery.[23]

An editorial was written by Wendy Levinson in The Toronto Star as a part of the weekly feature titled "Doctor's Notes". The article highlighted the Choosing Wisely campaign and encouraged patients to engage in conversations with their physicians about unnecessary care.[24]

Other campaign avenues

Healthcare stakeholder groups have mobilized around the CWC campaign at provincial and local levels. Choosing Wisely Canada has regional campaigns in all provinces and territories. At the local level, hospitals, health regions and clinician groups across the country are working under their own initiative to find innovative ways to put the recommendations into practice. Such local implementation efforts are beginning to emerge across Canada, with activities ranging from clinician and patient education, to modifying clinical processes and information systems, to providing data back to providers about their practice patterns.

Another major aspect of the campaign is engaging medical trainees at all levels. The Draft 2015 CanMEDS Framework identifies leadership as one of seven essential physician competencies, urging medical professionals to "engage in the stewardship of health care resources", particularly to "allocate health care resources for optimal patient care" and "to apply evidence and management processes to achieve cost-appropriate care".[25] In order to embody these ideals, CWC is working with Canadian medical schools to introduce new content focussing on resource stewardship into the undergraduate, postgraduate and continuing medical education curricula.

On the media front, the campaign includes partnerships with patient organizations and media outlets to develop and disseminate complementary content to increase patient awareness, and to support them in conversations surrounding inappropriate care.

Examples

Choosing Wisely Canada recommendations range from avoiding overuse of broad practices such as unnecessary and potentially harmful screening, diagnostic and radiographic services, to specific tests which are not supported by evidence to improve patient outcomes.

Examples of recommendations which advise against overuse of broad practices include:

Examples of specific low-value tests to avoid in certain circumstances include:

Challenges

Campaign leaders have identified a number of challenges which could potentially undermine the efforts of Choosing Wisely Canada. Since reducing unnecessary tests and procedures may result in lowering healthcare costs, the campaign may be viewed as a cost-cutting or rationing measure, which could in turn "undermine both physician engagement and patient trust."[30] Consequently, the campaign is centered around patient safety with particular emphasis on quality of care. Furthermore, Choosing Wisely Canada recommendations do not determine payment for individual services.

Some physicians report feeling pressure to engage in defensive medicine (e.g., ordering more tests than necessary) because they feel that it will help them avoid litigation.[31] The Canadian healthcare system is also set up so that specialty physicians get paid for tests and procedures conducted, and not for practicing conservative medicine.[32] Such a system may create a pattern for physicians to recommend more treatment. This pattern may also contribute to unwilling of physicians to put recommendations on their lists pertaining specifically to their specialty, instead focusing their recommendations on overuse by other specialties.

Evaluation of the campaign has also been identified as a major challenge. Campaign leaders concede that measuring the impact of Choosing Wisely is complex and may require multiple approaches, including physician and patient awareness of the campaign, documented curriculum inclusion in medical curricula, and demonstrated reduction in unnecessary testing following campaign efforts.[33] Measuring progress of reduction in inappropriate care is particularly complex, since "the definition of appropriateness often includes knowing about symptoms and physical exam findings often not included in electronic health records and administrative databases". Recognizing the complexity of evaluation efforts, Choosing Wisely Canada along with other international Choosing Wisely movements is working with the Organization for Economic Co-operation and Development to develop metrics that might be used to compare countries on specific measures of overuse, as well to develop cross-country metrics.

Since patient education is a core facet of the campaign, communication with patients presents another challenge. Some campaign recommendations may require clinical education for complete comprehension.[34] Furthermore, many patients tend to follow physician recommendations without question, even if they have questions. As such, a major portion of the campaign focuses on encouraging patients to initiate conversations about unnecessary care. Additionally, Choosing Wisely Canada has developed patient-friendly materials with straightforward, lay language to explain common tests, with a "When you need them and when you don't" approach. These materials complement the lists of "Five Things Physicians and Patients Should Question" developed by specialty societies.

Reception

The response to Choosing Wisely Canada has been positive, with clinicians across the country expressing support for the campaign and highlighting the need for more resource stewardship. Danielle Martin, family physician and Vice-President Medical Affairs and Health Systems Solutions at Women's College Hospital, lists Choosing Wisely Canada as one of three major ideas to improve Canadian healthcare, highlighting that "Choosing Wisely Canada is not a rationing or cost-cutting exercising. It is about reorganizing healthcare services so we only do things for people that truly benefit their health."[35] Chris Simpson, past president of the Canadian Medical Association, Professor of Medicine and Chief of Cardiology at Queen's University, Kingston, notes "Physicians are really embracing the principles behind Choosing Wisely. It's all about the right thing to do for patients and avoiding the harm that can come from unnecessary testing. Let's do more of what works and…and less of what is done 'just in case'. Society expects us to lead the way, and the physicians of Canada intend to do just that".[36]

Rick Glazier, senior scientist in primary care and population health at the Institute for Clinical Evaluative Sciences in Toronto, highlights two aspects of the campaign that he believes are unique and have great potential. "The first", he states, "is that it's targeted to the public, and the second is that it's driven not only by scientists and medical journals, but by the professional organizations themselves. For radiologists to come forward and say you shouldn't order radiology tests under these circumstances, this is unprecedented".[37]

The final report of the Advisory Panel on Healthcare Innovation to Rona Ambrose, Minister of Health (Canada), saluted Choosing Wisely Canada "as an innovative physician-led and patient-centered approach that has the potential to shift healthcare away from a culture of consumption to a focus on appropriateness and quality of care". Furthermore, the panel urged "governments to support the implementation of [Choosing Wisely Canada] in all jurisdictions and to carefully evaluate its impact".[38]

In addition to endorsements from eminent physician leaders and professional organizations, Choosing Wisely Canada received positive media coverage in national media sources, including The Globe and Mail,[39] the Canadian Broadcasting Corporation,[40] and the Toronto Star,[41] which heralded Choosing Wisely Canada as one of the top medical breakthroughs of the year.

On the other hand, early criticism of Choosing Wisely in the United States highlighted that some specialty recommendations addressed overuse of resources by primary care specialties, instead of addressing unnecessary tests and procedures conducted by their own specialty colleagues.[42] Choosing Wisely Canada responded to such criticisms by setting guidelines for its list development, which required recommendations put forward by specialty societies to pertain specifically to the specialty's scope of practice.

Many physician bloggers assert that most medical overuse is a result of practicing defensive medicine in an effort to avoid lawsuits.[43] Others recognize the noble goal of reducing overuse and harm, but lament that the lists are too simplistic and do not necessarily advance the identification of low-value care, but merely synthesize "agreed-upon, well-established practices".[44]

A critique of the Choosing Wisely campaign published in the Journal of the American Medical Association by Clement and Charlton highlights a number of shortcomings in the overall movement. While the critique commends the campaign for succeeding in its goal of promoting conversations about low-value care, the authors of the critique believed that the process of list development were based on "quasi-systematic methods that focus on physician participation to increase support".[45] The critique additionally called for increased evidence of the efficacy of the "Top Five" lists in terms of reduction in wasteful practices. Clement and Charlton furthermore warn of "Top Five List Burnout", noting that when faced with multiple guidelines on a single topic, physicians become confused regarding which protocol to follow.[45] In spite of these criticisms, Clement and Charlton "strongly believe in the global spirit behind the Choosing Wisely campaigns and movement" and "advocate that the priority in 2015 should be thoughtful implementation and rigorous evaluation of existing top five lists".

Impact

Choosing Wisely Canada has identified a multifaceted evaluation approach to measure its impact, which includes:

Evaluation of campaign impact on patient education and receptiveness included a randomized control trial entitled EMPOWER (Eliminating Medications Through Patient Ownership of End Results), led by Cara Tannenbaum, geriatrician and professor in the Faculties of Medicine and Pharmacy at the Université de Montréal.[46] The trial recruited more than 300 patients aged 65–95 years in the greater Montréal area who were long term users of benzodiazepines. Approximately half the patients were exposed to educational intervention, which included Choosing Wisely recommendations around excessive benzodiazepine therapy. The patients were then followed for 6 months. The study found that 62% of patients who received the intervention initiated conversation regarding benzodiazepine therapy discontinuation with physicians and/or pharmacists. After six months, 27% of the intervention group had stopped taking benzodiazepines, compared with 5% of the patients who did not receive the educational intervention.

The impact of Choosing Wisely Canada on test ordering and utilization was studied at the North York General Hospital in the Greater Toronto Area, one of the early adopters of the campaign. A multi-faceted campaign was implemented particularly in the hospital Emergency Department in June, 2014. Test utilization in the Emergency Department was analyzed between September 15 and November 21, 2014, and compared to the same 10-week period in 2013 to account for any seasonal variances.[47] The study found a 41% decline in the number of laboratory tests ordered pre- and post- CWC program implementation, without any observable change in outcomes. A preliminary cost analysis revealed annual departmental savings of approximately $215,000 while maintaining the same quality of care.

A quality improvement initiative based on CWC principles was launched under the supervision of Danielle Martin at the Women's College Hospital (WCH) in Toronto. The American Thyroid Association and Choosing Wisely Canada recommends testing only Thyroid Stimulating Hormone (TSH) levels rather than testing both TSH and free thyroid hormones (such as T4) for assessment of suspected hypothyroidism, since majority of patients with hypothyroidism will present with abnormal TSH levels. A baseline audit at Women's College Hospital revealed that 60% of all free thyroid hormones tests were performed in patients who had normal TSH levels, amounting to approximately $50,000 annually in additional laboratory testing expenditure.[48] A "Reflex T4" approach was implemented at WCH, wherein free T4 tests would not be conducted unless TSH levels are abnormal, or if there are clinical indications of situations when measurement of free thyroid hormones would be necessary. When it is found that TSH levels are abnormal, free T4 levels would then be automatically measured.[48] In addition to reducing inappropriate thyroid function testing, the impact of Choosing Wisely Canada is felt through numerous physician and patient awareness campaigns conducted at the hospital.[48]

Medical education efforts of CWC are currently centered at the University of Toronto, where Choosing Wisely principles are integrated into the undergraduate and postgraduate medical curricula through Problem-Based Learning seminars, lectures, resident research projects and academic half days.[49]

Following the example of Choosing Wisely in the United States and Choosing Wisely Canada, health leaders from Australia, Austria, Brazil, Denmark, England, France, Germany, India, Israel, Italy, Japan, Netherlands, New Zealand, South Korea, Switzerland, and Wales have committed to initiating similar campaigns revolving around medical stewardship and low-value care in their respective countries. Italy has integrated the principles of Choosing Wisely in a campaign called "Doing more does not mean doing better", and the Netherlands has launched "Choosing Wisely Netherlands", both contributing to a growing international Choosing Wisely movement[50]

Partners

Choosing Wisely Canada[51] is supported by the University of Toronto, Unity Health Toronto (Toronto) and the Canadian Medical Association. It receives funding from the Canadian Medical Association, along with grants from federal, provincial and territorial ministries of health, and other partner organizations and agencies.

The specialty societies participating in the campaign include:The national medical organizations endorsing CWC include:

Choosing Wisely Canada has also partnered with a number of patient and community groups which include:

Further reading

  1. Levinson W, Huynh T. Engaging physicians and patients in conversations about unnecessary tests and procedures: Choosing Wisely Canada. CMAJ. 2014 Mar 18;186(5):325-6.
  2. Grady D, Redberg RF. Advancing medical professionalism and the choosing wisely campaign-reply. JAMA Intern Med. 2015 Mar 1;175(3):465.
  3. Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA; Choosing Wisely International Working Group. 'Choosing Wisely': a growing international campaign. BMJ Qual Saf. 2015 Feb;24(2):167-74.
  4. O'Callaghan G, Meyer H, Elshaug AG. Choosing wisely: the message, messenger and method. Med J Aust. 2015 Mar 2;202(4):175-7.
  5. Wolfson D, Santa J, Slass L. Engaging physicians and consumers in conversations about treatment overuse and waste: a short history of the choosing wisely campaign. Acad Med. 2014 Jul;89(7):990-5.
  6. Morgan DJ, Wright SM, Dhruva S. Update on medical overuse. JAMA Intern Med. 2015 Jan;175(1):120-4.
  7. Bhatia RS, Levinson W, Lee DS. Low value cardiac testing and Choosing Wisely. BMJ Qual Saf. 2015 Feb;24(2):89-91.
  8. Morden NE, Colla CH, Sequist TD, Rosenthal MB. Choosing wisely—the politics and economics of labeling low-value services. N Engl J Med. 2014 Feb 13;370(7):589-92.
  9. Shah N, Levy AE, Moriates C, Arora VM. Wisdom of the Crowd: Bright Ideas and Innovations From the Teaching Value and Choosing Wisely Challenge. Acad Med. 2015 Jan 6.
  10. Fenton JJ, Franks P, Feldman MD, Jerant A, Henry SG, Paterniti DA, Kravitz RL. Impact of patient requests on provider-perceived visit difficulty in primary care. J Gen Intern Med. 2015 Feb;30(2):214-20.

External links

Notes and References

  1. Levinson W, Huynh T. Engaging clinicians and patients in conversations about unnecessary tests and procedures: Choosing Wisely Canada. CMAJ. 2014 Mar 18;186(5):325-6.
  2. Canadian Medical Association [website]. Choosing Wisely Canada.Ottawa, ON: Canadian Medical Association; 2014. Available from:www.cma.ca/En/Pages/choosing-wisely-canada.aspx.
  3. Horwitz LI, Masica AL, Auerbach AD. Introducing Choosing Wisely®: Next steps in improving healthcare value. J Hosp Med. 2015 Mar;10(3):187-9
  4. News: ANDRÉ PICARD: When health care becomes unnecessary care . The Globe and Mail. 14 July 2015.
  5. Morgan DJ, Wright SM, Dhruva S. Update on medical overuse. JAMA Intern Med. 2015 Jan;175(1):120-4
  6. Wang, E. E., Einarson, T. R., Kellner, J. D., & Conly, J. M. (1999). Antibiotic prescribing for Canadian preschool children: evidence of overprescribing for viral respiratory infections. Clinical infectious diseases, 29(1), 155-160.
  7. Emery, D. J., Shojania, K. G., Forster, A. J., Mojaverian, N., & Feasby, T. E. (2013). Overuse of magnetic resonance imaging. JAMA Internal Medicine,173(9), 823-825.
  8. Papaioannou A, Morin S, Cheung AM, Atkinson S, Brown JP, Feldman S, et al. 2010 clinical practice guidelines for the diagnosis and management of osteoporosis in Canada: Summary. CMAJ. 2010 Nov 23;182(17):1864-73.
  9. Berwick, D. M., & Hackbarth, A. D. (2012). Eliminating waste in US health care. Jama, 307(14), 1513-1516.
  10. Fisher, E. S., Wennberg, D. E., Stukel, T. A., Gottlieb, D. J., Lucas, F. L., & Pinder, E. L. (2003). The implications of regional variations in Medicare spending. Part 1: the content, quality, and accessibility of care. Annals of Internal Medicine, 138(4), 273-287.
  11. Schoen, C., Osborn, R., Doty, M. M., Bishop, M., Peugh, J., & Murukutla, N. (2007). Toward higher-performance health systems: adults' health care experiences in seven countries, 2007. Health Affairs, 26(6), w717-w734.
  12. Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM. Measuring Low-Value Care in Medicare. JAMA Intern Med. 2014. Epub ahead of print.
  13. https://www.cihi.ca/en/unnecessary-care-in-canada Unnecessary Care in Canada | CIHI
  14. Harvey EJ. Choosing wisely (and carefully) Canada. Can J Surg. 2014 Jun;57(3):149, 151.
  15. Smith, C. D., & Levinson, W. S. (2015). A Commitment to High-Value Care Education From the Internal Medicine Community. Annals of Internal Medicine,162(9), 639-640
  16. Gupta S, Detsky AS. Development of Choosing Wisely Recommendations for an Inpatient Internal Medicine Service. JAMA Intern Med. 2015 Feb 23.
  17. Vogel, L. More Hospitals Choose Wisely.CMAJ June 8, 2015 cmaj.109-5078
  18. Holton, E. Choosing Wisely: Tackling Unnecessary X-rays in the ICUS. St. Michael's Hospital Newsroom. Available at: http://www.stmichaelshospital.com/media/detail.php?source=hospital_news/2015/20150624_hn
  19. Hurley, R. (2014). Can doctors reduce harmful medical overuse worldwide?. BMJ, 349, g4289.
  20. Canadian Association of Radiologists. Medical imaging primer with a focus on x-ray usage and safety [Internet]. [Cited 2014 Feb 15]. Available from: http://www.car.ca/uploads/standards%20guidelines/20130128_en_guide_radiation_primer.pdf .
  21. Baron RJ, Wolfson D. Advancing medical professionalism and the choosing wisely campaign. JAMA Intern Med. 2015 Mar 1;175(3):464-5.
  22. Wolfson D, Santa J, Slass L. Engaging physicians and consumers in conversations about treatment overuse and waste: a short history of the choosing wisely campaign. Acad Med. 2014 Jul;89(7):990-5.
  23. Recommendations target overuse of unnecessary medical procedures. BCMJ, Vol. 57, No. 6, July, August 2015, page(s) 237–238.
  24. Web site: Why that medical test might not be necessary The Star. Toronto Star. 10 August 2015.
  25. Frank, J. R., Snell, L., & Sherbino, J. (2014). The Draft CanMEDS 2015: Physician Competency Framework. Ottawa: Royal College of Physicians and Surgeons of Canada
  26. Mitera, G., Earle, C., Latosinsky, S., Booth, C., Bezjak, A., Desbiens, C., ... & Porter, G. (2015). Choosing Wisely Canada Cancer List: Ten Low-Value or Harmful Practices That Should Be Avoided In Cancer Care. Journal of Oncology Practice, 11(3), e296-e303.
  27. Natarajan MK, Paul N, Mercuri M, Waller EJ, Leipsic J, Traboulsi M, et al. Canadian Cardiovascular Society position statement on radiation exposure from cardiac imaging and interventional procedures. Can J Cardiol. 2013 Nov;29(11):1361-8.
  28. The Endocrine Society. Testosterone Therapy in Adult Men with Androgen Deficiency Syndromes: An Endocrinology Society Clinical Practice Guideline [Internet]. 2010 [cited 2015 Jun 18]. Available from: http://www.endocrine.org/~/media/endosociety/Files/Publications/Clinical%20Practice%20Guidelines/FINAL-Androgens-in-Men-Standalone.pdf
  29. Hicks, L. K., Bering, H., Carson, K. R., Haynes, A. E., Kleinerman, J., Kukreti, V., ... & Wood, W. A. (2014). Five hematologic tests and treatments to question. ASH Education Program Book, 2014(1), 599-603
  30. Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA; Choosing Wisely International Working Group. 'Choosing Wisely': a growing international campaign. BMJ Qual Saf. 2015 Feb;24(2):167-74
  31. [Kevin Volpp|Volpp, K. G.]
  32. Allin, S., & Rudoler, D. (2015). The Canadian Health Care System, 2014.International Profiles of Health Care Systems, 21.
  33. Bhatia, R. S., Levinson, W., & Lee, D. S. (2014). Low value cardiac testing and Choosing Wisely. BMJ quality & safety, bmjqs-2014.
  34. Brody H. Talking with patients about cost containment. J Gen Intern Med. 2014 Jan;29(1):5-6.
  35. Web site: Danielle Martin's Three Big Ideas to Improve Healthcare .
  36. Web site: Choosing Wisely to Avoid Harm .
  37. Glauser W. Choosing Wisely campaign well received. CMAJ. 2014 May 13;186(8):E239-40.
  38. Web site: Report of the Advisory Panel on Healthcare Innovation: "Unleashing Innovation: Excellent Healthcare for Canada" .
  39. News: Medical Associations to Urge Canada's Doctors to Limit Unnecessary Tests . The Globe and Mail. 18 February 2014. Grant. Kelly.
  40. Web site: Unnecessary Medical Tests Need a Rethink .
  41. Web site: Doctors Weigh in on 2013's Biggest Medical Breakthroughs . Toronto Star. 27 December 2013.
  42. Morden, N. E., Colla, C. H., Sequist, T. D., & Rosenthal, M. B. (2014). Choosing wisely—the politics and economics of labeling low-value services.New England Journal of Medicine, 370(7), 589-592
  43. Web site: Why 'Choosing Wisely' Won't Protect You in a Lawsuit .
  44. Siemens DR, Finelli A. Choosing Wisely Canada: It's our turn. Can Urol Assoc J. 2014 Jul;8(7-8):E580-1.
  45. Clement, F., & Charlton, B. (2015). Challenges in Choosing Wisely's international future: support, evidence, and burnout. JAMA Internal Medicine,175(4), 644-645
  46. Tannenbaum C, Martin P, Tamblyn R, Benedetti A, Ahmed S. Reduction of inappropriate benzodiazepine prescriptions among older adults through direct patient education: the EMPOWER cluster randomized trial. JAMA Intern Med. 2014 Jun;174(6):890-8.
  47. Web site: CWC in North York General Hospital ED .
  48. Gilmour, J., Weisman, A., Vecchiarelli, J., Orlov, S., Goldberg, R. J., & Goldberg, A. (2015). THR-191: Reducing Inappropriate Thyroid Function Tests at an Academic Ambulatory Hospital: Baseline Assessment for a Quality Improvement Initiative.
  49. Leon-Carlyle, M., & Srivastava, R. (2014). Medicine's Push for Resource Stewardship in Education and Practice. University of Toronto Medical Journal,92(2).
  50. Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA; Choosing Wisely International Working Group. 'Choosing Wisely': a growing international campaign. BMJ Qual Saf. 2015 Feb;24(2):167-74.
  51. Web site: Choosing Wisely Canada Partners . 2015-07-17 . https://web.archive.org/web/20150712023806/http://www.choosingwiselycanada.org/partners/ . 2015-07-12 . dead .