How Outcome Measures Could Support Transactional Analysts in Clinical Practice to Improve Treatment Trajectories, Manage Risk, Minimise Client Drop-Out Rates and Support Clinical Supervision.
Main Article Content
Abstract
This article presents a review of the literature on the use of Outcome Measures (OMs) in counselling and psychotherapy. Recent Transactional Analysis (TA) research and literature has focussed on the theory and practice of using Outcome Measures (OM) with clients who present with depression, anxiety, and other mood disorders which support the evidence base for the effectiveness of TA. The use of OMs amongst counsellors, psychotherapists remains low, with time constraints during sessions, and the perception of an increase in the burden of their workload and paperwork. Counsellors and psychotherapists report that clients dislike completing the OMs, they are uncertain over which OMs to use and when, and they have had insufficient training on how to use and interpret OM data. Some counsellors and psychotherapists fear that OMs will interrupt or damage the therapeutic relationship and working alliance. Recent studies estimate that only between 7% and 37% of counsellors and psychotherapists utilise OMs as part of their clinical practice. Research studies have found that many counsellors and psychotherapists overestimate their clinical effectiveness by up to 65% and clients who plateau, deteriorate, and subsequently drop out of treatment are missed. The current research with counsellors and psychotherapists who use OMs confound these perceptions, and corroborate that OMs are; convenient, improve the treatment process and trajectory, engage clients in being able to express themselves and see their progress, support ethical practice, clarifies the clients' strengths and vulnerabilities, supports interpersonal functioning, identifying areas of difficulty or stress, screen for and manage risk. This article will explore these issues and give more depth and detail into the ‘pros and cons’ of OM use in private practice and suggest some practical ways to implement OM theory into clinical practice.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
The work in this journal is licensed under Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
References
American Psychological Association (2006). Evidence-Based Practice in Psychology. The American Psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271
Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using Client Feedback to Improve Couple Therapy Outcomes: A Randomized Clinical Trial in a Naturalistic Setting. Journal of Consulting and Clinical Psychology, 77(4), 693–704. https://doi.org/10.1037/a0016062
Beck, A. T., Steer, R. A., & Brown, G. (1996). Beck Depression Inventory–II. PsycTESTS Dataset. doi:10.1037/t00742-000
Benelli, E., Revello, B., Piccirillo, C., Mazzetti, M., Calvo, V., Palmieri, A.,Widdowson, M. (2016). TA Treatment of Depression: A Hermeneutic Single-Case Efficacy Design Study - ‘Sara.’ International Journal of Transactional Analysis Research & Practice, 7(1). doi:10.29044/v7i1p3
Benelli, E., Filanti, S., Musso, R., Calvo, V., Mannarini, S., Palmieri, A., & Widdowson, M. (2017). TA Treatment of Depression: A Hermeneutic Single-Case Efficacy Design Study - ‘Caterina.’ International Journal of Transactional Analysis Research & Practice, 8(1). doi:10.29044/v8i1p21
Bergin, A. E., & Garfield, S. L. (1994). Handbook of psychotherapy and behavior change. Wiley.
Berne, E. (1961). Transactional analysis in psychotherapy: A systematic individual and social psychiatry. Grove Press.
Berne, E. (1963c) The structure and dynamics of organizations and groups. New York: Grove Press
Berne, E. (1964) Games People Play. Grove Press
Berne, E. (1966) Principles of Group Treatment. Grove Press
Berne, E. (1968c) A layman’s guide to psychiatry and psychoanalysis. New York: Simon and Schuster.
Berne, E. (1969e) Standard nomenclature. Transactional Analysis Bulletin, 8(32), 111-112.
Berne, E. (1972) What do you say after you say hello? The psychology of human destiny. New York: Grove Press.
Berne. (1975). What do you say after you say hello? the psychology of human destiny. Corgi.
Beutler, L. E., Malik, M. L., Alimohamed, S., Harwood, T. M., Talebi, H., Noble, S., & Wong, E. (2004). Therapist Variables. In M. J. Lambert (Ed.), Bergin and Garfield’s Handbook of Psychotherapy and Behavior Change (5th ed., pp. 227-306). New York: Wiley.
Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W. T., Noser, K., Wilson, S. J., & Karver, M. S. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31(1), 70-74. doi:10.1037/0735-7028.31.1.70
Bickman, L. (2005). A Common Factors Approach to Improving Mental Health Services. Mental Health Services Research, 7(1), 1-4. doi:10.1007/s11020-005-1961-7
Black, W., Owen, J., Chapman, N., Lavin, K., Drinane, J. M., & Kuo, P. (2017). Feedback informed treatment: An empirically supported case study of psychodynamic treatment. Journal of Clinical Psychology, 73(11), 1499–1509. https://doi.org/10.1002/jclp.22529
Bohanske, R. T., & Franczak, M. (2010). Transforming public behavioral health care: A case example of consumer-directed services, recovery, and the common factors. In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (pp. 299–322). American Psychological Association. https://doi.org/10.1037/12075-010
Boholst, F. A. (2002). A Life Position Scale. Transactional Analysis Journal, 32(1), 28-32. doi:10.1177/036215370203200105
Boisvert, C. M., & Faust, D. (2006). General Psychotherapy Research Knowledge Questionnaire. PsycTESTS Dataset. doi:10.1037/t24918-000
Boswell, J. F., Castonguay, L. G., & Wasserman, R. H. (2010). Effects of psychotherapy training and intervention use on session outcome. Journal of Consulting and Clinical Psychology, 78(5), 717-723. doi:10.1037/a0020088
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2013). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6-19. doi:10.1080/10503307.2013.817696
Bower, P. and Gilbody,S. (2010) Chapter 1: The Current View of Evidence and Evidence-Based Practice, In: Barkham, M., Gardy, G.E., and Mellor-Clark, J. (Eds) Developing and Delivering Practice-Based Evidence; A Guide for the Psychological Therapies. Wiley-Blackwell, UK.
Bugatti,M., & Boswell, J. F. (2022). Clinician perceptions of nomothetic and individualized patient-reported outcome measures in measurement-based care. Psychotherapy Research, 1–12. https://doi.org/10.1080/10503307.2022.2030497
Callaly, T., Hyland, M., Coombs, T., & Trauer, T. (2006). Routine outcome measurement in public mental health: Results of a clinician survey. Australian Health Review, 30(2), 164. doi:10.1071/ah06016
Chapman, N.A., Winklejohn Black, S.,Drinane, J.M., Bach, N., Kuo, P., Owen, J.J. (2017) Quantitative Performance Systems. In Rousmaniere, T., Goodyear, R. K., Miller, S. D., & Wampold, B. E. (Eds). The cycle of excellence: Using deliberate practice to improve supervision and training. Wiley Blackwell.
Choy, A. (1990) The Winners Triangle.TAJ, 20(1), 40-46.doi:10.1177/036215379002000105
Christensen, A., & Jacobson, N. S. (1994). Who (or What) Can Do Psychotherapy: The Status and Challenge of Nonprofessional Therapies. Psychological Science, 5(1), 8-14. doi:10.1111/j.1467-9280.1994.tb00606.x
Clarkson, P. (1992). Transactional analysis psychotherapy: An integrated approach. Tavistock/Routledge.
Cooper, M. (2012). Essential research findings in counselling and psychotherapy: The facts are friendly. SAGE.
Boyd, H., and Cowles-Boyd, (1980) Blocking Tragic Scripts. Transactional Analysis Journal, 10(3);227-9
Crossman, P. (1966) Permission and Protection. Transactional Analysis Bulletin. 5 (19), 482-4
Duncan, B. L. (2002). The legacy of Saul Rosenzweig: The profundity of the dodo bird. Journal of Psychotherapy Integration, 12(1), 32-57. doi:10.1037/1053-0479.12.1.32
Duncan, B., Miller, S., Sparks, J., Claud, D., Reynolds, L., Brown, J., & Johnson, L. (2003). The Session Rating Scale: preliminary psychometric properties of a “working” alliance measurement. Journal of Brief Therapy, 3(1), 3-12.
Duncan, B. L. (2010). On becoming a better therapist. doi:10.1037/12080-000
Duncan, B. L. (2010). The heart & soul of change: Delivering what works in therapy. American Psychological Association.
Duncan, B. L., Miller, S. D., Wampold, B. E., & Hubble, M. A. (Eds.). (2010). The heart and soul of change: Delivering what works in therapy (2nd ed.). American Psychological Association. https://doi.org/10.1037/12075-000
Edwards, D., & Arntz, A. (2012). Schema therapy in historical perspective. In M. van Vreeswijk, J. Broersen, & M. Nadort (Eds.), The Wiley-Blackwell handbook of schema therapy (pp. 3–26). Wiley.
Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000). CORE: Clinical Outcomes in Routine Evaluation. Journal of Mental Health (Abingdon, England), 9(3), 247–255. https://doi.org/10.1080/713680250
Gabbay, J., & May, A. L. (2011). Practice-based evidence for healthcare: Clinical mindlines. Routledge.
Garland, A. F., Hurlburt, M. S., & Hawley, K. M. (2006). Examining Psychotherapy Processes in a Services Research Context. Clinical Psychology: Science and Practice, 13(1), 30–46. https://doi.org/10.1111/j.1468-2850.2006.00004.x
Geller, J. D., Norcross, J. C., & Orlinsky, D. E. (2005). The psychotherapist's own psychotherapy: Patient and clinician perspectives. Oxford University Press.
Gentelet, B., & Widdowson, M. (2016). Paradoxical Alliances in Transactional Analysis Psychotherapy for Anxiety. Transactional Analysis Journal, 46(3), 182-195. doi:10.1177/0362153716650657
Goldberg, S. B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W. T., Whipple, J. L., Miller, S. D., & Wampold, B. E. (2016). Creating a climate for therapist improvement: A case study of an agency focused on outcomes and deliberate practice. Psychotherapy, 53(3), 367–375. https://doi.org/10.1037/pst0000060
Goulding, R. and Goulding, M. (1972) in; Progress in Group and Family Therapy. Edited by Clifford J. Sager and Helen Singer Kaplan. London: Butterworth, for Brunner/Mazel, New York. 1972. Pp. 935. British Journal of Psychiatry, 123(572), 124–124. https://doi.org/10.1192/bjp.123.1.124
Goulding, R. and Goulding, M. (1976) Injunctions, decisions and redecisions. Transactional Analysis Journal 6, 1, pp41-48
Gough, H. G. (1960). The adjective check list as a personality assessment research technique. Psychological Reports, 6(1), 107–122. https://doi.org/10.2466/pr0.1960.6.1.107
Gough, H. G., & Heilbrun, A. B., Jr. (2007). Adjective check list manual (1983 ed.). Consulting Psychologists Press.
Goussakovski, V., & Sizikova, M. (2017). Paradoxical Findings Regarding Therapist Empathy Based on Length of Professional Experience. Transactional Analysis Journal, 47(2), 112-125. doi:10.1177/0362153717691976
Green, D., & Latchford, G. (2012). Maximising the Benefits of Psychotherapy. doi:10.1002/9781119967590
Gyani, A., Shafran, R., Myles, P., & Rose, S. (2014). The Gap Between Science and Practice: How Therapists Make Their Clinical Decisions.
Hall, C. L., Taylor, J., Moldavsky, M., Marriott, M., Pass, S., Newell, K.,Hollis, C. (2014). A qualitative process evaluation of electronic session-by-session outcome measurement in child and adolescent mental health services. BMC Psychiatry, 14(1). doi:10.1186/1471-244x-14-113 Hall et al., 2014;
Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155-163. doi:10.1002/jclp.20108
Hargaden, H and Sills, C. (2002) Transactional Analysis: A Relational Perspective. Hove: Brunner –Routledge.
Hargaden,H., & Sills, C. (2001). Deconfusion of the Child Ego State: A Relational Perspective. Transactional Analysis Journal, 31(1), 55–70. https://doi.org/10.1177/036215370103100107
Hatfield, D. R., & Ogles, B. M. (2004). The Use of Outcome Measures by Psychologists in Clinical Practice. Professional Psychology: Research and Practice, 35(5), 485-491. doi:10.1037/0735-7028.35.5.485
Hatfield, D. R., & Ogles, B. M. (2007). Why Some Clinicians Use Outcome Measures and Others Do Not. Administration and Policy in Mental Health and Mental Health Services Research, 34(3), 283-291. doi:10.1007/s10488-006-0110-y
Hatfield, D., Mccullough, L., Frantz, S. H., & Krieger, K. (2009). Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clinical Psychology & Psychotherapy. doi:10.1002/cpp.656
Holland, R. (2009). Improving access to psychological therapies: the intention. London Journal of Primary Care, 2(1), 50–51. https://doi.org/10.1080/17571472.2009.11493243
Holloway, W. H. (1973) Shut the escape hatch: In the Monograph series, Numbers 1-10. Ohio, Midwest Institute for Understanding.
Holloway, M., & Holloway, H. (1973). The contract setting process (Monograph VII). In M. M. Holloway & W. H. Holloway, The monograph series of Midwest Institute for human understanding: Numbers I–IX (pp. 34–39). Medina, OH: Midwest Institute for Human Understanding.
Ionita, G., & Fitzpatrick, M. (2014). Bringing science to clinical practice: A Canadian survey of psychological practice and usage of progress monitoring measures. Canadian Psychology/Psychologie Canadienne, 55(3), 187-196. doi:10.1037/a0037355
Ionita, G., Fitzpatrick, M., Tomaro, J., Chen, V. V., & Overington, L. (2016). Challenges of Using Progress Monitoring Measures: Insights From Practicing Clinicians. Journal of Counseling Psychology, 63(2), 173–182. https://doi.org/10.1037/cou0000122
Ionita, G., Ciquier, G. & Fitzpatrick, M. (2020). Barriers and Facilitators to the Use of Progress-Monitoring Measures in Psychotherapy. Canadian Psychology/Psychologie Canadienne, 61 (3), 245-256. doi: 10.1037/cap0000205.
Ishikawa, H., Sogo, M., Wada, M., (1984) Handbook of TEG Tokyo: Kanek-Shobo 1984 (In Japanese)
Jensen-Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C. F., & Hawley, K. M. (2018). Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice. Administration and Policy in Mental Health and Mental Health Services Research, 45(1), 48–61. https://doi.org/10.1007/s10488-016-0763-0
Kahler, T., and Capers, H. (1974). The miniscript. Transactional Analysis Journal, 4(1), 26-42.
Kaluzeviciute, G. (2020). Social Media and its Impact on Therapeutic Relationships. British Journal of Psychotherapy, 36(2), 303–320. https://doi.org/10.1111/bjp.12545
Knox,S., Connelly, J., Rochlen, A. B., Clinton, M., Butler, M., & Lineback, S. (2020). How Therapists Navigate Facebook with Clients. Training and Education in Professional Psychology, 14(4), 265–276. https://doi.org/10.1037/tep0000267
Karpman, S. (1968) Fairy tales and script drama analysis. Transactional Analysis Bulletin, 7(26) pp 9-43.
Kraus, D. R., Seligman, D., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285–314. doi:10.1002/jclp.20084
Kroenke, K., Spitzer, R. L., & Williams, J. B. (1999). Patient Health Questionnaire-9. PsycTESTS Dataset. doi:10.1037/t06165-000
Lambert, M., Burlingame, G.M. and Hansen, N.B. (1996) The Reliability and Validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy. Vol 3. (4) 249-258
Lambert, M. J., & Hawkins, E. J. (2001). Using Information About Patient Progress in Supervision: Are outcomes Enhanced? Australian Psychologist, 36(2), 131–138. https://doi.org/10.1080/00050060108259645
Lambert, M. J., and Ogles, B.M. (2004). The efficacy and effectiveness of psychotherapy. In. Michael J. Lambert (Ed), Bergin and Garfield's handbook of psychotherapy and behavior change / by. Wiley.
Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association. https://doi.org/10.1037/12141-000
Lambert, M. J. (2013). Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed.). John Wiley & Sons.
Lambert, M. J., & Shimokawa, K. (2011). Collecting Client Feedback. Psychotherapy Relationships That Work, 203-223. doi:10.1093/acprof:oso/978019973
Lambert, M. J., & Harmon, K. L. (2018). The merits of implementing routine outcome monitoring in clinical practice. Clinical Psychology: Science and Practice, 25(4). doi:10.1111/cpsp.12268
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H.,Kroenke, K. (2019). Implementing Measurement-Based Care in Behavioral Health. JAMA Psychiatry, 76(3), 324. doi:10.1001/jamapsychiatry.2018.33
Lilienfeld, S.O. and Lynn, S.J. (2015). Errors/Biases in Clinical Decision Making. In The Encyclopedia of Clinical Psychology (eds R.L. Cautin and S.O. Lilienfeld). https://doi.org/10.1002/9781118625392.wbecp567
Little, R. (2011). Impasse Clarification within the Transference-Countertransference Matrix. Transactional Analysis Journal, 41(1), 23–38. https://doi.org/10.1177/036215371104100106
Macdonald, J., & Mellor-Clark, J. (2014). Correcting Psychotherapists' Blindsidedness: Formal Feedback as a Means of Overcoming the Natural Limitations of Therapists. Clinical Psychology & Psychotherapy, 22(3), 249-257. doi:10.1002/cpp.1887
McLeod, J. (2017) Qualitative Methods for Routine Outcome Measurement. In Rousmaniere, T., Goodyear, R. K., Miller, S. D., & Wampold, B. E. (Eds). The cycle of excellence: Using deliberate practice to improve supervision and training. Wiley Blackwell.
Meier, S. T. (2008). Measuring change in counseling and psychotherapy. Guilford.
Miller, S. D., Duncan, B. L., & Hubble, M. A. (1997). Escape from Babel: Toward a unifying language for psychotherapy practice. New York:W.W. Norton.
Miller, S. D., Duncan, B. L., & Johnson, L. (2002). The Session Rating Scale. Jensen Beach, FL.
Miller, S.D., Duncan, B.L., Brown, J., Sparks, J.A. & Claud, D.A. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analogue measure. Journal of Brief Therapy, 2, 2, 91-100.
Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. Journal of clinical psychology, 61(2), 199–208. https://doi.org/10.1002/jclp.20111
Miller, S. D., Duncan, B. L., Brown, J., Sorrell, R., & Chalk, B. (2006). Using outcome to inform and improve treatment outcomes. Journal of Brief Therapy, 5, 5–22
Miller, S.D., Duncan, B.L., Brown, J., Sparks, J.A. & Claud, D.A. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analogue measure. Journal of Brief Therapy, 2, 2, 91-100.
Miller, S.D., Hubble, M., & Duncan, B. (2007). Supershrinks: What's the secret of their success? PsycEXTRA Dataset. doi:10.1037/e526322010-003
National Quality and Outcomes Framework (2006/2007)
National Institute for Health and Care Excellence (2009a) Depression in Adults: Recognition and Management. https://www.nice.org.uk/guidance/cg90 accessed 21/05/2021
National Institute for Health and Care Excellence (2011). Common Mental Health Disorders, Identification and Pathways to Care: National Clinical Guideline Number 123, National Collaborating Centre for Mental Health Commissioning. UK.
Noorani, T. (2013). Service user involvement, authority and the “expert-by-experience” in mental health. Journal of Political Power, 6(1), 49–68. https://doi.org/10.1080/2158379X.2013.774979
O’Donovan, A., Halford, W. K., & Walters, B. (2011). Towards Best Practice Supervision of Clinical Psychology Trainees. Australian Psychologist, 46(2), 101–112. https://doi.org/10.1111/j.1742-9544.2011.00033.x
Omer, S., Golden, E., & Priebe, S. (2016). Exploring the Mechanisms of a Patient-Centred Assessment with a Solution Focused Approach (DIALOG) in the Community Treatment of Patients with Psychosis: A Process Evaluation within a Cluster-Randomised Controlled Trial. Plos One, 11(2). doi:10.1371/journal.pone.0148415
Oshima, K., Horie, H., Yoshimuchi, K., Shimura, M., Shinobi Nomura,. Wada, M., Tawara, R., Nakao, M., Kuboki, T., Suematsu, H. (1996) The clinical application studies of Tokyo University egogram, second edition (TEG 2.0)- Comparison between controls and patients by TEG patterns and multivariate analysis. Japanese Journal of Psychosomatic Medicine, Vol 36,4 p 315-324
Overington, L., & Ionita, G. (2012). Progress Monitoring Measures: A Brief Guide. Canadian Psychology = Psychologie Canadienne, 53(2), 82–92. https://doi.org/10.1037/a0028017
Perry, T., Barkham, M., & Evans, C. (2013). The CORE‐OM and CORE‐OM (SV) in secure settings: A template analysis of the experiences of male patients and their staff. The Journal of Forensic Practice, 15(1), 32-43. doi:10.1108/14636641311299068
Phelps, R., Eisman, E. J., & Kohout, J. (1998). Psychological practice and managed care: Results of the CAPP practitioner survey. Professional Psychology: Research and Practice, 29(1), 31-36. doi:10.1037/0735-7028.29.1.31
Pomerantz,A.M., & Dever, J. M. (2021). Googling psychotherapists: Can online information make or break prospective clients’ decisions? Practice Innovations (Washington, D.C.), 6(3), 149–158. https://doi.org/10.1037/pri0000145
Prochaska, J. O., Norcross, J. C., & Saul, S. F. (2020). Generating psychotherapy breakthroughs: Transtheoretical strategies from population health psychology. American Psychologist, 75(7), 996-1010. doi:10.1037/amp0000568
Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. R. (2009). Using Client Feedback in Psychotherapy Training: An Analysis of its Influence on Supervision and Counselor Self-Efficacy. Training and Education in Professional Psychology, 3(3), 157–168. https://doi.org/10.1037/a0015673
Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory, Research, Practice, Training, 47(4), 616–630. https://doi.org/10.1037/a0021182
Rijn, B. V., Wild, C., & Moran, P. (2011). Evaluating the Outcomes of Transactional Analysis and Integrative Counselling Psychology within UK Primary Care Settings. International Journal of Transactional Analysis Research & Practice, 2(2). doi:10.29044/v2i2p34
Rijn, B. V., & Wild, C. (2013). Humanistic and Integrative Therapies for Anxiety and Depression. Transactional Analysis Journal, 43(2), 150-163. doi:10.1177/0362153713499545
Rousmaniere, T., Goodyear, R. K., Miller, S. D., & Wampold, B. E. (2017). The cycle of excellence: Using deliberate practice to improve supervision and training. Wiley Blackwell.
Rycroft-Malone, J., Seers, K., Titchen, A., Harvey, G., Kitson, A., & McCormack, B. (2004). What counts as evidence in evidence-based practice? Journal of Advanced Nursing, 47(1), 81–90. https://doi.org/10.1111/j.1365-2648.2004.03068.x
Rye, M., Rognmo, K., Aarons, G. A., & Skre, I. (2019). Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS–ROM. Administration and Policy in Mental Health and Mental Health Services Research, 46(6), 833-846. doi:10.1007/s10488-019-00968-5
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: what it is and what it isn't. BMJ: British Medical Journal, 312(7023), 71. https://doi.org/10.1136/bmj.312.7023.71
Safran, J.D., Abreu, I., Ogilvie, J., & DeMaria, A. (2011). Does Psychotherapy Research Influence the Clinical Practice of Researcher-Clinicians? Clinical Psychology (New York, N.Y.), 18(4), 357–371. https://doi.org/10.1111/j.1468-2850.2011.01267.x
Scilligo, P. (2000). Il questionario ANINT-A36: Uno strumento per misurare la percezione di s e [ANINT-A36 questionnaire: A tool for measuring self-perception]. Psicologia Psicoterapia e Salute, 6(1), 1–35.
Sills, C. (2006). Contracts for counselling and psychotherapy: Professional skills for counsellors. Sage Publications.
Skovholt, T. M., Rønnestad, M. H., & Jennings, L. (1997). Educational Psychology Review, 9(4), 361-369. doi:10.1023/a:1024798723295
Sparks, J. A., Kisler, T. S., Adams, J. F., & Blumen, D. G. (2011). Teaching Accountability: Using Client Feedback to Train Effective Family Therapists. Journal of Marital and Family Therapy, 37(4), 452–467. https://doi.org/10.1111/j.1752-0606.2011.00224 Sparks et al., 2011
Spitzer R. L., Kroenke K., Williams J. B. W., Löwe B. (2006). A brief measure for assessing generalized anxiety disorder the GAD-7. Arch. Intern. Med. 166 1092–1097. 10.1001/archinte.166.10.1092 Spitzer et. al, 2006
Spring, B. (2007). Evidence-based practice in clinical psychology: What it is, why it matters; what you need to know. Journal of Clinical Psychology, 63(7), 611–631. https://doi.org/10.1002/jclp.20373
Stewart,R.E., & Chambless, D. L. (2007). Does psychotherapy research inform treatment decisions in private practice? Journal of Clinical Psychology, 63(3), 267–281. https://doi.org/10.1002/jclp.20347
Stewart, I., & Joines, V. (1987). TA today: A new introduction to transactional analysis. Nottingham, England, and Chapel Hill, NC: Lifespace Publishing.
Stewart,R.E., Stirman, S. W., & Chambless, D. L. (2012). A Qualitative Investigation of Practicing Psychologists’ Attitudes Toward Research-Informed Practice: Implications for Dissemination Strategies. Professional Psychology, Research and Practice, 43(2), 100–109. https://doi.org/10.1037/a0025694
Stewart, R. E., Chambless, D. L., & Baron, J. (2012). Theoretical and practical barriers to practitioners’ willingness to seek training in empirically supported treatments. Journal of Clinical Psychology, 68(1), 8–23. https://doi.org/10.1002/jclp.20832
Swift, J. K., Callahan, J. L., Rousmaniere, T. G., Whipple, J. L., Dexter, K., & Wrape, E. R. (2014, October 6). Using Client Outcome Monitoring as a Tool for Supervision.Psychotherapy. Advance online publication. http://dx.doi.org/10.1037/a0037659 (14) (PDF) Using Client Outcome Monitoring as a Tool for Supervision. Available from: https://www.researchgate.net/publication/266626327_Using_Client_Outcome_Monitoring_as_a_Tool_for_Supervision#fullTextFileContent [accessed Mar 19, 2023
Swift, & Parkin, S. R. (2017). The client as the expert in psychotherapy: What clinicians and researchers can learn about treatment processes and outcomes from psychotherapy clients. Journal of Clinical Psychology, 73(11), 1486–1488. https://doi.org/10.1002/jclp.22528
Tarescavage, A.M., & Ben‐Porath, Y. S. (2017). Avoiding Cognitive Biases in Clinical Decision Making: Commentary on “Evidence‐Based Assessment as an Integrative Model for Applying Psychological Science to Guide the Voyage of Treatment.” Clinical Psychology (New York, N.Y.), 24(4), 367–369. https://doi.org/10.1111/cpsp.12220
Tasca, G. A., Angus, L., Bonli, R., Drapeau, M., Fitzpatrick, M., Hunsley, J., & Knoll, M. (2019). Outcome and Progress Monitoring in Psychotherapy: Report of a Canadian Psychological Association Task Force. Canadian Psychology = Psychologie Canadienne, 60(3), 165–177. https://doi.org/10.1037/cap0000181
Thomas, J. (2013) Therapy: No improvement for 40 years. The National Psychologist, 23,1.
Tudor, K., & Widdowson, M. (2001). Integrating Views of TA Brief Therapy. Transactional Analysis Approaches to Brief Therapy: What Do You Say between Saying Hello and Goodbye?, 114-136. doi:10.4135/9781446217917.n7
Tryon, G. S., Blackwell, S. C., & Hammel, E. F. (2007). A meta-analytic examination of client–therapist perspectives of the working alliance. Psychotherapy Research, 17(6), 629-642. doi:10.1080/10503300701320611
Unsworth, G., Cowie, H., & Green, A. (2012). Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study. Counselling and Psychotherapy Research, 12(1), 71-80. doi:10.1080/14733145.2011.56512
Van Wert, M. J., Malik, M., Memel, B., Moore, R., Buccino, D., Hackerman, F.,Narrow, W. (2020). Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed‐methods quality improvement project. Journal of Evaluation in Clinical Practice. doi:10.1111/jep.13457
Vos, J., & van Rijn, B. (2021). The Evidence-Based Conceptual Model of Transactional Analysis: A Focused Review of the Research Literature. Transactional Analysis Journal, 51(2), 160–201. https://doi.org/10.1080/03621537.2021.1904364
Walfish, S., Mcalister, B., O'Donnell, P., & Lambert, M. J. (2012). An Investigation of Self-Assessment Bias in Mental Health Providers. Psychological Reports, 110(2), 639-644. doi:10.2466/02.07.17.pr0.110.2.639-644
Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914-923. doi:10.1037/0022-006x.73.5.914
Wampold, B.E., & Imel, Z. E. (2015). The great psychotherapy debate. The evidence for what makes psychotherapy work. New York/Londen: Routledge.
Whooley, M. A., Avins, A. L., Miranda, J., & Browner, W. S. (1997). Case-finding instruments for depression. Journal of General Internal Medicine, 12(7), 439-445. doi:10.1046/j.1525-1497.1997.00076.x
Widdowson, M. (2011). Case Study Research Methodology. International Journal of Transactional Analysis Research & Practice, 1(1). doi:10.29044/v2i1p25
Widdowson, M. (2015). Transactional Analysis for Depression: A step-by-step treatment manual. Taylor and Francis. https://doi.org/10.4324/9781315746630
Widdowson, M. (2020). KEYNOTE: Three Positive Outcome TA Psychotherapy Cases: Hermeneutic Single-Case Efficacy Design Research in Action. International Journal of Transactional Analysis Research & Practice, 4(1), 26-29. doi:10.29044/v4i1p26
Wilson, I. B., and Cleary, P.D. (1995). Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. In; Velentgas, P. T., Dreyer, N. A., Nourjah, P., Smith, S. R., & Torchia, M. (2013.). Developing a protocol for observational comparative effectiveness research: A user's guide. Agency for health Care Research and Quality (US)
Woollams S. and Brown, M. (1978) Transactional analysis. Dexter: Huron Valley Institute
Wolpert M., Curtis-Tyler K., Edbrooke-Childs J. (2016). A qualitative exploration of patient and clinicians' views on patient reported outcome measures in child mental health and diabetes services. Administration and Policy in Mental Health and Mental Health Services Research, 43, 309–315
Worthen, V. E., & Lambert, M. J. (2007). Outcome oriented supervision: Advantages of adding systematic client tracking to supportive consultations. Counselling and Psychotherapy Research, 7(1), 48–53. https://doi.org/10.1080/14733140601140873
Youn, S. J., Kraus, D. R., & Castonguay, L. G. (2012). The treatment outcome package: Facilitating practice and clinically relevant research. Psychotherapy, 49(2), 115-122. doi:10.1037/a0027932
Young, J. E., Arntz, A., Atkinson, T., Lobbestael, J., Weishaar, M. E., Van Vreeswijk, M. F., & Klokman, J. (2007). The schema mode inventory. Schema Therapy Institute.
Zigmond, A. S., & Snaith, R. P. (1983). The Hospital Anxiety and Depression Scale. Acta Psychiatrica Scandinavica, 67(6), 361-370. doi:10.1111/j.1600-0447.1983.tb09716.x