onthepoint

Focus Groups

FOCUS GROUPS:

This page has been created and is maintained by the Child and Youth Mental Health Learning Outcomes Project team.

The Assessment of CMHO Stakeholder Needs and Models of Evidence Based Practice

        Introduction

This report documents the process and the results of an assessment of stakeholder needs completed in October 2005 for the project “The Role of Competence in Outcomes for Children and Youth”.  The project, funded by the Centre of Excellence for Child and Youth Mental Health, is examining the post-secondary educational curriculum for child and youth workers in the province of Ontario to determine the match between the existing curriculum, the competencies that graduating child and youth workers possess, and the needs of child and youth mental health organizations that are hiring there workers. Prior to examining the curriculum stakeholders were consulted to determine what competencies they required in graduates. The results of that consultation are reported here for the purpose of having the participants validate the analysis.

        Methodology

Five focus groups, made up of supervisors, program managers and service directors from children’s mental health programs, were conducted in various regions of the province.  There were two held in the greater Toronto area, one in London, one in Ottawa and one in Sudbury.  There were thirty-four participants with group size ranging from five to eight in number.

All participants responded to an email with a general call to participate issued by CMHO and were then contacted by telephone, by project personnel to ensure that they were informed of the process and agreed to the manner in which the groups were going to be conducted.  All participants were further informed at the beginning of each group and were asked to sign an Informed Consent form.

Each group was conducted in a similar fashion using eight questions  that were distributed at the beginning of each group and focused on the needs of supervisors and agencies in relation to entry level child and youth workers.  The intent was to allow members of each group to respond to the questions with maximum freedom in terms of range and depth of response.  The group facilitator (Bill Carty) and the recorder (Carol Stuart) were the same for each group, both being the principal researchers on the project.  Notes were taken by the group facilitator and the recorder used a laptop computer and an audio tape recording to ensure accuracy of the participants’ ideas and language.  Each researcher individually analyzed the focus group notes and then findings were collectively discussed.  Consensus was reached between the researchers as to the major and minor points that were raised by the participants and a list of principle themes were developed for each group.  These themes were then combined to form an analysis framework for all groups.   The transcripts of the focus groups were coded according to the analysis framework using NVIVO, qualitative analysis software.  

Of the eight questions asked the first four were about child and youth work practice in their agencies, the last four were about training and supervision practices.  In general the responses, across all groups, were very similar and the differences that were noted were primarily in the depth that each group discussed a particular point not whether the point was raised or discussed.  The make up of the groups in terms of program and service representation differed e.g. residential services or family intervention programs would be over represented in some groups and under represented in others.  The discussions reflected these imbalances in group composition.      

All five focus groups discussions revolved around three main themes:

♦         Child and youth work general knowledge, skills and abilities e.g. what cyw’s need to know and able to do in the care of children and youth in any setting 

♦         Child and youth work specific knowledge, skills and abilities as they pertain to mental health difficulties that children, youth, and their families experience and the appropriate treatment interventions

♦         Mental health issues in general– the importance of things like assessment, clinical formulation, abnormal development, adult and family issues, medication, evaluation and research, and theoretical perspectives. 

        The Findings

1    New CYW graduates are rarely hired directly into full time positions in children’s mental health programs. Most often they are hired into relief positions as a result of their practicum experience in the agency and from there proceed to a full-time position.

Children’s mental health programs are typically seen as having the most interesting CYW positions at the highest compensation levels so supply and demand suggests that full time permanent positions in these programs are at a premium.  Focus group participants also stated that college placement students in their agencies were natural choices for contract or relief positions (which lead to permanent positions) since they had some mental health training, specifically in the programs in which they completed their placements in, a factor seen as efficient for the agency.  Some regions described collective agreement rules that restricted the hiring practices of managers therefore  new graduates, who showed excellent promise, but had no position within the agency could not be hired.     

2     CYW practitioners are employed in a wide range of services, residential, day treatment, community based, outreach and prevention programs, offered in children’s mental health agencies.

Focus group participants were supervisors of CYW’s in at least one program in their organization, but each organization had several programs that employed CYW’s.  Participants were asked which programs within their organization employed CYW’s. Table One represents an approximation of the number and types of programs that employed CYW’s within the agencies that participated in the focus groups. Most of the organizations represented in the five focus groups had residential programs and/or day treatment programs but very few had addictions or employment programs for youth that employed CYW’s.

Table 1: Programs represented in the Focus Groups

#
Type of Program

#
Type of Program
1
Addictions

6
School-based

Hospital based


Family based interventions

Treatment Foster Homes


Early Years Intervention (0-6)

Youth Employment Program

9
In-home Intensive support
2
Young Offender

15
Day treatment
5
Crisis team

18
Residential

Many of the above programs hired not ONLY CYW’s for the program but also hired a range of professional disciplines, choosing the person who had the right combination of skills for the job. Very often this was a CYW, but it could also be a social worker, a nurse, or a human service worker.

3     Evidence based treatments and practices are being (slowly) introduced into most children’s mental health programs and CYW’s are being expected to be knowledgeable, informed and trained in these treatments and practices.

The issues of evidence-based practice and evidence-based treatments were discussed by focus group participants.  The participants themselves described a wide variation in the practices and treatments that they thought were evidence based. The role of the child and youth work practitioner in providing these treatments or engaging in specific practices also varied widely. 

There were more than twenty different treatments / practices identified by participants as being at some stage of implementation in their mental health programs; including five crisis management programs. Table 2 below lists the practices identified. There was no clear delineation between models of treatment and evidence-based practices and there seemed to be no consensus in the groups about the difference between using a theorists’ ideas and models versus treatments and practices that have been derived from systematic research studies. One can see from the list in Table 2 that participants were often unclear on the meaning of the term evidence based treatment.  Very often they were also unclear on the full name of the program.

Table 2: Participants Descriptions of Evidence Based Treatment/Practice in the Agency

EMDR-(Rapid Eye Movement for Trauma victims)

Assist Model for Suicide Intervention

ITTM

Developing an Understanding of Self (DUSO)

SNAP (Stop Now and Plan)

Interactional Guidance

STOP

Modified Interactional Guidance (Benoit)

COPE

Mother Goose

TAP-C (Arson Prevention program and assessment)

Social Skills Training (Goldstein)

CAFAS (Child and FamilyAssessment S)

Wrap Around Program

BCFPI (Brief Child and Family Phone Interview)

Sexual Abuse Trauma Treatments

Cognitive Behavioural Therapy (CBT)

Durrant’s Competency Based Model

Dialectical Behaviour Therapy (DBT)

Glasser’s Reality Therapy

Intensive Behaviour Interventions (IBI)

Solution focused and Brief Therapy Approach

Multi-Systemic Therapy (MST)

Life Space Interview (LSI)

Positive Parenting Program (Triple P)

 Anglin’s Model of Residential Treatment

Incredible Years Training (parent training)

“Horse Friends”

Friends for Life (adolescent)

Thera-play

Crisis Intervention Programs: These are the programs that train workers in de-escalating violent behaviour and if necessary restraining clients who might injure others.

BMI, CPI, TCI, PMAB, UMAB

Of interest to us, and likely characteristic of the child and youth care focus in this project, all groups immediately identified one of the government approved behavior management training programs[1] when asked what evidence based treatments were used in the organization. When asked if practitioners OTHER than child and youth care were trained in these procedures most participants replied that they were not but there was a general consensus that agency social workers, prevention workers, and family support workers should receive this training, (the descalation component as a minimum), and some agencies were already doing this in order to build a common language across the organization.

4      There was an acknowledgement of the importance of on-going training and supervision for all practitioners in children’s mental health programs, including CYW’s. 

Training is generally very similar across all disciplines in the agencies; CYW’s are included in most, if not all, clinical training opportunities in the agencies and there are additional specific training programs designed specifically for CYW’s, especially in the area of crisis management and physical restraints. 

Supervision was described as being substantively different for CYW’s as compared to other clinical staff members.  All participants were CYW supervisors and recognized that CYW’s needed support, encouragement, and a clear sense of the ‘use of self’ in relation to their clients, and this was best reviewed in the supervision process.  The differences in supervisory approaches among participants were found in the frequency of supervisory meetings  (from weekly to monthly), and the nature of the connection between the supervision process and formal performance appraisals.  Participants believed that younger, more inexperienced CYW practitioners needed more frequent and intense supervision than those who had been in the field longer; although there was no evidence presented, in any of the groups, that this belief has any foundation in research.

Participants distinguished between clinical supervision and administrative supervision. They also described some peer or group supervision processes in relation to clinical supervision. Overall, a pictured emerged that included the following elements:

  • Regular team meetings with a focus on presenting and discussing cases for clinical supervision.  This could be either peer supervision or supervision involving a clinical specialist who was different from the designated line supervisor.
  • Regular individual supervisory meetings with a line supervisor which, for child and youth workers included a significant focus on their own awareness of self and use of self in work with the children and youth, as well as ensuring administrative tasks were dealt with.
  • Frequent spontaneous consultation with the supervisor, often with a focus on working through the CYW’s self-awareness in order to ensure that their interactions with the children and youth were effective and to facilitate the identification of possible intervention scenarios.  Such consultation could occur “on the floor” in residential programs or by phone or “drop in” visits to the supervisors working in community based and hospital based programs[2].
  • Regular note taking of individual supervisory sessions.

5    The personal attributes and general abilities that CYW practitioners brought to the job were more important than the specific training and skills developed through CYW study and practice.  

This point was very prevalent in all focus group discussions.  The participants, although wanting skilled, knowledgeable, competent practitioners, identified that the most significant issue was a high level of competence stemming from a good general education, and having personal philosophies, histories, and the ability to relate and care for others in providing excellent child and youth work services.  The belief was that given this general knowledge and positive attributes then a practitioner could learn and be trained in all other specific areas of professional practice. 

This was not to say the focus group participants did not see the importance and significance of professional child and youth care training and education and they certainly stated that given people of similar attributes and characteristics, those with formal education in child and youth work would certainly win out in a competition for a position, but given the importance of healthy relationships in CYW practice they believed that the individual characteristics of the practitioner were paramount in the hiring process. 

      Domains of Competence

Six domains of competence were discerned from questions which asked the participants to describe the self-awareness, knowledge, and practice skills required for entry to practice.

Overall, the authors’ analysis of the focus groups discussions determined that there were six general domains (containing knowledge, skills, and personal attributes and values) that were prominent across all groups when discussing the central requirements of a graduating child and youth work practitioner. 

This analysis was completed by reviewing the tapes and notes from each group, recording the frequency of particular competencies raised, and then coding these to a main theme (domain). As noted above each principal researcher individually analyzed the focus group notes and then findings were collectively discussed.  Consensus was reached between the researchers as to the principle domains that were present across all groups.  These domains formed an analysis framework for all groups.   The transcripts of the focus groups were coded according to the analysis framework using NVIVO, qualitative analysis software.   The results of this analysis, following validation by the focus group participants will be added to the analysis of Child and Youth Work certification standards completed in Phase 3 (current status posted on the CECYMH Wiki at http://onthepoint.editme.com/

The domains and their corresponding definitions are:

1    Appropriate professional presentation and communication.

This domain involves skills in professional demeanor and the knowledge that forms the foundation for those skills as well as the ability to understand how others see the person.  The entry level practitioner should have good verbal and written communication skills which demonstrate respect for confidentiality; use of appropriate grammar and syntax in reporting; and a demonstrated understanding of the roles of other professionals on the multi-disciplinary team.  The practitioner must be able to understand the client and/or family’s needs and to communicate to those needs toothers. This requires knowledge and skills for advocacy and team work. 

2     Mental Health Assessment/Diagnosis, Planning and Intervention

Entry level practitioners must have the basic skills for developing relationships and engaging with children, youth, and families.  These relationship skills are the foundation for intervention and planning for change in the client(s) life. The practitioner, drawing on knowledge from other domains (development, family and systems) is able to understand and formulate clinical explanations for client behaviour which are grounded in theory and research. Through this understanding and in collaboration with the client and other members of the multi-disciplinary team, goals for change are set and a plan is developed for meeting the needs of and/or changing behaviour in the client. The skills lie in problem analysis and problem solving and the ability to articulate these into a systematic plan.  Once the plan is in place systematic (pre-planned) interventions and “in the moment” interventions are undertaken by the practitioner who has a range of strategies for correcting behaviour and teaching ways of interacting with the social world which are drawn from a variety of theoretical or empirical approaches to change.

3     Understanding of families and systems

Entry level practitioners should have strong foundational knowledge in this domain.  Skills will be developed primarily in the context of practice. A basic knowledge of different ethnic, cultural, and religious norms and practices and a strong understanding of  how one’s culture influences worldview and the judgment of others is fundamental. Understanding the dynamics of family relationships as they influence the behaviors of children and youth and the ability to communicate respectfully and non-judgmentally with parents is required. Knowledge and consideration of how multiple micro systems and macro systems such as policy and legislation influence the lives of children, families, and the organization’s employees is essential.

4     Understanding themselves

The tangible tools of a child and youth worker are self-awareness and the values that are brought to the job.  This domain requires an entry level practitioner who is able to identify the feelings and emotions that are being elicited in them by the children or families that they are working with and to identify when and how to set boundaries and to focus on the needs of the child.  The practitioner must take responsibility for his/her own personal and professional growth and development, seeking supervision and/or consultation when needed and identifying when personal issues need to be processed and resolved in order to function well in relating to clients and to team members. 

5      Mental Health and Safety

This domain requires knowledge and skills in intervention strategies that include the ability to create safe environments for self and for clients, particularly when faced with aggressive behaviour. It also involves an understanding of how pathology affects behaviour, influences the risks to staff and other clients and of the effects of medication on client behaviour.  Knowledge of crisis theory as it applies to intervention strategies is critical. An awareness of the how trauma and violence impacts on self and on clients underlies the ability to take care of the worker and to intervene with the client.

6     Human Development and Pathology

This domain includes an applied understanding of theories of normal development from birth to old age.  Normal development is the context for understanding and recognizing pathology and developmental delays within children and youth.  Implications for medication, learning, and behavioural interventions are drawn from understanding pathology and development. This domain is primarily knowledge based and the knowledge is applied in other domains which require conceptualization of problems and issues within a developmental context (e.g. assessment and intervention).  In child and youth mental health entry level practitioners should have a good knowledge of the mental health conditions both in children and in adults and be able to recognize symptomatic behaviour.


[1] CPI (Crisis prevention institute); BMI, TCI (Therapeutic Crisis Intervention-Cornell), PMAB, UMAB

[2] Due to the intense one on one nature of child and youth care work-which can go on for several hours at a time, this is a common practice in the field which acknowledges the potential for transference and counter-transference and the importance of working through these possibilities with a more neutral party. 

Site

Changes
Index
Search

 

User

 

Log In

 
 

Last Modified 2/20/06 11:09 AM