[Federal Register Volume 79, Number 116 (Tuesday, June 17, 2014)]
[Notices]
[Pages 34532-34535]
From the Federal Register Online via the Government Publishing Office [www.gpo.gov]
[FR Doc No: 2014-14083]
-----------------------------------------------------------------------
DEPARTMENT OF HEALTH AND HUMAN SERVICES
Agency for Healthcare Research and Quality Agency Information
Collection Activities:
Proposed Collection; Comment Request
AGENCY: Agency for Healthcare Research and Quality, HHS.
ACTION: Notice.
-----------------------------------------------------------------------
SUMMARY: This notice announces the intention of the Agency for
Healthcare Research and Quality (AHRQ) to request that the Office of
Management and Budget (OMB) approve the proposed information collection
project: ``Evaluation of the Educating the Educator (EtE) Workshop.''
In accordance with the Paperwork
[[Page 34533]]
Reduction Act of 1995, Public Law 104-13 (44 U.S.C. 3506(c)(2)(A)),
AHRQ invites the public to comment on this proposed information
collection.
This proposed information collection was previously published in
the Federal Register on March 28th, 2014 and allowed 60 days for public
comment. No comments were received. The purpose of this notice is to
allow an additional 30 days for public comment.
DATES: Comments on this notice must be received by July 17, 2014.
ADDRESSES: Written comments should be submitted to: Doris Letkowitz,
Reports Clearance Officer, AHRQ, by email at
[email protected].
Copies of the proposed collection plans, data collection
instruments, and specific details on the estimated burden can be
obtained from the AHRQ Reports Clearance Officer.
FOR FURTHER INFORMATION CONTACT: Doris Lefkowitz, AHRQ Reports
Clearance Officer, (301) 427-1477, or by email at
[email protected].
SUPPLEMENTARY INFORMATION:
Proposed Project
Evaluation of the Educating the Educator (EtE) Workshop
AHRQ's Educating the Educator (EtE) workshop training project is an
Agency knowledge translation and dissemination project that aims to
increase knowledge about and use of AHRQ's EHC Program products among
health care professionals. For the EtE project, AHRQ is sponsoring the
development of an accredited, in-person, train-the-trainer workshop
program for health care professionals to educate them on how to use
AHRQ's EHC Program materials and resources in shared decision making
(SDM) with patients/caregivers. As a train-the-trainer program, the
workshop also provides education on effectively training other health
care professionals to facilitate the dissemination of the key
competencies taught by the program. Additionally, as part of the EtE
project, a collection of new stand-alone tools are being developed to
facilitate the implementation and use of AHRQ EHC Program materials.
The new tools will be integrated into the EtE workshop training program
and made available to workshop participants. These new tools also will
be publicly-accessible through the AHRQ Web site for easy referral,
access, and use by both workshop participants and other health care
professionals. Ten EtE workshops, with 25-50 participants each, will be
held each year for four years around the United States. Primary
trainees will then be able to go back to their home institutions or
organizations to train other secondary trainees.
AHRQ recognizes the importance of ensuring that its dissemination
activities are useful, well implemented, and effective in achieving
their intended goals. Therefore, an evaluation is associated with the
EtE project. The EtE evaluation is comprised of two key components. One
component has been designed to support both a process-oriented
formative evaluation and a summative (impact) evaluation of the EtE
train-the-trainer workshop program. The other component is designed to
assess the impact of new tools developed through this project in
supporting the implementation of AHRQ EHC Program materials.
The specific goals of the EtE train-the-trainer workshop evaluation
(component 1) are to examine the following:
Who is participating in both the primary train-the-trainer
sessions, and in subsequent, secondary trainings offered by primary
trainees?
The uptake of and confidence among primary trainees in
training others on the key competencies of the curriculum
How the workshop implementation or course content should
be modified to improve the quality of the training (e.g., instructor,
materials, modules, etc.)?
The extent to which workshop participants have been able
to conduct additional trainings, start new PCOR education programs
based on the workshop curriculum, or integrate the workshop curriculum
into existing training programs in their local settings.
What the results of subsequent trainings by workshop
participants were among secondary participants (i.e., individuals who
received training from a workshop participant) in terms of their use of
PCOR information and the practice of SDM with patients?
Whether workshop participants have participated in other
project activities, such as ongoing webinars or the learning network
that are planned as part of the EtE project.
How workshop participants are using what they have learned
from the training program in their own practice?
The specific goals of the EtE new tools evaluation (component 2)
are to examine the following:
If and how workshop trainees and other health care
professionals are using the new tools developed during this project to
support their implementation of AHRQ EHC Program resources?
How useful clinicians find AHRQ EHC Program resources to
be in their practice?
How frequently new tools are being accessed and used by
workshop trainees and other health care professionals?
Suggestions for improving tools to meet health care
professionals' needs when serving their patients?
This study is being conducted by AHRQ through its contractor, AFYA,
Inc., and The Lewin Group, pursuant to AHRQ's statutory authority to
support the agency's dissemination of comparative clinical
effectiveness research findings. 42 U.S.C. 299b-37(a)-(c).
Method of Collection
To achieve the goals of this project the following data collections
will be implemented:
(1) Pre-Training Survey of Primary Participants. This pen and paper
survey will be administered to train-the-trainer workshop participants
(also referred to as Primary Workshop Participants) immediately prior
to the start of the in-person train-the-trainer workshop sessions.
Information collected includes (1) non-identifying demographic
information about respondents (e.g., type of clinician; practice
setting); (2) participants knowledge of core concepts and objectives of
the workshop; and (3) their confidence in training others. This
instrument will also collect information about participants' use of and
exposure to AHRQ EHC Program products for comparison at later time
points.
(2) Post-Training Survey of Primary Participants. This pen and
paper survey will be administered to train-the-trainer workshop
participants immediately following the conclusion of the in-person
train-the-trainer workshop sessions. Information collected includes (1)
post-training knowledge of core concepts presented in workshop; and (2)
post-training confidence in training others. The post-training
instrument will also collect information about participants' reaction
to the training (e.g., instructor, the content, the presentation style,
the schedule, etc.), a requirement for accreditation purposes.
(3) Six-Month Post-Training Survey of Primary Participants. This
survey will be administered to primary workshop participants six months
following their participation in the train-the-trainer workshop. The
survey will be Web-enabled, and a link to the survey will be emailed to
participants. Information to be collected includes (1) behaviors and
experiences of primary workshop participants in training others (i.e.,
secondary participants); (2) the numbers of individuals they have
trained; and (3) barriers they have encountered in training others.
This instrument will also collect (4) data on primary
[[Page 34534]]
participants' early experiences in applying what they learned in the
workshop training in their own clinical practice with patients; and (5)
their use of AHRQ EHC resources and tools which will be compared to
baseline measures.
(4) One-Year Post-Training Survey of Primary Participants. This
survey will be administered to primary workshop participants one year
following their participation in the train-the-trainer workshop. The
survey will be Web-enabled, and a link to the survey will be emailed to
participants. This survey will collect the same information as
collected in the 6-month survey. This instrument will also collect new
information from participants about their use/participation in
continued training that will be offered (e.g., participating in
training and technical assistance webinars and the learning network
that will be created).
(5) One-Year Post Survey of Secondary Workshop Participants. This
survey will be administered to secondary workshop participants one year
following their receipt of continuing education (CE) credits for
participating in locally-delivered workshops by primary workshop
participants. The questions of interest include (1) non-identifying
demographic information about respondents (e.g., type of clinician;
practice setting); (2) their use of AHRQ EHC program products; (3) how
useful they thought the training they received was in developing their
patient engagement and SDM skills; (4) barriers they have encountered
when implementing what they learned in practice; (5) the types of
changes they or their organization have made related to involving
patients in health care decision making and their use of decision
support tools, since participating in the workshop; and (6) any changes
that they have observed in their patients since they participated in
the training.
(6) New Tool Users. This survey will be deployed on the AHRQ Web
site on a quarterly basis. More specifically, it will be made available
on the new tools Web landing page on the AHRQ Web site so that it
targets users of the new tools from this project. Information to be
collected includes (1) non-identifying demographic information about
respondents (e.g., type of clinician; practice setting); (2) whether or
not they have participated in the workshop training associated with
this project; (3) how often respondents use tools on the AHRQ tools
landing page; and (4) how useful respondents find the tools to be and
new tools that they would like to see added.
AHRQ and the EHC Program staff will use the information collected
through this Information Collection Request to assess the short- and
long-term progress in achieving the dissemination and implementation
aims of the EtE project. The information collected will facilitate
real-time adjustments in the strategies and tactics that are used to
promote and deliver the new tools and workshop training. The summative
evaluation will assess the impact of this EtE workshop training program
and new tools on increased awareness, understanding, and use of AHRQ's
EHC Program products in clinical practice with patients. The specific
purpose and use of each of the data collection instruments is described
below.
(1) Pre- and Post-Training Surveys of Primary Workshop
Participants--These data collections will be used to assess the
effectiveness of the training in transferring course concepts to train-
the-trainer participants. They will be used to measure what
participants learned during the training relative to their knowledge of
core concepts and objectives of the workshop, and their confidence in
training others as assessed prior to the training (pre-training
survey). The pre-training survey also will establish a baseline level
regarding workshop participants' use and exposure to AHRQ EHC Program
products for comparison at later time points. The post-training
assessment also will be used to assess workshop participants' reaction
to the training. This is important for the process evaluation component
of this project as it will provide information on participants'
reactions to specific components of the program (e.g., instructor, the
content, the presentation style, the schedule, etc.), a requirement for
accreditation purposes, and help to identify where minor tweaking of
the program may be needed to better meet participants' needs.
(2) Six-Month Post-Training Survey, of Primary Participants--This
data collection will be used to assess the behaviors and experiences of
workshop participants in training others (i.e., secondary
participants), and whether the training has promoted changes to
participants' use of PCOR resources in SDM with their patients. This
survey will also be used to assess whether the use of AHRQ EHC Program
products has increased since participating in the survey.
(3) One-Year Post-Training Survey of Primary Participants--This
data collection will be used to assess the long-term impact of the
train-the-trainer workshop on participants' use of PCOR resources in
SDM with patients in clinical practice. The assessment will determine
if the training results in or contributes to changes in participants'
continued use of key training concepts relative to baseline and 6-month
assessments. This assessment also will provide information on the
numbers of other individuals (i.e., secondary participants) who have
received training at subsequent time points by the train-the-trainer
workshop participants and the impact of training those secondary
participants on their organizational practices regarding using AHRQ EHC
Program products in SDM with their patients.
(4) One-Year Post Training Survey of Secondary Workshop
Participants--This data collection will be used to assess the
effectiveness of the train-the-trainer format on disseminating
knowledge among the health care community. The questions of interest
include the following:
[cir] Are participants from the train-the-trainer workshop able to
effectively transfer or share key competencies from their training to
other locally-based health care professionals (i.e., secondary
participants)?
[cir] Do secondary participants taught by AHRQ-sponsored train-the-
trainer workshop participants increase their use of AHRQ EEC Program
products in SDM with their patients?
(5) New Tool Survey--This data collection will be used to gather
information on AHRQ Web site users experiences with the available new
tools including who uses these tools and if they are useful.
Estimated Annual Respondent Burden
Exhibit 1 shows the estimated annualized burden hours for the
respondents' time to participate in this evaluation. For the
longitudinal evaluation, four questionnaires will be completed by
approximately 1,500 primary trainees who participate in the AHRQ-
sponsored EtE train-the-trainer workshop, at the specified intervals,
and each will require 10 or 15 minutes to complete. The annual survey
of secondary participants will be completed by 3,000 secondary trainees
(individuals who receive training from primary trainees) over the 3
years. Based on previous experience with convenience-based Web-based
surveys, we estimate that the quarterly Web-based survey of new tool
users will be completed by approximately 1,200 respondents over the 3-
year period.
Exhibit 2 shows the estimated annualized cost burden based on the
respondents' time to participate in this
[[Page 34535]]
project. The total cost burden is estimated to be $91,668.
Exhibit 1--Estimated Annualized Burden Hours
----------------------------------------------------------------------------------------------------------------
Number of
Form name Number of responses per Hours per Total burden
respondents respondent response hours
----------------------------------------------------------------------------------------------------------------
Pre-training survey (primary trainees) (time * 1500 1 15/60 375
point 1)..............................
Post-training survey (time point 2).... * 1500 1 15/60 375
6-month post training survey (time point 3)...........................................
12-month post training survey (time point 4)...........................................
Annual survey (one-time survey of secondary 3000 1 10/60 500
trainees)......................................
Quarterly survey of new tool users.............. 1200 1 5/60 100
---------------------------------------------------------------
Total....................................... ** 5,700 NA NA 1850
----------------------------------------------------------------------------------------------------------------
* These individuals are the same 1500 individuals (primary trainees) and will be assessed at four different time
points.
** Estimated total number of unique respondents.
Exhibit 2--Estimated Annualized Cost Burden
----------------------------------------------------------------------------------------------------------------
Average
Form name Number of Total burden hourly wage Total cost
respondents hours rate * ($) burden ($)
----------------------------------------------------------------------------------------------------------------
Pre-training survey (primary trainees) (time 1500 375 * 49.55 18,581
point 1)..............................
Post-training survey (time point 2).... 1500 375 * 49.55 18,581
6-month post training survey (time point 3)...........................................
12-month post training survey (time point 4)...........................................
Annual survey (one-time survey of secondary 3000 500 * 49.55 24,775
trainees)......................................
Quarterly survey of new tool users.............. 1200 100 * 49.55 4,955
---------------------------------------------------------------
Total....................................... ** 5,700 1,850 NA 91,668
----------------------------------------------------------------------------------------------------------------
* Average hourly wage based on the weighted average of wages for 1 Family and General Practitioner (29-1062,
$81.78), 1 Internist (29-1063, $86.20), 1 Physician Assistant (29-1071, $44.96), 1 Psychiatrist (29-1066,
$95.33), 1 Nurse Practitioner (29-1171, $44.48), 3 Registered Nurses (29-1141, $34.23), 1 Pharmacist (29-1051,
$59.87), 1 Licensed Practical or Licensed Vocational Nurse (29-2061, $21.17), 1 Health Educator (21-1091,
$20.52), and 1 Administrative Services Manager (11-3011, $37.61). Data Source: National Occupational
Employment and Wage Estimates in the United States, May 2012, ``U.S. Department of Labor, Bureau of Labor
Statistics'' (available at http://www.bls.gov/oes/current/naics4 621400.htm).
** Estimated total number of unique respondents.
Request for Comments
In accordance with the above-cited Paperwork Reduction Act
legislation, comments on AHRQ's information collection are requested
with regard to any of the following: (a) Whether the proposed
collection of information is necessary for the proper performance of
AHRQ health care research and information dissemination functions,
including whether the information will have practical utility; (b) the
accuracy of AHRQ's estimate of burden (including hours and costs) of
the proposed collection(s) of information; (c) ways to enhance the
quality, utility, and clarity of the information to be collected; and
(d) ways to minimize the burden of the collection of information upon
the respondents, including the use of automated collection techniques
or other forms of information technology.
Comments submitted in response to this notice will be summarized
and included in the Agency's subsequent request for OMB approval of the
proposed information collection. All comments will become a matter of
public record.
Dated: June 6, 2014.
Richard Kronick,
AHRQ Director.
[FR Doc. 2014-14083 Filed 6-16-14; 8:45 am]
BILLING CODE 4160-90-M