JOURNAL TRANSCRIPT
BUILDING TEAMS: A TOBACCO EVALUATION AND MONITORING SYSTEM Leah Ranney, PhD: Tobacco Preven3on Evalua3on Program, UNC School of Medicine Leigh Welper BA: Independent Contractor Adam Goldstein, MD, MPH: Tobacco Preven3on Evalua3on Program, UNC School of Medicine Tom Brown, M.Ed: NC Department of Health and Human Services, Tobacco Preven3on and Control Branch
Agenda NC Tobacco Initiatives Teen Tobacco Use Prevention and Cessation Initiative Tobacco Evaluation and Management System (TEAMS) How are program activities monitored? What type of outcome data is produced for evaluation? Utility of TEAMS for program managers, evaluators, and Technical
Assistance providers
Benefits of TEAMS
Impact of Tobacco Use } Approximately 400,000 people die each year
from their own cigarette smoke } Over 6,000,000+ youth under 18 years old
alive today will ultimately die from smoking – unless smoking rates decline Campaign for Tobacco-Free Kids (June 13, 2012) http://www.tobaccofreekids.org/facts_issues/toll_us/
NC Tobacco Initiatives Master Settlement funds used to
establish Health and Wellness Trust Fund (HWTF): 2001-2011 Four primary components: Teen Initiative: 2003 TRU Media Campaign: 2004 Quitline: 2005 Colleges Initiatives: 2006
Teen Tobacco Use Prevention and Cessation Initiative Funds 43 School and Community Based
Grantees
Prevent Youth Initiation of Tobacco Use Promote Tobacco Use Cessation Among Youth Eliminate Youth Exposure to Secondhand
Smoke Reduce Tobacco Related Disparities Among Priority Populations
Example of Program Indicators Tobacco Prevention # of tobacco use prevention education media messages aired or
disseminated
# of youth led prevention activities
Tobacco Cessation # of presentations promoting tobacco cessation resources # of printed materials distributed with QuitlineNC Logo
Continued Reduce Secondhand Smoke Exposure # of improved smoke-free policies (increase from smoke-free to
tobacco-free)
# of new smoke-free policies (i.e. Parks)
Reduce tobacco-Related Disparities # of culturally tailored activities conducted targeting an identified
high risk group
# of activities conducted where materials from the Heritage Toolkit
(culturally tailored products and activities) were disseminated
TOBACCO EVALUATION AND MANAGEMENT SYSTEM (TEAMS)
TA Provider Services
HOW ARE PROGRAM ACTIVITIES MONITORED? Status Reports Indicator Reports Qualitative Data
TEAMS Status Report
TEAMS Quantitative Report
TEAMS Qualitative Report
Monthly Raw Data Spreadsheet
TA Provider Services Report
WHAT TYPE OF OUTCOME DATA IS PRODUCED FOR EVALUATION? Quantitative Qualitative
Events Conducted by Grantees by Goal Area Fiscal Year (2010-2011)
Comparison of AAP with Actual Performance
# of Active Youth Groups by SemiAnnual Period (2006-2011) 250 212
Number of ac,ve youth groups
200
218
219
210
181 163
150
211
133 121
154
127 114
100
50
0 Fall 2005 Spring Fall 2006 Spring Fall 2007 Spring Fall 2008 Spring Fall 2009 Spring Fall 2010 Spring 2006 2007 2008 2009 2010 2011 Repor,ng Period
100% Smoke Free Policy Adoptions Fiscal Year (2010-2011) Grantee Quarter Venue Alice Aycock Poe 3 Raleigh C ity P arks Catawba County 3 Catawba C ounty G overnment Catawba County 3 Unnamed a partment c ommunity Dare County 2 All f our t own p arks: A viation Park, Meekins Field, West Hayman Blvd. and Copley Dr. Dare County 2 The B athhouse a t O cean Boulevard Durham County 4 Smoke-‐free playgrounds, bus stops and county/city buildings Halifax County 3 White Oak Baptist church Union County 4 Dogwood Park at Wesley Chapel
Location Raleigh, NC Catawba County, NC Catawba County, NC Kill Devil Hills, NC Kill Devil Hills, NC Durham, NC Enfield, NC Wesley Chapel, NC
UTILITY OF TEAMS Evaluators Program Managers Technical Assistance Providers
Benefits for Evaluators Quickly check status of data submission for monthly and
semi-annual reporting
Easily access grantee contact information Use indicator report to review data monthly, quarterly
and yearly
Download data in spreadsheet and conduct further
analysis using statistical software
Use TEAMS reports to view qualitative data synopses to
support or clarify quantitative data issues
Benefits for Managers Easily access grantee/TA profile information View grantee Annual Action Plans online Monitor grantee progress individually or by Region Monitor grantee progress monthly, quarterly, or yearly Check grantee status of monthly and semi-annual data
entry
Benefits for TA Providers Scope of Work Calendar view Pending, Scheduled, and completed TA request
Tracking Services and materials via
Spreadsheet
Highlights TEAMS is a customized, flexible, web-based tracking
system
TEAMS collects data related to performance indicators in
accordance with the Teen Initiative Annual Action Plans
Evaluators and Program Managers can use TEAMS to
monitor programmatic changes and evaluate program progress
Improved technology allows for the ability to make rapid
program improvements
Leah M. Ranney, PhD Tobacco Prevention and Evaluation Program University of North Carolina at Chapel Hill Phone: 919-475-2773 Email:
[email protected] Website: http://www.tpep.unc.edu/index.htm