Home / Course catalog / Evaluation Foundations (WWC Sprint 009)

WWC Sprint

Evaluation Foundations (WWC Sprint 009)


Description

Start Date: September 16, 2019
--
Duration: 12 weeks
--
Why do evaluations matter? City governments take responsibility for providing a wide range of necessary services, and resources are often limited, so every dollar is a trade-off! Through rigorous evaluation, we can build an evidence base and continually improve the quality and efficiency of our programs and services.

In this Sprint, you’ll learn the basic principles of evaluation, apply them to your own real-world challenge, and discuss ways to build up your ongoing evaluation capacity. Join BIT for webinars, calls, and resources with step-by-step information on how to run your own randomized trial and assess your city’s next steps to encourage continuous testing and improvement.

What to Expect:

• September 18, 2019 Webinar: Introduction to Evaluations
• Resources (including sample policies, templates, and evaluation guides)
• 3 rounds of office hours for calls with BIT experts for Q&A and support
• Personalized feedback and document review from a BIT advisor
• November 20, 2019 Webinar: Sustaining evaluations through teams, process, and policy

Recommended Participants: Any interested city staff and elected officials interested in running their own randomized field experiment. We highly recommend participants with an opportunity to test a redesigned email communication for this Sprint. For folks who aren’t quite ready to run a trial or who already have lots of experience with field evaluations, we invite you to follow along and join us for the webinar sessions on building and sustaining your evaluation capacity.

Achievable Criteria: 5 Evaluation criteria, 1 General Management criterion

• Your local government has a policy or ordinance that encourages the use of rigorous evaluation methods for practices, programs, and/or policies.
• Your local government has defined standards, methodologies, or tools to help staff rigorously evaluate practices, programs, and/or policies.
• Your local government requires that, as a condition of funding, new or renewed programs will be rigorously evaluated.
• Your local government has a designated leader and/or team responsible for helping departments conduct experimental or quasi-experimental evaluations.
• In the past 12 months, your local government has launched two or more experimental or quasi-experimental evaluations.
• In the past 12 months, your local government has used the results from experimental or quasi-experimental evaluations to make different, or to newly justify, decisions.

Start Date: 09/16/2019

Content
  • Kick Off
  • Welcome to the Evaluation Foundation Sprint
  • Sprint Pre-Course Survey
  • Discussion: Introductions Thread
  • Kickoff Webinar Slides
  • Week 1 Review
  • Kickoff Resources
  • Webinars: Schedule, Connecting Information, and Recordings
  • Evaluation Foundations Overview
  • Sprint FAQ
  • Running your own RCT
  • Week 2: Scoping your trial
  • Week 2 Review
  • Week 2 Task: Is an RCT right for me?
  • Discussion: Running your own RCT
  • Week 2 Task: Submission
  • Week 3: Design your intervention
  • Week 3: Email Intervention Checklist
  • Week 3 Review
  • Week 3 Task: Trial Protocol: Project background and intervention design
  • Week 3 Task: Trial Protocol Part 1
  • Week 4: Outcomes and Participants
  • Week 4 Review
  • Week 4 Task: Trial Protocol - Trial design
  • Week 4 Task: Trial Protocol Part 2
  • Week 5 Slides.pdf
  • Week 5 Review
  • Week 5 Task: Trial Protocol - Trial Design
  • Week 5: Randomization and Sample Size
  • Embedding Evaluations 100d
  • Wrap Up 104d 4h
  • Sprint Post-Course Survey
  • Evaluation Foundations Overview (clone)
  • Evaluation Foundations Overview (clone)
  • Section 6 104d 6h
  • Section 7 104d 8h
Completion rules
  • All units must be completed