Assessing the Effectiveness of Wise Guys: A Mixed-Methods Approach

Previous research raised questions on the validity of survey studies with the teen population. As one response, our team implemented a mixed-methods study to evaluate an evidence-based, interactive curriculum, Wise Guys, which is designed to promote healthy relationships and sexual behavior in young men ages 4–17. The current study included a Youth Advisory Group, focus groups, and a video-journaling project to delineate teens' thoughts on the most salient aspects of Wise Guys, and we used these to develop a stakeholder-informed survey instrument. The survey was administered via REDCap, a computer-based medium via phones and mobile devices. Quantitative survey analyses revealed significant positive changes in study constructs. Qualitative interpretations provided rich data that validated the survey findings. Community engagement in the research process and mixed methods may provide the infrastructure for future research and evaluation efforts related to teens.