< Evidence-based assessment < ROC Party
Click to see contents of the EBA wiki

Special:Prefixindex/Evidence-based assessment/ROC Party/Summer 2017/


Medical disclaimer: This page is for educational and informational purposes only and may not be construed as medical advice. The information is not intended to replace medical advice offered by physicians. Please refer to the full text of the Wikiversity medical disclaimer.


Receiver Operating Characteristic (aka ROC) Party, hosted at University of North Carolina

Hashtags: #ReadyToROC
Call in number: 1-712-432-6333, code: 202921
Next Date: February 20, 2017

Evidence-based assessment/ROC Party/Sidebar

Welcome to the ROC Party landing page! We will use this page to include a suggested syllabus and non project-specific material.

The bulk of the work happens in between our weekly calls, and there are several things that should happen in the coming weeks to get the most out of the party.

Following these steps makes it more likely than not that you’ll have both a deeper understanding of the concepts, and also a manuscript with at least the Methods, Results, tables and figures ready to go as soon as possible.

Google Doc

Groups

Project IdeaCollaboratorsCanvas Link AARF MONS Code Final Code MONS Lit Review Team Deadline for Submission
Depression (#800.20)

(Point: Kenny)

 GBI and Depression ROC in ABACAB
  • Kenny Le
  • Minakshi Pillai
  • Shelby Johnson

(+ ABACAB collabs)

Depression Canvas Depression AARF
  • Kenny
  • Minakshi
  • Shelby
 #800.20 Final Code Depression Lit Review
Mania (#210)

(Point: Rachael)

 ABACAB Primary Horserace
  • Rachael Kang
  • Lizzie Wilson
  • Addie Jeffs
  • Guillermo Perez Algorta
  • Eric Youngstrom

(+ ABACAB collabs)

Mania Canvas Mania AARF
  • Rachael
  • Lizzie
  • Addie
 #210 Final Code Mania Lit Review
ASPD (#166)

(Point: Jacquee)

 To ROC an antisocial processes screening device
  • Jacquee Genzlinger
  • Kristen Green
  • Logan Smith
  • Kristen McGreevy
  • Hannah Lucero
  • Paul Frick (as consult)

(+ ABACAB collabs)

ASPD Canvas ASPD AARF
  • Jacquee
  • Logan
  • Kristen
  • Hannah Lucero
 #166 Final Code ASPD Lit Review

    Suggested timeline

    ScheduleGoal for weekLogisticsActivities Readings/Resources
    Week 1

    (2/13)

    Conceptual Grounding in ROC

    How is it different from t-test and other traditional statistical methods in the social sciences?

    		 Register:
    • Dropbox
    • Peerwise

    If unable to register, please contact Mian-Li Ong at mian@med.unc.edu

    		 Read:
    • Youngstrom (2014) “Ready to ROC” primer

    Assignments:

    Fill out ROC Planning Canvas

    • Criterion definition (who counts as a hit, who counts as a false positive)
    • Distractor variables (what variables will likely create false positives)
    • Predictor variables (name of the scales)
    • Moderator variables (anything that might change accuracy of the test)
    • Confounds (things that we should adjust for in addition to the moderator variables)

    Alert areas

    • Writing part of measures section that describes the interview. Eric has already written this so we need to reword it

    Fill out Author Agreement Registration Form ("AARF")

    • Get data use agreements for every ROC participant

    Write IRB Proposal
    Week 2 (2/20)

    Introduction to Your Dataset

    What is your dataset, and what is your research question?

    		 Post open-ended questions and logistical questions to the Talk pageAssignments:
    • Discuss ROC Planning Canvas
    • Read each other's group canvas,
    • Practice with sample data from Ready to ROC Care Package
    • Read Introduction and Discussion section of meta-analysis paper
    • Start article search along with data analysis
      • References within last 2 years (something new)
      • Discuss similar scales and their psychometrics/meta analysis (something borrowed)
      • Cite something from Carolina - something our group has done (something blue)
      • Target is to have ~8 articles for introduction
    Week 3

    Finalizing Dataset and Team Building

    Who is in your team? Which dataset are you using?

    		 Each team should have:
    • 1 experienced ROCStar
    • 1 content expert
    • 1 person familiar with dataset
    • 1 understudy, aka. "wingman"

    Logistics:

    • Deidentify data set
    • Local data use agreement
    • Any other permissions
    		 Assignment:
    • Complete ROC planning canvas
    • Get feedback from experienced ROCStar
    • Finalize dataset choice and team
    Week 4

    We Are Ready to ROC

    All of your team should have met, and everyone should have the data!
    • Complete at least one pre-meeting for "meet and greet" of your team
    • Make sure everyone has data and appropriate permissions
    		 Assignment:

    Schedule large meeting call

    Sample ROC code

    Other resources

    Suggested timeline (from 2/3/2017)

    Meeting times are 6.00pm to 8.00pm. Items should be completed before meeting.

    1. Monday, 2/13: First meeting discussing overview, including introduction, etc
    2. Monday, 2/20: Methods, Searching
    3. Monday, 3/6: Results, Figures, Drafts
    4. Monday, 3/27: Buff Results, Figures, Tables, Outline for discussing introduction
    5. Monday, 4/3: Draft of paper
    6. Monday, 4/10: Review and Organize

    Previous ROC parties

    1. Inaugural ROC Party - Summer 2015
    2. Second ROC Party - Summer 2016
    3. ROCParty@Carolina (2-13-2017 to 5-31-2017)

    Example ROC papers

    • Ready to ROC
    This article is issued from Wikiversity. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.