Statistical Analysis of Single-Case Data by James Pustejovsky https://padlet.com/jepusto/WISCC2025 Wing Institute Single Case Conference 2025 en-us 2025-05-15 02:45:07 UTC 2025-05-16 02:41:03 UTC hello@padlet.com jepusto https://padlet.com/jepusto/WISCC2025/wish/3451620098 What common problems are you seeing in manuscript review with respect to statistical analysis and reporting? Have you noticed any improvements in application of statistical analysis?

]]> 2025-05-15 02:49:25 UTC https://padlet.com/jepusto/WISCC2025/wish/3451620098 jepusto https://padlet.com/jepusto/WISCC2025/wish/3451621768 What challenges or limitations are you running into in applying statistical analysis that you think could potentially enhance your work?

]]> 2025-05-15 02:50:12 UTC https://padlet.com/jepusto/WISCC2025/wish/3451621768 jepusto https://padlet.com/jepusto/WISCC2025/wish/3451624414 Have you seen any applications of statistical analysis that you found especially compelling? Have you learned about any statistical methodology work that you find exciting or compelling?

]]> 2025-05-15 02:51:24 UTC https://padlet.com/jepusto/WISCC2025/wish/3451624414 Insufficient reviewer/editor expertise https://padlet.com/jepusto/WISCC2025/wish/3453044188 2025-05-15 20:25:42 UTC https://padlet.com/jepusto/WISCC2025/wish/3453044188 https://padlet.com/jepusto/WISCC2025/wish/3453044915 Lack of training on statistics in doctoral training programs

]]> 2025-05-15 20:26:48 UTC https://padlet.com/jepusto/WISCC2025/wish/3453044915 Lack of training in graduate programs. Finding the right analysis for the data set. https://padlet.com/jepusto/WISCC2025/wish/3453046934 2025-05-15 20:29:49 UTC https://padlet.com/jepusto/WISCC2025/wish/3453046934 Insufficient funding for statistical consult https://padlet.com/jepusto/WISCC2025/wish/3453048421 2025-05-15 20:32:04 UTC https://padlet.com/jepusto/WISCC2025/wish/3453048421 https://padlet.com/jepusto/WISCC2025/wish/3453049468 The knowledge to evaluate indices or procedures is limited to a small number of folks. It feels like gate keeping that only a small handful of folks have the expertise. We don’t want to gate keep.

]]> 2025-05-15 20:33:55 UTC https://padlet.com/jepusto/WISCC2025/wish/3453049468 If our intent is for our research to be relevant & accessible for the populations we serve (behavior analysts, special education teachers, etc.), then we have to be mindful of their ability to understand the outcomes of statistical analysis and how they may apply to their practice. How relevant is it for practitioners? Will the "jargon" act as another barrier for accessing research? https://padlet.com/jepusto/WISCC2025/wish/3453049775 2025-05-15 20:34:20 UTC https://padlet.com/jepusto/WISCC2025/wish/3453049775 I struggle with having to correct things as an editor or AE when reviewers say something incorrect. https://padlet.com/jepusto/WISCC2025/wish/3453049794 2025-05-15 20:34:22 UTC https://padlet.com/jepusto/WISCC2025/wish/3453049794 I do not know the situations or types of data sets the occasion a researcher to select one analysis/test compared to another https://padlet.com/jepusto/WISCC2025/wish/3453050073 2025-05-15 20:34:46 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050073 https://padlet.com/jepusto/WISCC2025/wish/3453050207 No satisfactory way to account for trend when using single case effect sizes

]]> 2025-05-15 20:34:57 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050207 We need to build fluency in R so we can grab the packages from GitHub and then know what to do. We know where to look and know the authors to follow, but get stuck trying to work in R. https://padlet.com/jepusto/WISCC2025/wish/3453050506 2025-05-15 20:35:22 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050506 https://padlet.com/jepusto/WISCC2025/wish/3453050562 Lack of training in any of my graduate programs

]]> 2025-05-15 20:35:27 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050562 A statistician provides two guest lectures in a doc level research method class, and the students always leave inspired by the ways stats could enhance SCD, but they do not have sufficient opportunity or confidence to use the strategies discussed. https://padlet.com/jepusto/WISCC2025/wish/3453050636 2025-05-15 20:35:34 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050636 Reviewer feedback https://padlet.com/jepusto/WISCC2025/wish/3453050712 Reviewer feedback may not be representative of existing best practices or emerging consensus regarding time series data

]]> 2025-05-15 20:35:41 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050712 ensuring consistent alignment between the study/data set and the relevant/recent standards https://padlet.com/jepusto/WISCC2025/wish/3453050926 2025-05-15 20:36:02 UTC https://padlet.com/jepusto/WISCC2025/wish/3453050926 I rely on collaborators to make up for my difficulties in doing the analyses in R myself. There’s so few of you, at times it feels like we need to be respectful of your time https://padlet.com/jepusto/WISCC2025/wish/3453051104 2025-05-15 20:36:21 UTC https://padlet.com/jepusto/WISCC2025/wish/3453051104 Lack of reviewers and associate editors with sufficient expertise, and single case, design and stats https://padlet.com/jepusto/WISCC2025/wish/3453051159 2025-05-15 20:36:27 UTC https://padlet.com/jepusto/WISCC2025/wish/3453051159 A student considered survival analysis for SCD time to treatment effect https://padlet.com/jepusto/WISCC2025/wish/3453051602 2025-05-15 20:37:09 UTC https://padlet.com/jepusto/WISCC2025/wish/3453051602 Challenges https://padlet.com/jepusto/WISCC2025/wish/3453052340

  • Default use of PND and Tau-U

  • Journal mandated use of specific metrics without recognizing purpose

  • Reviewers without knowledge of the statistical analysis

]]> 2025-05-15 20:38:23 UTC https://padlet.com/jepusto/WISCC2025/wish/3453052340 https://padlet.com/jepusto/WISCC2025/wish/3453052760

  • Not having background knowledge about statistics to be able to appropriately select an analytic method

  • Keeping up with new developments in field

    • ]]>     2025-05-15 20:38:48 UTC https://padlet.com/jepusto/WISCC2025/wish/3453052760     People use nonoverlap effects that I think aren't very good. https://padlet.com/jepusto/WISCC2025/wish/3453053544 2025-05-15 20:39:19 UTC https://padlet.com/jepusto/WISCC2025/wish/3453053544 A lack of clarity about the appropriateness of particular methods https://padlet.com/jepusto/WISCC2025/wish/3453054015 2025-05-15 20:40:08 UTC https://padlet.com/jepusto/WISCC2025/wish/3453054015 https://padlet.com/jepusto/WISCC2025/wish/3453054060 Just starting to learn statistics; not enough people with the expertise to be able to teach classes and prepare students to use statistical analysis

    ]]>     2025-05-15 20:40:12 UTC https://padlet.com/jepusto/WISCC2025/wish/3453054060     https://padlet.com/jepusto/WISCC2025/wish/3453054062 Nondiscriminating or incorrect use of various stat analyses, esp. non-overlap procedures despite some existing guidelines.

    Using stat analyses to overcome unclear functional relations.


    We see some improvements in the variety of analyses and their inclusion.

    ]]>     2025-05-15 20:40:13 UTC https://padlet.com/jepusto/WISCC2025/wish/3453054062     We need clarity in the field that many models or indices may have known limitations or the index distributions do not exist to interpret data https://padlet.com/jepusto/WISCC2025/wish/3453054407 2025-05-15 20:40:47 UTC https://padlet.com/jepusto/WISCC2025/wish/3453054407 https://padlet.com/jepusto/WISCC2025/wish/3453054587 PoGO

    Fine grained effect sizes

    ]]>     2025-05-15 20:40:59 UTC https://padlet.com/jepusto/WISCC2025/wish/3453054587     https://padlet.com/jepusto/WISCC2025/wish/3453055092

  • It doesn't always feel useful to include stats in a single study.

  • When we want to include stats, it's not always clear how to use stats and visual analysis and visual analysis together.

  • There's no funding to get help when we're looking for it.

    • ]]>     2025-05-15 20:41:48 UTC https://padlet.com/jepusto/WISCC2025/wish/3453055092     Prediction intervals https://padlet.com/jepusto/WISCC2025/wish/3453055578 2025-05-15 20:42:12 UTC https://padlet.com/jepusto/WISCC2025/wish/3453055578 Authors do not have an understanding of the importance of the unit of analysis https://padlet.com/jepusto/WISCC2025/wish/3453057315 2025-05-15 20:45:02 UTC https://padlet.com/jepusto/WISCC2025/wish/3453057315 Authors do not delineate between what is a measure of magnitude or model of the magnitude, rather than measures of nonoverlap that do not include variability components required for the concept of magnitude https://padlet.com/jepusto/WISCC2025/wish/3453057954 2025-05-15 20:45:56 UTC https://padlet.com/jepusto/WISCC2025/wish/3453057954 Authors struggle with knowing the important features to make decisions (outcome measurement, outcome data type, within or between case, AB comparisons) https://padlet.com/jepusto/WISCC2025/wish/3453059454 2025-05-15 20:48:28 UTC https://padlet.com/jepusto/WISCC2025/wish/3453059454 https://padlet.com/jepusto/WISCC2025/wish/3453092523 Where can scd researchers go for tier 3 supports in using and understanding stats for single case?

    ]]>     2025-05-15 21:44:40 UTC https://padlet.com/jepusto/WISCC2025/wish/3453092523