Data Driven Decisions by Jt Torres https://padlet.com/jmtnom/wcvcqbtciff7gcxo en-us 2022-12-19 19:52:58 UTC 2023-02-10 20:59:52 UTC hello@padlet.com In this column, describe challenges at your institution preventing meaningful data collection and strategic decision-making. jmtnom https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425161199 2022-12-19 19:55:03 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425161199 Please click the + under each relevant column to add your responses jmtnom https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425161488 2022-12-19 19:55:29 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425161488 In this column, describe the current role assessment plays at your institution: How does your institution communicate data to inform budget allocations? How does your institution communicate data to inform satisfaction? jmtnom https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425170119 2022-12-19 20:09:02 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425170119 In this column, consider the campus conversations at your institution that you can engage: What data CURRENTLY informs decision making? What data SHOULD inform decision making? jmtnom https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425179347 2022-12-19 20:24:16 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2425179347 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907380 Many faculty feel that the collection of data is the point and are not motivated to respond to the data.]]> 2023-02-10 20:15:03 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907380 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907527 Unanswerable questions are being asked]]> 2023-02-10 20:15:14 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907527 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907794 Describing the data in meaningful ways ]]> 2023-02-10 20:15:30 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907794 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907924 One office doesn’t talk to the other—territorialism

Competing definitions of terms


]]> 2023-02-10 20:15:40 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476907924 Data Systems https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908021 Different data collection systems that don’t integrate well. (SIS, FinAid)]]> 2023-02-10 20:15:47 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908021 Lack of coordination between offices/departments https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908054 2023-02-10 20:15:50 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908054 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908104 Knowing what data is available and IR’s willingness to share that data. ]]> 2023-02-10 20:15:53 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908104 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908157 Getting people into the habit of looking at data before making decisions. ]]> 2023-02-10 20:15:57 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908157 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908284 Poor collaboration across units]]> 2023-02-10 20:16:06 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908284 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908336 Centralized data collection compared to silo’d data that people may or may not know about.]]> 2023-02-10 20:16:11 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908336 Sometimes data changes to support the presenters' decision https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908542 2023-02-10 20:16:26 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908542 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908677 Knowing how to access and interpret centralized data ]]> 2023-02-10 20:16:37 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908677 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908753 Time to figure out best data. Who has what types of data?]]> 2023-02-10 20:16:43 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908753 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908762 Decisions are being made without an understanding of what the data really means and without consulting with those that best understand the data]]> 2023-02-10 20:16:43 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908762 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908826 Constituents don’t know how to interpret the data]]> 2023-02-10 20:16:49 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908826 Tech https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908993
No single app/platform, nor standards for the collection of that information beyond “participation/enrollment”]]> 2023-02-10 20:16:59 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476908993 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909006 Only one IR person ]]> 2023-02-10 20:17:00 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909006 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909279 requests for compilation of data are often seen as a meaningless nuisance or (worse) a threat]]> 2023-02-10 20:17:19 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909279 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909388 Knowing which questions to ask. ]]> 2023-02-10 20:17:27 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909388 Students and faculty aren't always seen as co-designers that deserve to have agency over whether, what, and how data should be collected. It also seems that data driven tools often accept austerity as a given, rather than a policy choice that can be challenged or changed. https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909472 2023-02-10 20:17:33 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909472 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909589 Unclear what data needs to be collected and what it is that we are trying to track. There are too many people with ideas on what we should do, but nobody is willing to say this is the direction we should go]]> 2023-02-10 20:17:39 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909589 Pushback against the idea of operationalizing strategic pillars as metrics (measurable KPIs) https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909617 2023-02-10 20:17:41 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909617 Without knowing the question, what data to collect, in what form, and from where is challenging. https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909810 2023-02-10 20:17:54 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476909810 Data we rely heavily on - like class sizes, faculty loads etc don't work appropriately for people teaching labs or studio classes and it may not be clear to folks using the data why this is the case https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910037 2023-02-10 20:18:10 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910037 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910257 Common definitions I.e. Full time/ part time ratio: what is a full time faculty member. What if he/she teaches extra courses? Adjunct for the overload courses and full time for the contracted load, or all full time?]]> 2023-02-10 20:18:28 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910257 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910268 This is mostly done at upper administration/cabinet level (small school). I’ve only really seen it shared with faculty when we hired a consultant company. ]]> 2023-02-10 20:18:29 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910268 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910413 Learning Outcome assessment data is currently not used to tell the story of our institution. We also are not engaging in meaningful assessment of co-curricular and curricular-support.]]> 2023-02-10 20:18:38 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910413 Pockets of data but not consistent amount/ depth across areas https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910461 2023-02-10 20:18:41 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910461 Double Standards https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910852
Clear data necessary for a proposal, but data has little influence on larger institutional priorities. Ad hoc relationships and convenient benchmarking seem to do much of the heavy lifting there]]> 2023-02-10 20:19:11 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476910852 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911411 Technology is a big issue- what do we do with the data we collect and how do we present that data? What should we use to house the data, present the data etc?

]]> 2023-02-10 20:19:46 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911411 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911550 Our office has not been part of strategic planning, though we are moving that way next fall.


]]> 2023-02-10 20:19:55 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911550 Data quality https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911591 Poor data quality. Important indicators are difficult to access (e.g. number of majors). Plethora of purchased tools and reports. different tools give different answers to the same question. IR office produces misleading reports on fundamental measures ( I.e credit hours generated per department).]]> 2023-02-10 20:19:58 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911591 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911986 We often mistakenly assume that perception is consistent with reality]]> 2023-02-10 20:20:26 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476911986 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476912178 Deans are supposed to look at current numbers of majors when planning future course scheduled, but they go by last year’s data instead. Then we have low enrolled courses. ]]> 2023-02-10 20:20:41 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476912178 Student voice? Employer voice? https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476912179 2023-02-10 20:20:41 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476912179 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476912833 OIR has good data but (I think) mostly works on
1) reporting out to the government, US news&world, etc.
2) helping keep track of faculty teaching loads, class sizes]]> 2023-02-10 20:21:28 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476912833 The President’s Cabinet makes most budgetary decisions with little input from the IE office or the faculty https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476913205 2023-02-10 20:21:55 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476913205 Our institutional researcher is no longer able to provide data to faculty or departments as she is too busy providing data for academic affairs, assessment, IPEDs, etc https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476913389 2023-02-10 20:22:08 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476913389 When it comes to data used for student success, it often seems to focus on nudging students to make "good" choices (the right configuration of classes, to spend more time in the library, etc.) rather than addressing institutional failures to support marginalized students, and which might require that administrators and policymakers, rather than students, become the object of the data collection and analysis. https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476914896 2023-02-10 20:24:02 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476914896 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476915192 OIR itself emphasizes that their job is only to provide data but not to provide “the narrative”.]]> 2023-02-10 20:24:24 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476915192 Concerns about outsourcing of institutional data collection and assessment to private companies, concerns about data that can be used to curtail academic freedom of faculty and undermine student privacy and other protections. https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476917583 2023-02-10 20:26:59 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476917583 Satisfaction survey reports come before and are at least somewhat verbally summarized at college wide functions https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476926977 2023-02-10 20:38:00 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476926977 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476927045 it feels like data isn't communicated- it's more along the lines of here is the issue we are dealing with currently- what data do we have help us with this problem- it feels like data is reactive not proactive

]]> 2023-02-10 20:38:06 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476927045 Not sure about budget allocation https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476927602 2023-02-10 20:38:42 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476927602 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476928893 Current- Enrollment, retention, and graduation rates
Should include student success around stated outcomes]]> 2023-02-10 20:40:30 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476928893 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476929605 The data that demonstrates money acquisition (butts in seats) is used but student learning is ignored. ]]> 2023-02-10 20:41:27 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476929605 I'm concerned that some institutions are using institutional data to undermine DEI efforts and racial equity education, rather than support them. https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476929844 2023-02-10 20:41:49 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476929844 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476929864 We don’t share information below the highest levels of leadership. We don’t collect good/reliable data to start with either. ]]> 2023-02-10 20:41:51 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476929864 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476930145 We gather data very well, and yet most curricular decisions are made by anecdotal evidence and perception]]> 2023-02-10 20:42:18 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476930145 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476932492 We report various metrics (ETA assessment test scores, program assessment plan results, etc.) most faculty see this as lip service for accreditation, while a few faculty and the Dean are encouraging us to treat these data as opportunity for reflection.]]> 2023-02-10 20:45:29 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476932492 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476937282 Data that shows that students are learning, they are developing critical thinking skills and that we are developing graduates that are well rounded citizens]]> 2023-02-10 20:52:16 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476937282 News and opinion articles often inform the conversation, sometimes independent of Institutional data. https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476941642 2023-02-10 20:57:59 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476941642 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476942453 Instructional units, term and enrollment and majors reports all used heavily ]]> 2023-02-10 20:59:03 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476942453 Should dig into retention causes and correlates https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476942471 2023-02-10 20:59:04 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476942471 https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476943083 I’ll add - we use course grades, DFW rates. Should use student learning metrics. ]]> 2023-02-10 20:59:52 UTC https://padlet.com/jmtnom/wcvcqbtciff7gcxo/wish/2476943083