Latest posts tagged with #REF2021 on Bluesky
Such an exploration of REF2021 impact case studies.
The data challenge a common assumption about single-output ICS, and that’s exactly why evidence matters.
What’s been your experience with single-output case studies? www.stephenckemp.co.uk/ref-impact-c...
#REF2021 #researchimpact #casestudies
Links:
* www.theguardian.com/global-devel...
** www.thelancet.com/series-do/mi...
*** Taken from results2021.ref.ac.uk/impact/dac99...
#REF2021
Screenshot of article title, authors, and Abstract Psychology and research assessment in the United Kingdom Matthew Inglis,Colin Foster,Hugues Lortie-Forgues,Victoria Simms & Elizabeth Stokoe Abstract What can we learn about psychology research in the UK, and its perceived quality, from examining manuscripts submitted to the psychology, psychiatry and neuroscience subpanel of the 2021 Research Excellence Framework (REF2021)? Using a latent Dirichlet allocation topic modelling approach, we identified 33 topics which collectively summarised the content of the journal articles returned to the subpanel. We found that the composition of submissions to the subpanel, in terms of these topics, explained a large proportion of the variance in the quality assessments they received from the expert peer review subpanel. Our model identified topics which were typically associated with receiving higher and lower unit-level quality assessments. In our discussion we pay particular attention to the fate of qualitative research, and discuss possible accounts for why units who returned a large amount of qualitative work tended to receive lower quality assessments than those who did not.
For anyone interested in #psychology, #research assessment and evaluation, how the expert panel rated research submitted to #REF2021 - and especially the fate of #qualitative research - our article in Cogent Psychology is #OpenAccess (link in next post).
1/2
Published open access this week in OUP’s Research Evaluation (by me)
Equality and employment aspects of the UK Research Excellence Framework url: academic.oup.com/rev/article/...
#REF2021 #REF2029
Meet our next #RISummit Duo: David Phipps & Dori Simeonov
They will explore Strengthening Institutional Impact Support, with fresh perspectives on changes after #REF2021 in the UK and the evolving role of #AI in knowledge mobilization.
Register now at researchimpactsummit.com
Investing in research in the #InnovationCorridor between #Camden and #Peterborough benefits...everyone. Here's #REF2021 impact of the Corridor's #universities mapped across the UK. Darker the colour the greater the.impact concentration.
Happy to have a chat if you go in this direction and find it useful. I was involved in the submission side of #REF2021 so I might be able to answer some questions about structures, organisation, etc - not a research area of mine, though (DM/ my institutional details are easy to find).
Taking it on from the other side: In the UK's Research Excellence Framework research units need to report so-called "Impact Case Studies", i.e. how their research has been used outside academia. Maybe worth a shot?
#REF2021
results2021.ref.ac.uk/impact
#REF2014
impact.ref.ac.uk/casestudies/
In May 2022, @livunipol.bsky.social got its #REF2021 results, which showed significant progress from the previous REF! We were proud of these results - for a day, then we start planning on how to improve them further! IMO, 100% of academics (PhD to Prof) should go in so all research is celebrated!
Spent the day talking #REF2029, so...
#REF2021 cost HE £430m, or ~£3m per institution.
70% of UK HEIs are forecast to be in the red soon.
So...why's the sector doing this when >90% of the variance in QR is explained just by citations?
REF's great but...keeping HE is more important for the UK.
Doing a research on books in the #REF2021 project. One weird finding is that political science has very high share of authored books among all books (vs. edited books and book chapters). #bibliographicdata #scisci #scientometrics
Discussing their recent study of #REF2021 environment statements, @lizziegadd.bsky.social, @lizstokoe.bsky.social & @mjinglis.bsky.social highlight eight features of 'good' statements & suggest how they can be incorporated into work for #REF2029
#ResearchEvaluation #HigherEducation wp.me/p4m9em-cSm
What is a high-quality research environment? Evidence from the UK’s research excellence framework Matthew Inglis, Elizabeth Gadd, Elizabeth Stokoe Abstract As part of the UK university sector’s performance-related research funding model, the ‘REF’ (Research Excellence Framework), each discipline-derived ‘Unit of Assessment’ must submit a statement to provide information about their environment, culture, and strategy for enabling research and impact. Our aim in this paper is to identify the topics on which these statements focus, and how topic variation predicts funding-relevant research environment quality profiles. Using latent Dirichlet allocation topic modelling, we analysed all 1888 disciplinary ‘unit-level’ environment statements from REF2021. Our model identified eight topics which collectively predicted a surprisingly large proportion—58.9%—of the variance in units’ environment scores, indicating that the way in which statements were written contributed substantially to ....
What is a high-quality #research #environment?
New paper by @mjinglis.bsky.social @lizziegadd.bsky.social & me topic modelling all unit-level #REF2021 environment statements shows that how statements were written contributed substantially to the perceived quality of a unit’s research environment.
Coming to the end of the week
Part 4 of #REF2014 #REF2021 #psychometrics.
This time a look at how much the institutions matters from which a submission is made for the respective GPA score.
Back to #REF2014 #REF2021 application of #psychometrics in clustered data:
Do subject-specific standards matter?
The Research Excellence Framework is the UK’s system for assessing the quality of research in UK higher education institutions.
More detail:
In #psychometrics & #REF2021 the analyses from
are now applied to #REF2021 data.
The #REF2014 high inter-correlations between the 3 quality indicators were interpreted as evidence that dropping any one of the indicators has little effect on ordering.
#REF2021 #REF2028 research evaluation activity picked up gain & I came back to analyses I did earlier this year replicating parts of this paper by @Mehmet_Pinar_M @timjhorne:
The paper applies #PCA to #REF2014 profile data:
💾
So... how many #REF2021 Impact Case studies were about forcing a socially or environmentally problematic company out of business??
Congratulations to @UoSGeogEnv for rising to joint 3rd place in the Geography and Environmental Studies #REF2021
The culture of anti intellectualism in the U.K. does us no favours. 41% of research found to be world beating. Today should be a national holiday #REF2021 https://on.ft.com/3L8S6Pw
88% of Oxford’s archaeology research submission was rated 4* & 3* - or 'world leading' & 'internationally excellent'. Endorsing the research power of our community & networks across the globe & testament to the positive impact #archaeology has in the present! #REF2021
Sparing a thought for academic colleagues up nice and early to ponder the meaning of #REF2021 (or is it #REF2022) 😀
I can see my office! - great #ref2021 result for @NorthumbriaUni today and @NBSNU campus featured here. Places us top 30 for research power. Congrats to all my colleagues - it’s been hard work but paid off :) #lovehe #highered
Good morning, UK academia. Rankings don't define us and sure as hell should not divide us. #CollaboratorsNotCompetitors #REF2021
Cannot believe I am sitting in Finland wondering/curious about #REF2022 #REF2021 results
I left the UK in Oct 2020 - But I guess, if a success, my strategy as PVC-Research in my last institution will not be remembered, but if it has gone wrong my input will be an easy target 😂
Heidi Brattland provides a fascinating insight into planning and building feedback systems in Norway and how feedback is a good cultural fit.
Have a look at this interview:
And one of the studies she refers to:
#REF2021
Can we agree that if one is comparing 2/+ treatments w/o random assignment, extraordinary methods & arguments are required to even suggest that they correlate w anything at all?
[After living under the #REF2021 rock, just coming back to #peerreview-ing]
On 20 Nov @ResEngland @UKRI_News confirmed Mar21 #REF2021 submission date. Given emergence ofmuch more infectious Cov-19 variant & now closure of schools for 6+ wks, there is strong case for reconsidering this decision & postponing further. Staff are stretched to breaking point.
