Posts

An alternative to REF2014?

Image
After blogging last week about use of journal impact factors in REF2014, many people have asked me what alternative I'd recommend. Clearly, we need a transparent, fair and cost-effective method for distributing funding to universities to support research. Those designing the REF have tried hard over the years to devise such a method, and have explored various alternatives, but the current system leaves much to be desired. Consider the c urrent criteria for rating research outputs, designed by someone with a true flair for ambiguity: Rating Definition 4* Quality that is world-leading in terms of originality, significance and rigour 3* Quality that is internationally excellent in terms of originality, significance and rigour but which falls short of the highest standards of excellence 2* Quality that is recognised internationally in terms of originality, significance and rigour 1* Quality that is recogn...

Journal Impact Factors and REF 2014

Image
In 2014, British institutions of Higher Education are to be evaluated in the Research Excellence Framework (REF), an important exercise on which their future funding depends. Academics are currently undergoing scrutiny by their institutions to determine whether their research outputs are good enough to be entered in the REF. Outputs are to be assessed in terms of  "‘originality, significance and rigour’, with reference to international research quality standards." Here's what the REF2014 guidelines say about journal impact factors: "No sub-panel will make any use of journal impact factors, rankings, lists or the perceived standing of publishers in assessing the quality of research outputs." Here are a few sources that explain why it is a bad idea to use impact factors to evaluate individual research outputs: Stephen Curry's blog David Colquhoun letter to Nature Manuscript by Brembs & Munafo on "Unintended consequences of journal rank" Editage ...

Genetic variation and neuroimaging: some ground rules for reporting research

Image
Those who follow me on Twitter may have noticed signs of tetchiness in my tweets over the past few weeks. In the course of writing a review article, I’ve been reading papers linking genetic variants to language-related brain structure and function. This has gone more slowly than I expected for two reasons. First, the literature gets ever more complicated and technical: both genetics and brain imaging involve huge amounts of data, and new methods for crunching the numbers are developed all the time. If you really want to understand a paper, rather than just assuming the Abstract is accurate, it can be a long, hard slog, especially if, like me, you are neither a geneticist nor a neuroimager. That’s understandable and perhaps unavoidable. The other reason, though, is less acceptable. For all their complicated methods, many of the papers in this area fail to tell the reader some important and quite basic information. This is where the tetchiness comes in. Having burned my brains out trying...

Genes, brains and lateralisation: how solid is the evidence?

Image
If there were a dictionary of famous neurological quotes, “Nous parlons avec l'hémisphère gauche” by Paul Broca (1865) would be up there among the top hits. Broca’s realisation that the two sides of the brain are functionally distinct was a landmark observation. It was based on a rather small series of patients, but has since been confirmed in numerous studies. After localised brain injury, aphasia (language impairment) is far more likely after damage to the left side than the right side. And nowadays, we can visualise greater activation of the left side in neurologically intact people as they do language tasks in a brain scanner. There are many fascinating features of cerebral lateralisation, but I’m going to focus here on just one specific question: what do we know about genetic influences on brain asymmetry in humans?  There are really two questions here: (1) how do genes lead to asymmetric brain development? (2) are there genetic variants that can account for individual variat...

Psychology: Where are all the men?

Image
There's a lot of interest in under-representation of women in certain science subjects, but in psychology, there's more concern about a lack of men. A quick look at figures from UCAS* (Universities & Colleges Admissions Service) shows massive differences in gender ratios for different subjects. In figure 1 I’ve plotted the percentage of women accepted for subjects that had at least 6000 successful applicants to degree courses in 2011. Fig. 1. % Females accepted on popular UK degree courses 2011 Given the large sample sizes, the sex differences are statistically significant for all subjects except Media Studies, which is bang on 50%. As a psychologist, I found the most surprising thing about this plot was the huge preponderance of women in psychology. This didn’t square with my experiences: my colleagues include a good mix of men and women, so I was keen to find the explanation for the mismatch. There seemed to be several possible explanations, which aren’t mutually exclusi...