Citation Metrics: Another Sign the US Is Lagging in Scholarship
August 31, 2008
Update: August 31, 2008. Mary Ellen Bates provides more color on the “basic cable” problem for professional informatoin. Worth reading here. Econtent does an excellent job on these topics, by the way.
Original Post
A happy quack to the reader who called my attention to Information World Review’s “Numbers Game Hots Up.” This essay appeared in February 2008 and I overlooked it. For some reason, I am plagued by writers who use the word “hots” in their titles. I am certain Tracey Caldwell is a wonderful person and kind to animals. She does a reasonable job of identifying problems in citation analysis. Dr. Gene Garfield, the father of this technique, would be pleased to know that Mr. Caldwell finds his techniques interesting. The point of the long essay which you can read here is that some publishers’ flawed collections yields incorrect citation counts. For me, the most interesting point in the write up was this statement:
The increasing complexity of the metrics landscape should have at least one beneficial effect: making people think twice before bandying about misleading indicators. More importantly, it will hasten the development of better, more open metrics based on more criteria, with the ultimate effect of improving the rate of scientific advancement.
Unfortunately, traditional publishers are not likely to do much that is different from what the firms have been doing since commercial databases became available. The reason is money. Publishers long to make enough money from electronic services to enjoy the profit margins of the pre digital era. But digital information has a different cost basis from the 19th century publishing model. The result is reduced coverage and a reluctance to move too quickly to embrace content produced outside of the 19th century model.
Services that use other methods to determine link metrics exist in another world. If you analyze traditional commercial information, the Web dimension is either represented modestly or ignored. Mr. Caldwell’s analysis looks at the mountain tops, but it does not explore the valleys. In those crevices is another story; namely, researchers who rely on commercial databases are likely to find themselves lagging behind those researchers in countries where commercial databases are simply too expensive for most researchers to use. A researcher who relies on a US or European commercial database is likely to get only an incomplete picture.
Stephen Arnold, August 31, 2008
Comments
One Response to “Citation Metrics: Another Sign the US Is Lagging in Scholarship”
-
- Subscribe to Beyond Search
Feature archive
News archive
-
The Bates piece implies that the traditional commercial databases contain more than what is accessible through the google, yahoo, scirus and other interfaces to the same big name repositories. This seems to mean – put your credit card back in your pocket and go back to DOS command line subscription searches. Then continuing, your take on the Tracey Caldwell piece is that U.S. scholarship along with these traditional commercial databases are lagging because ROW (remember Rest of World?) is leapfrogging onto the free net. How interesting. Scholar is chomping down on Citations while Bates is saying but wait, what about those other terabytes
for a fee that aren’t showing up. Is the net feeding on itself while the edge is beyond (free) search? Or is what is/was past edge present/future forgetable underflap?