Measuring Attention In Science And Technology – Forbes
Soccer fans cheering
Most people alive today who are not in science or medicine will not be able to quickly recall just ten biologists or ten chemists and their discoveries. Most of them can have a happy life without that knowledge. But may will easily recall ten popular sports people, singers, actors, and even the members of the Kardashian family. Some will recall celebrity scientists from the past including Einstein, Newton, Tesla. Celebrity scientists nowadays are very rare. In this long article I would like to explore some of the reasons why there is a lack of celebrity scientists, why do we need more of them, and how to track the popularity of academic papers.
circa 1955: Mathematical physicist Albert Einstein (1879 - 1955) delivers one of his recorded ... [+] lectures. (Photo by Keystone/Getty Images)
Have you ever heard someone being told that they have a memory like a goldfish? Ever wondered what this expression even means? It means that they tend to forget something rather quickly or that they have a short memory span. But the truth is that this expression is a myth. Goldfish do not have a 3-second memory span like we often hear. At least not according to this article by Live Science, which claims that some goldfish have a memory span of 2 seconds and others, 10 seconds but its always short. But humans are not goldfish. We have a capacity to retain various types of information for different lengths of time. Short-term memories last seconds to hours, while long-term memories last for many years. According to this article by National Geographic, we also have a working memory that allows us to keep something in our minds for a limited time by repeating it. Whenever you read an academic article over and over again to memorize it, youre using your working memory. Another way to categorize memories is by the subject of the memory itself. You tend to remember things you most deeply and passionately care about. Everyone cares about different things and so they retain information differently. I believe the most important type of information that we must retain is in scientific knowledge and discoveries. It is sometimes frustrating to see people forget about some of the most famous modern-day scientists in the world while choosing to remember certain celebrities who are famous for being famous.
NEW YORK, NY - FEBRUARY 11: (L-R) Khloe Kardashian, Lamar Odom, Kris Jenner, Kendall Jenner, ... [+] Kourtney Kardashian, Kanye West, Kim Kardashian, Caitlin Jenner and Kylie Jenner attend Kanye West Yeezy Season 3 on February 11, 2016 in New York City. (Photo by Jamie McCarthy/Getty Images for Yeezy Season 3)
For example, you may constantly hear about the Kardashians on the news or on social media, but when was the last time you heard about Rosalind Franklin? Or John Ray? Or John Logie Baird? Rosalinds work was instrumental in the understanding of the molecular structures of DNA; John Ray published important works on botany, zoology, and natural theology; and John Baird demonstrated the world's first live working television system. The work done by the former two is crucial to our understanding of humans, whereas the invention of the latter is something that we rely on to spread information. The truth is that while theres nothing wrong with seeing celebrities dominating the news cycle in todays day and age, we must also not forget those who have contributed so much to science.
CEO of Tesla Motors and SpaceX, Elon Musk speaks to a crowd of people who had gathered to ... [+] participate in Tesla Motors test drives outside the Texas Capitol building in Austin on January 15th, 2015. Tesla manufactures and sells electric cars. (Photo by Robert Daemmrich Photography Inc/Corbis via Getty Images)
It was not until Elon Musk entered the game and started promoting hardcore science in the consumer space that made him into the first celebrity-scientist-entrepreneur that smart kids put on their walls as a role model. Still, very few people know about Elons early successes like Zip2 and X.com. Even today, most people know about Elon because of SpaceX and Tesla. Neil deGrasse Tyson, a highly accomplished astrophysicist, gained more attention after he popularized science with such books as The Pluto Files and through his frequent appearances on television. Bill Nye had to host the science television show Bill Nye the Science Guy and the Netflix show Bill Nye Saves the World to get famous. Few people know about his career as a mechanical engineer for Boeing. Fewer know about his many patents.
Lee Se-Dol (C), one of the greatest modern players of the ancient board game Go, arrives before the ... [+] third game of the Google DeepMind Challenge Match against Google-developed supercomputer AlphaGo at a hotel in Seoul on March 12, 2016. / AFP / JUNG Yeon-Je (Photo credit should read JUNG YEON-JE/AFP via Getty Images)
When it comes to companies, DeepMind, a subsidiary of Alphabet that builds advanced AI, managed to achieve greatness and fame by combining science with carefully-crafted PR. In 2017, DeepMind released a documentary called AlphaGo: The Movie, which helped inspire a generation of scientists as well as the general public. The documentary is about a five-game Go match between world champion Lee Sedol and AlphaGo, a computer program that combines advanced search tree with deep neural networks. These neural networks take a description of the Go board as an input and processes it through a number of different network layers containing millions of neuron-like connections (Spoiler alert: The AI wins). Not only did the documentary receive multiple awards and nominations, but it also inspired people to work on AI.
Altmetric page of an academic paper
Very often, we see truly amazing scientific achievements published in peer-reviewed journals, conferences, or on pre-print servers. These are largely ignored by the mainstream public. To help measure attention beyond academia, Nature Publishing Group adopted a score called Altmetric.
According to its website, Altmetric are metrics and qualitative data that are complementary to traditional, citation-based metrics. They can include peer reviews on Faculty of 1000, citations on Wikipedia and in public policy documents, discussions on research blogs, mainstream media coverage, bookmarks on reference managers like Mendeley, and mentions on social networks such as Twitter. Sourced from the internet, Altmetric can tell about how often journal articles and other scholarly outputs like datasets are discussed and used around the world. Altmetric has been incorporated into researchers websites, institutional repositories, journal websites, and more.
Altmetric - the measure of attention of academic papers
In order to track online attention for a specific piece of research, Altmetric requires the following three things: An output (journal, article, dataset, etc), an identifier attached to the output (DOI, RePEc, etc), and mentions in a source that it tracks.
Once it tracks a mention of the research, Altmetric collates it together with any other online attention it has seen for that item. It then displays it via the Altmetric details page, along with its unique donut and automatically calculated Altmetric Attention Score. Altmetric also includes the technological capacity to track items according to their unique Unform Research Identifier. So far, Altmetric has worked with institutions, funders, think-tanks and publishers to track attention to their press releases, grey literature and company reports.
The Nature Index is another great database of author affiliations and institutional relationships. It tracks roughly 60,000 research articles per year from 82 high-quality natural science journals and provides absolute and fractional counts of article publication at the institutional and national level. The Nature Index was conceived by Nature Research, one of the worlds leading multidisciplinary science journals. In total, more than 10,000 institutions are listed in the Nature Index.
Here's how the Nature Index works.
According to its website, the Nature Index uses article count (called Count) and fractional count (called Share) to track research output. A country/region or an institution is given a Count of 1 for each article that has at least one author from that country/region or institution. This is the case regardless of the number of authors an article has, and it means that the same article can contribute to the Count of multiple countries/regions or institutions.
To look at a countrys, a regions or an institutions contribution to an article, and to ensure they are not counted more than once, the Nature Index uses a fractional count, referred to as Share, which takes into account the share of authorship on each article. The total Share available per article is 1, which is distributed among all authors under the assumption that each contributed equally. For instance, an article with 10 authors means that each author receives a Share of 0.1. For authors who are affiliated with more than one institution, the authors Share is then split equally between each institution. The total Share for an institution is calculated by summing the Share for individual affiliated authors. The process is similar for countries/regions.
Other publishers have tried to copy their model but Altmetric remains the de-facto standard. And some of the concepts of Altmetric are integrated into many other places. For example, at Insilico Medicine in PandaOmics we track the industry's attention to protein target using a tool called TargetMetric, which also presents a flower composed of the various sources of attention. It looks like Altmetric inspired many companies to represent attention in the flower format.
While very often more conservative scientists criticize scientific PR and optimization of the papers for higher Altmetric and often sensational nature of the announcements that help achieve higher Altmetric Attention Scores, it is extremely important to understand that the kids who are growing up today live in a new world of technology that is optimized to grab their attention and compete for their eyeballs. So it is important to compete not with the other scientists but with non-value-adding celebrities and noise and get the attention back into the real world of science. Like I said in the beginning of this article, humans are not goldfish; we have a capacity to retain various types of information for different lengths of time. We should use this capacity to learn more about science and the minds behind recent scientific developments.
Since inception Altmetric fascinated me. I think that it is our duty as scientists to popularize the scientific achievements of our own teams and the achievements of others and inspire the people to get into biomedicine. Tracking attention for scientific papers is not an easy task and Nature did not disappoint. Other publishers tried to launch similar systems that pale in comparison in terms of the quality, scale, and presentation. Hence, I was very pleased when Katherine Christian, CEO of Altmetric, agreed to answer a couple of my questions.
Alex: In your opinion, what the scientists can do to increase the popularity of their articles?
Kathy Christian: We don't advocate increasing the popularity of research simply to increase the Altmetric Attention Score. When it comes to research attention, we encourage researchers to think about the aim of their research - what outcomes are they looking for - and to focus on the specific attention sources (e.g. policy, news, twitter) that are going to be most helpful in achieving those outcomes. For example, a researcher working on new ways for governments to reduce carbon emissions is most likely going to focus on attention in policy documents, whereas a researcher working on effective management of diabetes may be more focused on twitter and facebook with the aim of reaching patients. One tip we suggest is to search for research in your field that has been successful in reaching the audiences that you're keen to reach and review their attention profile to help develop your communication strategy. For some more detailed tips we have a blog posts on this topic, 'A quick and dirty guide to building your online reputation' and a short guide; '10 clever tips for promoting your research online' .
Alex: Are you planning to add any additional sources to Altmetric including TikTok and other social media? It looks like these channels are picking up in popularity.
Kathy Christian: We are continually evaluating where people are speaking about research in an effort to increase the diversity and coverage of our data; some attention sources are more challenging to track as they either do not link back to research or the platforms are closed. TikTok is a good example of an emerging source for research discussion that is also difficult to track. The technology required to detect mentions within a purely audiovisual space, such as TikTok, is still in its early stages, so collecting attention with a high enough level of confidence would be incredibly challenging. While YouTube is also an audiovisual space, in that case we're able to rely on the 'description' section and search for links back to research outputs.
Screenshot of Altmetric Top 100 - 2018-2020
To highlight the most popular research papers, every year Altmetric publishes the Top 100 lists. There is a blog post, press release, and a podcast accompanying the annual release. And if you want to analyze the trends by yourself, there is also an open ready-to-crunch dataset.
Unsurprisingly, 2020 list was dominated by the COVID-19 papers. But if you look deeper at the most popular papers, these are either the papers written by celebrities, or papers covering popular dinner-table topics such as diet, fake news, and climate change. The exciting biology and chemistry papers are generally lagging behind.
See more here:
Measuring Attention In Science And Technology - Forbes
- AlphaGo led Lee 4-1 in March 2016. One round Lee Se-dol won remains the last round in which a man be.. - - December 5th, 2024 [December 5th, 2024]
- Koreans picked Google Artificial Intelligence (AI) AlphaGo as an image that comes to mind when they .. - MK - - March 16th, 2024 [March 16th, 2024]
- DeepMind AI rivals the world's smartest high schoolers at geometry - Ars Technica - January 20th, 2024 [January 20th, 2024]
- Why top AI talent is leaving Google's DeepMind - Sifted - November 20th, 2023 [November 20th, 2023]
- Who Is Ilya Sutskever, Meet The Man Who Fired Sam Altman - Dataconomy - November 20th, 2023 [November 20th, 2023]
- Microsoft's LLM 'Everything Of Thought' Method Improves AI ... - AiThority - November 20th, 2023 [November 20th, 2023]
- Absolutely, here's an article on the impact of upcoming technology - Medium - November 20th, 2023 [November 20th, 2023]
- AI: Elon Musk and xAI | Formtek Blog - Formtek Blog - November 20th, 2023 [November 20th, 2023]
- Rise of the Machines Exploring the Fascinating Landscape of ... - TechiExpert.com - November 20th, 2023 [November 20th, 2023]
- What can the current EU AI approach do to overcome the challenges ... - Modern Diplomacy - November 20th, 2023 [November 20th, 2023]
- If I had to pick one AI tool... this would be it. - Exponential View - November 20th, 2023 [November 20th, 2023]
- For the first time, AI produces better weather predictions -- and it's ... - ZME Science - November 20th, 2023 [November 20th, 2023]
- Understanding the World of Artificial Intelligence: A Comprehensive ... - Medium - October 17th, 2023 [October 17th, 2023]
- On AI and the soul-stirring char siu rice - asianews.network - October 17th, 2023 [October 17th, 2023]
- Nvidias Text-to-3D AI Tool Debuts While Its Hardware Business Hits Regulatory Headwinds - Decrypt - October 17th, 2023 [October 17th, 2023]
- One step closer to the Matrix: AI defeats human champion in Street ... - TechRadar - October 17th, 2023 [October 17th, 2023]
- The Vanishing Frontier - The American Conservative - October 17th, 2023 [October 17th, 2023]
- Alphabet: The complete guide to Google's parent company - Android Police - October 17th, 2023 [October 17th, 2023]
- How AI and ML Can Drive Sustainable Revenue Growth by Waleed ... - Digital Journal - October 9th, 2023 [October 9th, 2023]
- The better the AI gets, the harder it is to ignore - BSA bureau - October 9th, 2023 [October 9th, 2023]
- What If the Robots Were Very Nice While They Took Over the World? - WIRED - September 27th, 2023 [September 27th, 2023]
- From Draughts to DeepMind (Scary Smart) | by Sud Alogu | Aug, 2023 - Medium - August 5th, 2023 [August 5th, 2023]
- The Future of Competitive Gaming: AI Game Playing AI - Fagen wasanni - August 5th, 2023 [August 5th, 2023]
- AI's Transformative Impact on Industries - Fagen wasanni - August 5th, 2023 [August 5th, 2023]
- Analyzing the impact of AI in anesthesiology - INDIAai - August 5th, 2023 [August 5th, 2023]
- Economic potential of generative AI - McKinsey - June 20th, 2023 [June 20th, 2023]
- The Intersection of Reinforcement Learning and Deep Learning - CityLife - June 20th, 2023 [June 20th, 2023]
- Chinese AI Giant SenseTime Unveils USD559 Robot That Can Play ... - Yicai Global - June 20th, 2023 [June 20th, 2023]
- Cyber attacks on AI a problem for the future - Verdict - June 20th, 2023 [June 20th, 2023]
- Taming AI to the benefit of humans - Asia News NetworkAsia News ... - asianews.network - May 20th, 2023 [May 20th, 2023]
- Evolutionary reinforcement learning promises further advances in ... - EurekAlert - May 20th, 2023 [May 20th, 2023]
- Commentary: AI's successes - and problems - stem from our own ... - CNA - May 20th, 2023 [May 20th, 2023]
- Machine anxiety: How to reduce confusion and fear about AI technology - Thaiger - May 20th, 2023 [May 20th, 2023]
- We need more than ChatGPT to have true AI. It is merely the first ingredient in a complex recipe - Freethink - May 20th, 2023 [May 20th, 2023]
- Taming AI to the benefit of humans - Opinion - Chinadaily.com.cn - China Daily - May 16th, 2023 [May 16th, 2023]
- To understand AI's problems look at the shortcuts taken to create it - EastMojo - May 16th, 2023 [May 16th, 2023]
- Terence Tao Leads White House's Generative AI Working Group ... - Pandaily - May 16th, 2023 [May 16th, 2023]
- Why we should be concerned about advanced AI - Epigram - May 16th, 2023 [May 16th, 2023]
- Purdue President Chiang to grads: Let Boilermakers lead in ... - Purdue University - May 16th, 2023 [May 16th, 2023]
- 12 shots at staying ahead of AI in the workplace - pharmaphorum - May 16th, 2023 [May 16th, 2023]
- Hypotheses and Visions for an Intelligent World - Huawei - May 16th, 2023 [May 16th, 2023]
- Cloud storage is the key to unlocking AI's full potential for businesses - TechRadar - May 16th, 2023 [May 16th, 2023]
- The Quantum Frontier: Disrupting AI and Igniting a Patent Race - Lexology - April 19th, 2023 [April 19th, 2023]
- Putin and Xi seek to weaponize Artificial Intelligence against America - FOX Bangor/ABC 7 News and Stories - April 19th, 2023 [April 19th, 2023]
- The Future of Generative Large Language Models and Potential ... - JD Supra - April 19th, 2023 [April 19th, 2023]
- A Chatbot Beat the SAT. What Now? - The Atlantic - March 23rd, 2023 [March 23rd, 2023]
- Exclusive: See the cover for Benjamn Labatut's new novel, The ... - Literary Hub - March 23rd, 2023 [March 23rd, 2023]
- These companies are creating ChatGPT alternatives - Tech Monitor - March 23rd, 2023 [March 23rd, 2023]
- Google's AlphaGo AI Beats Human Go Champion | PCMag - February 24th, 2023 [February 24th, 2023]
- AlphaGo: using machine learning to master the ancient game of Go - Google - February 10th, 2023 [February 10th, 2023]
- AI Behind AlphaGo: Machine Learning and Neural Network - February 10th, 2023 [February 10th, 2023]
- Google AlphaGo: How a recreational program will change the world - February 10th, 2023 [February 10th, 2023]
- Computer Go - Wikipedia - November 22nd, 2022 [November 22nd, 2022]
- AvataGo's Metaverse AR Environment will be Your Eternal Friend - Digital Journal - September 17th, 2022 [September 17th, 2022]
- This AI-Generated Artwork Won 1st Place At Fine Arts Contest And Enraged Artists - Bored Panda - September 3rd, 2022 [September 3rd, 2022]
- The best performing from AI in blockchain games, a new DRL model published by rct AI based on training AI in Axie Infinity, AI surpasses the real... - September 3rd, 2022 [September 3rd, 2022]
- Three Methods Researchers Use To Understand AI Decisions - RTInsights - August 20th, 2022 [August 20th, 2022]
- What is my chatbot thinking? Nothing. Here's why the Google sentient bot debate is flawed - Diginomica - August 7th, 2022 [August 7th, 2022]
- Opinion: Can AI be creative? - Los Angeles Times - August 2nd, 2022 [August 2nd, 2022]
- AI predicts the structure of all known proteins and opens a new universe for science - EL PAS USA - August 2nd, 2022 [August 2nd, 2022]
- What is Ethereum Gray Glacier? Should you be worried? - Cryptopolitan - June 24th, 2022 [June 24th, 2022]
- How AI and human intelligence will beat cancer - VentureBeat - June 19th, 2022 [June 19th, 2022]
- Race-by-race tips and preview for Newcastle on Monday - Sydney Morning Herald - June 19th, 2022 [June 19th, 2022]
- A gentle introduction to model-free and model-based reinforcement learning - TechTalks - June 13th, 2022 [June 13th, 2022]
- The role of 'God' in the 'Matrix' - Analytics India Magazine - June 3rd, 2022 [June 3rd, 2022]
- The Powerful New AI Hardware of the Future - CDOTrends - June 3rd, 2022 [June 3rd, 2022]
- The 50 Best Documentaries of All Time 24/7 Wall St. - 24/7 Wall St. - June 3rd, 2022 [June 3rd, 2022]
- How Could AI be used in the Online Casino Industry - Rebellion Research - April 12th, 2022 [April 12th, 2022]
- 5 Times Artificial Intelligence Have Busted World Champions - Analytics Insight - April 2nd, 2022 [April 2nd, 2022]
- The Guardian view on bridging human and machine learning: its all in the game - The Guardian - April 2nd, 2022 [April 2nd, 2022]
- How to Strengthen America's Artificial Intelligence Innovation - The National Interest - April 2nd, 2022 [April 2nd, 2022]
- Why it's time to address the ethical dilemmas of artificial intelligence - Economic Times - April 2nd, 2022 [April 2nd, 2022]
- About - Deepmind - March 18th, 2022 [March 18th, 2022]
- Experts believe a neuro-symbolic approach to be the next big thing in AI. Does it live up to the claims? - Analytics India Magazine - March 18th, 2022 [March 18th, 2022]
- The Discontents Of Artificial Intelligence In 2022 - Inventiva - March 16th, 2022 [March 16th, 2022]
- Is AI the Future of Sports? - Built In - March 5th, 2022 [March 5th, 2022]
- This is the reason Demis Hassabis started DeepMind - MIT Technology Review - February 28th, 2022 [February 28th, 2022]
- Sony's AI system outraces some of the world's best e-sports drivers | The Asahi Shimbun: Breaking News, Japan News and Analysis - Asahi Shimbun - February 28th, 2022 [February 28th, 2022]
- SysMoore: The Next 10 Years, The Next 1,000X In Performance - The Next Platform - February 28th, 2022 [February 28th, 2022]
- The World's Shortest List Of Technologies To Watch In 2022 - Forbes - February 3rd, 2022 [February 3rd, 2022]