Tracking and Measuring the Impact of Your Research

You’ve invested immense time and effort into planning, conducting, and disseminating your research. But how do you know if your hard work is truly making a difference and reaching the right audiences? 

Tracking and measuring the impact of your research is crucial at this stage. It validates not only the significance and effectiveness of your work but also its meaningful contributions to both academic progress and societal well-being. 

In this guide, we'll walk you through setting clear goals, choosing the right metrics, utilizing powerful tools, and applying robust communications to maximize impact. Let’s explore some strategies for successfully tracking and measuring the impact of your research. 

Why is measuring research impact important? 

Measuring research impact is essential for several reasons that include academic, societal, and practical dimensions. Here are some key points highlighting its importance: 

• Recognition and Reputation- Quantifying the impact of your research makes its contributions easier to recognize. High-impact research often leads to greater academic prestige and can enhance your reputation. 

• Funding and Resources- Demonstrating the impact of your research is usually a requirement for securing funding. Grant agencies and investors look for evidence that research will lead to significant advancements or applications. 

• Career Progression- Showing that your work has been impactful can be critical for career advancement, including promotions, tenure, and competitive positions. 

• Policy Making- Impact measurements can inform policymakers about the effectiveness and relevance of your research, leading to evidence-based decisions that benefit society. 

• Public Awareness and Engagement- Highlighting the impact of your research can increase the public’s understanding and appreciation of science, which can foster greater engagement and support. 

• Innovation and Development- Measuring the impact of your research can accelerate the translation of scientific findings into practical applications, technologies, and products. 

• Problem Solving- High-impact research regularly addresses pressing global challenges, such as climate change, health issues, and social inequalities. Measuring your impact ensures that these valuable insights are recognized and implemented. 

• Resource Allocation- Institutions can use your impact measurements to allocate resources more effectively, prioritizing certain research areas and improving overall research quality. 

• Benchmarking and Assessment- Impact metrics provide benchmarks for evaluating your research performance. This helps institutions identify strengths and areas for improvement. 

• Building Partnerships- Demonstrating your research impact can attract the collaborators from academia, industry, and government necessary for building interdisciplinary and cross-sector partnerships. 
•  
• Knowledge Sharing- Measuring impact encourages the dissemination of your research findings that will promote knowledge sharing and increase scientific progress. 
  
  

  Measuring research impact is more than a bureaucratic requirement. It is also a powerful way to gain academic recognition, shape policy, and create positive societal change.  

  By understanding and clearly demonstrating the wide-reaching effects of your work, you boost its value. This approach opens doors to new opportunities that can advance both your career and the field. 

  Defining your impact goals 

  It’s essential to define your impact goals at the outset of your research project. They will guide the work by helping you stay focused on the outcomes you want to achieve. 

  You may even be required to create an “impact summary” or a “pathways to impact” section for a grant application. This is where clearly defined impact goals become especially important. 

  They are not rigid constraints, however, but rather flexible guides that drive your research toward tangible outcomes. These impact goals are dynamic and will evolve as new information and circumstances emerge. 

  To them to be effective, your impact goals should follow the SMART criteria, defined as Specific, Measurable, Achievable, Relevant, and Time-bound. Here’s what an impact goal that uses this method might look like: 

  
  

  Overall Goal	Reducing the carbon footprint in urban areas
  Specific	Reduce the carbon footprint of urban households in City X by promoting the adoption of energy-efficient appliances.
  Measurable	Achieve a 15% reduction in carbon emissions per household by the end of the 3-year study.
  Achievable	Partner with local government and energy companies to provide subsidies and incentives for energy-efficient appliances.
  Relevant	Contribute to City X’s goal of reducing overall carbon emissions by 25% by 2030.
  Time-bound	Complete the project and achieve the reduction within 3 years.

While some details may need to be adjusted as the project progresses, the explicit nature of SMART goals keeps both you and the stakeholders grounded in realistic expectations. When developing these clear goals, you need to take some questions into consideration:  

1. Who will benefit? 
a. Consider the communities, organizations, or fields that will gain from your research findings. Think about how your work will make a concrete difference to them. 
2. How will I know if we’ve succeeded? 
a. Establish clear metrics for success. Decide early on how you will measure these outcomes. 
3. Is there a definitive alignment?
a. Make sure that your impact goals align with the overall research question, purpose, and scope. They should also reflect the needs and expectations of all stakeholders. 
4. What are the potential consequences?
a. Consider the possible positive and negative consequences of your research, and think about how you will mitigate these. A thorough risk assessment is critical for achieving the desired impact of your research. 

Defining your impact goals from the beginning of a project is essential for maximizing the positive outcomes of your research. It allows you to clearly identify target audiences, meet stakeholder needs, and establish measurable criteria for evaluating success. 

Using frameworks when planning research impact 

Implementing a framework for defining and evaluating your impact goals provides the structure and transparency needed for success. It offers guidance in distinguishing outcomes from impacts and mapping the pathways to achieve both. 

Examples:

1. Research Impact Pathway- Connects the resources you invest (inputs) and the work you do (activities) to the tangible outputs and long-term impacts that your research achieves. To effectively plan your pathway to impact, start by defining clear impact goals at the outset of your project. 

2. Becker Medical Library Model for Assessment of Research Impact- Organizes impact into five key domains: Advancement of Knowledge, Clinical Implementation, Community Benefit, Legislation and Policy, and Economic Benefit. This model also provides tools for capturing evidence of impact, making it easier for you to articulate the significance of your work beyond traditional academic metrics. 

3. Payback Framework- Evaluates impact through Categories of Benefits and Stages of Research Process. The categories of benefits include knowledge production, capacity building, informing policy, health benefits, and broader economic and societal impacts. The stages of the research process guide how these benefits are achieved, from project initiation to dissemination and implementation. 

4. Social Impact Assessment- Involves identifying and analyzing the potential effects on communities, including changes in quality of life, cultural practices, economic conditions, and social structures. By assessing social impacts, you can design interventions that maximize positive outcomes. 

Choosing appropriate indicators and metrics 

There are various methods to measure the impact of your research, each with its own strengths and weaknesses. Balancing quantitative, qualitative, and alternative approaches is important for achieving a comprehensive and accurate understanding of your research's impact. 

Quantitative 

Quantitative metrics provide a clear, objective way to assess the impact of your research, offering valuable insights into performance and progress over time. These metrics allow for tracking and comparison of your work against the benchmarks established in the impact summary.  

Quantitative methods are essential for evaluating the effectiveness of strategies, determining the return on investment, and refining future initiatives. While a valuable part of assessing the impact of your research, they must be used responsibly. 

Keep these benefits and limitations in mind when implementing quantitative measures: 

Common examples and types of quantitative metrics 

1. Citation Count- The total number of times your publications are cited by other researchers. This is one of the most straightforward measures of impact. 
2. h-Index- A metric that attempts to measure both the productivity and citation impact of your publications. You have an h-index of n if n of your papers have been cited at least n times. 
3. Journal Impact Factor (JIF)- The average number of citations received in a particular year by papers published in a specific journal during the two preceding years. Used to gauge the relative importance of a journal within its field. 
4. i10-Index- The number of your publications that have received at least 10 citations. It is used primarily in Google Scholar profiles. 
5. Citation Impact- Measures the average number of citations per paper published by a researcher, institution, or journal. It provides an indication of the overall influence of your work. 
6. Relative Citation Ratio (RCR)- A metric that measures the citation rate of a paper relative to the average citation rate in its field. It provides a normalized measure of your impact. 
7. Field-Weighted Citation Impact (FWCI)- This metric compares the number of citations received by a publication to the average number of citations received by all similar publications in the same field. An FWCI of 1.0 indicates average performance, while above 1.0 indicates above-average impact. 
8. Eigenfactor Score- A metric that measures the influence of a journal in the network of academic citations. Unlike the JIF, it considers the source of the citations, giving more weight to citations from highly ranked journals. 
9. Citations per Publication- The average number of citations received per published article, often used to evaluate the impact of individual researchers or institutions. 
10. g-Index- A variant of the h-index, which gives more weight to highly cited articles. It is designed to improve on the h-index by considering the citation distribution of your publications. 

These metrics are commonly used in research evaluation to assess the impact and influence of a researcher's work, a journal's significance, or an institution's output within the academic community. Remember, though, that each metric has its own context, limitations, and potential for misuse. 

Qualitative 

Qualitative methods offer a more nuanced understanding of research impact by capturing aspects that quantitative data might miss. While numbers can track citations or publication counts, qualitative measures delve into the underlying significance and context of research contributions.  

These metrics allow for a deeper exploration of factors such as the influence on policy, the quality of collaboration, and the real-world application of findings. By integrating qualitative metrics into evaluation processes, you can better understand the broader implications of your work.  

While this approach ensures that the full spectrum of a research project's impact is recognized, it also has advantages and disadvantages: 

Common examples and types of qualitative metrics 

1. Peer Review Assessments- Evaluations of your research’s quality, significance, and originality provided by expert reviewers. It is often used in the context of grant applications, journal submissions, or tenure decisions. 
2. Narrative Impact Statements- Descriptions provided by you or your institution that explain the significance and influence of your work by highlighting contributions to society, policy, or specific communities. 
3. Case Studies- In-depth explorations of how your specific research has been applied in real-world situations, such as influencing public policy, changing clinical practices, or improving educational outcomes. 
4. Interviews and Focus Groups- Data collected through conversations with stakeholders to understand the broader impact and relevance of your research. 
5. Expert Opinion and Testimonies- Insights provided by recognized leaders or authorities in a particular field who can speak to the significance and implications of your research. 
6. Policy Influence and Contributions- Evidence of how your research has informed or shaped public policy, including citations in policy documents, participation in advisory panels, or direct consultation with government bodies. 
7. Awards and Recognitions- Honors received by you or your institution for your work. This can indicate how the value and impact of your contributions is perceived by peers and organizations. 
8. Collaborative and Interdisciplinary Impact- Evaluations of how your research fosters collaboration across disciplines or between academia and industry that lead to innovative solutions or new areas of study. 
9. Educational and Training Contributions- The role of your research in shaping educational programs, curricula, or training materials, demonstrating its influence on the next generation of scholars and professionals. 
10. Community and Societal Impact- Assessment of how your research contributes to community development, social justice, or societal well-being. 

These qualitative metrics provide a rich, contextualized understanding of your research impact. They complement the quantitative measures by capturing the broader influence and application of your work. 

Alternative 

Alternative metrics, or altmetrics, offer a modern approach to measuring research impact by capturing the digital footprint of your scholarly work. Unlike traditional metrics that focus on citations and journal impact, altmetrics assess how your research is discussed, shared, and engaged with across digital platforms.  

By illuminating how your work resonates with broader audiences, these altmetrics broaden the scope of your impact measurements beyond the academic realm. They can reveal immediate engagement with your research outputs, offering a valuable complement or alternative to conventional quantitative and qualitative methods. 

Like traditional methods, altmetrics are powerful tools for impact measurement that should be approached with an awareness of its strengths as well as potential pitfalls: 

Common examples and types of alternative metrics 

1. Social Media Mentions- The number of times your research article or findings are mentioned or shared on social media platforms like Twitter, Facebook, LinkedIn, and others. This reflects the reach and engagement of the research within online communities. 
2. Blog Posts- Mentions or discussions of your research in blog posts illustrates how it is being interpreted and shared in less formal, but widely read, contexts. 
3. News Media Coverage- The extent to which your research is covered in news outlets, including newspapers, online news sites, TV, and radio. This highlights your research’s relevance to current events and its public visibility. 
4. Downloads and Views- The number of times your research paper, dataset, or other output is downloaded or viewed online shows the interest in your research and the topic in general. 
5. Mendeley Readers- The number of times your research paper is saved or read in Mendeley, a reference manager and academic social network. This can indicate the level of interest and potential future citation. 
6. Patent Citations- The number of times research is cited in patents, suggesting its influence on technological innovation and commercial applications. 
7. Wikipedia Citations- The number of times your research is cited in Wikipedia articles reflects its influence on public knowledge and educational resources. 
8. YouTube and Video Mentions- Engagement with your research in video formats, including mentions in YouTube videos, webinars, or video abstracts implies that it is reaching a wide audience. 
9. Public Comments and Reviews- Feedback and discussions from platforms like PubPeer, where researchers and the public can comment on and review your research shows its relevance in adding to the conversation. 
10. Open Access Mentions- Tracking mentions and downloads from open access platforms and repositories like arXiv, SSRN, or institutional repositories can highlight the accessibility of your research. 

Altmetrics provide a broader and often more immediate picture of your research’s impact. They capture how your research resonates with a wider audience beyond academia and how it contributes to public discourse, education, and innovation. 

By incorporating quantitative, qualitative, and alternative methods, you will gain the most comprehensive understanding of the impact of your research. 

Tools for tracking and measuring impact 

As you can see, tracking and measuring research impact is essential for demonstrating the value of your work, guiding strategic decisions, and securing funding. There are clearly many variables, though, so how can you simplify the process and make it more efficient? 

You can easily track and showcase the impact of your research on multiple levels, author impact, journal impact, article impact, and researcher impact . Try using online platforms and tools like these:  

• Google Scholar- A free service that offers citation monitoring, h-index and i10 index calculations, and profile creation for alerts and tracking over time. 

• Scopus Preview- This free version allows access to CiteScore, a metric used to measure the citation impact of peer-reviewed research published in serial titles like journals. 

• Scopus- The paid subscription comes with advanced analytics for citation analysis, h-index calculation, and journal metrics. It will also automatically generate your full author profile and give you insights into collaboration. 

• Web of Science- A paid subscription through an institution provides robust citation reports, h-index calculation, and journal citation reports. It further creates a complete author record and collaboration analysis. 

• Dimensions- This paid platform offers full-service impact tracking that includes citation metrics, altmetric integration, funding analysis, networking insights, and research influence. Goes beyond publications to track datasets, grants, patents, policy documents, and clinical trials as well. 

• Plum Analytics- A paid subscription service that aggregates diverse impact measures like citation counts, altmetrics, usage metrics, captures, mentions, and social media.  

• Semantic Scholar- This free service provides citation counts, influence metrics, citation graphs, author profiles, and paper summaries. It also allows programmatic access to its data and features through Semantic Scholar API. 

• CrossRef- The paid subscription grants access to the DOI system, citation linking, event data, metadata, and references. DOI lookup and some citation information is available for free to the public. 

• Scholarometer- A free tool, accessible via web-based platforms, that analyzes citation metrics through individual paper counts, h-index calculation, author impact metrics, and visualization tools. 

• Publish or perish- This free tool provides comprehensive citation and impact analysis using available online data sources. It converts this information into detailed citation counts, trend analysis, customized reports, and h-index, g-index, and i10 index calculation. 

• ORCID- A free service that creates a unique identifier for researchers, helping with publication tracking, collaborative network building, and profile management.  

• ResearchGate- This free platform offers tracking and measuring through citation counts, ResearchGate score, full-text access and metrics, author metrics, and collaboration patterns. 

• Altmetric- A paid service capturing non-traditional metrics and converting them into an Altmetric score, attention breakdown, engagement metrics, Altmetric badges, and geographic and demographic awareness. 

• Impactstory- A free service for tracking various online and social metrics and then transforming them into an altmetric dashboard, engagement metrics, impact profiles, and visualizations. 

While many platforms offer a range of services, no single tool can capture all aspects of research impact. To build a complete impact story, it is essential to use complementary platforms. 

Let’s look at the strengths of some popular tools and platforms: 

By using a diverse range of tools for impact tracking and measurement, you can better understand the broader influence of your research and effectively communicate its significance through data. Documenting these benefits underscores the relevance and value of your work. 

Communicating your impact story 

Communicating your research impact involves more than just presenting numbers and data. It requires telling a compelling story that highlights the real-world significance of your work.  

While statistics provide essential evidence, incorporating personal narratives paints a more engaging and meaningful picture of your research. Thoughtful storytelling brings your research to life, making it relatable and memorable for diverse audiences.  

A well-crafted, credible impact story allows you to demonstrate the true value of your research to stakeholders and target audiences. Here are some key  tips to consider when telling the story of your research impact: 

Formats and channels for communicating your impact story 

To effectively communicate the impact of your research, it's important to choose the right formats and channels that will resonate with your target audience. Different formats offer unique ways to tell your impact story, making sure that your message is not only accessible but also memorable and compelling.  

Here are some of the most popular formats and channels you can use to share the impact of your research: 

1. Case Studies- Highlight real-world applications, challenges overcome, and measurable outcomes. They are particularly useful for stakeholders who want specific, in-depth evidence of your research’s value. 
2. Impact Summaries- Offer a concise overview of the key impacts of your research. These are optimal for readers who need a quick yet informative snapshot of your achievements and contributions. 
3. Infographics- Use visual elements to represent impact data and key messages. They can simplify complex information, making it easier to understand and more visually appealing. 
4. Videos- Short, engaging clips that illustrate your impact story through visuals, interviews, and testimonials. Videos can be highly effective for capturing attention and conveying emotion. 
5. Blogs- Share your impact story in a narrative form, incorporating anecdotes, reflections, and personal experiences. Blogs allow for a more informal and conversational tone that is ideal for reaching broader audiences.. 
6. Social Media Posts- Use platforms like Twitter, LinkedIn, and Facebook to share highlights of your impact story, linking to more detailed content. These posts can quickly reach a large audience and encourage engagement. 
7. Podcasts- Feature your impact story in a podcast episode, either as an interview or a discussion. Podcasts reach a wide audience that is interested in in-depth conversations about research and its broader implications. 
8. Webinars and Workshops: Present your impact story to a live audience. These formats allow for interactive discussions, Q&A sessions, and networking. 

Choosing the right format and channel depends on your target audience and the nature of your research impact. By combining different methods, you can more effectively communicate your impact story and ensure it reaches and resonates with a diverse array of stakeholders. 

Seeking feedback and improvement 

Tracking and measuring research impact is not a one-time effort but rather a continuous process that evolves over time. Regularly seeking feedback and making improvements is key to keeping your research impact relevant, meaningful, and in line with changing goals.  

Here are some tips to consider when refining your impact tracking efforts: 

Insights: 

• Engage with feedback- These stakeholders can provide valuable perspectives on how your research is perceived and its impact. Constructive feedback helps identify gaps, areas for improvement, and new opportunities for improving your impact narrative. 

• Monitor and update regularly- By updating your impact narratives often, your research stays fresh and current. It will help avoid missing opportunities for recognition or collaboration. 

• Adapt to changing contexts- As the needs and expectations of stakeholders change, your approach to communicating research impact may need to be adjusted. Staying flexible and responsive to these shifts allows you to keep your impact strategies up-to-date and effective. 

• Celebrate achievements- Acknowledging progress not only boosts morale but also reinforces the value of your research efforts to your team and stakeholders. Neglecting smaller achievements can demotivate your team and overlook valuable progress. 

• Share achievements with your network- Sharing stories of success can inspire others, foster collaborations, and amplify the reach of your research. Not sharing these stories can limit the potential benefits and recognition your research could receive. 

Tracking and communicating research impact successfully demands a continuous, adaptive approach. By actively seeking and responding to feedback, you can keep your impact data relevant, visible, and meaningful. 

Final thoughts 

As you complete your research, remember that tracking and measuring its impact is more than just a final step. It's about capturing both concrete metrics and qualitative insights that demonstrate the true reach and significance of your work.  

Be intentional when setting your research goals, and select the right tools and frameworks to effectively measure progress. Then, use that data to craft a compelling impact story that drives real-world change and informs key decisions. 

Throughout the process, refer to this guide for the assistance and strategies that will maximize your impact. Whether you need help defining metrics, selecting tools, or communicating your findings, this resource will support you every step of the way.  

Your work has the power to shape the future. Stay committed, be bold, and allow your research to make the impact it was meant to have. The world is waiting — make sure it hears you.