Research users impacted as evaluators

Individuals or their representatives directly impacted by the research activities can be involved as reviewers, as one specific category of stakeholders. Depending on the group represented, their role in the research assessment process and their requirements in terms of communication have to be carefully considered in the process design.
Level 0
Challenge - Inclusivity
Challenge - Bias Mitigation
Challenge - Process Culture
Challenge - Diversity
Challenge - Different Questions
CoARA Commitment 1
CoARA Commitment 2
CoARA Commitment 6
User - Funder
User - Academies
Contributor

Experiments in Assessment WG

Last updated

March 10, 2026

WarningObjectives and potential outcome

Research domains

Context and considerations

Challenges and mitigations

Challenge: Jargon from the proposal may limit contributions Mitigation: Ensure researchers know the composition of the panel and support them in making efficient communication (RI could be used as a case on this)

Challenge: Will evaluate impact, but possibly not the quality of the scientific method Mitigation: assign different elements of the assessment to different assessors so they feel confident in those elements (but this can create different levels of scoring needed)

Evaluating success

Relevant resources and literature

This section includes resources, literature, and reports relevant to this specific experimental idea.

Templates from funders and institutions

Case examples and literature

Other resources

Comments/lived examples