Annual report on competitions

Enriching the merit review process

As part of SSHRC’s commitment to continuous improvement, we analyze data on merit review results, as well as feedback from our staff, merit reviewers and observers, in an annual report on competitions.

All findings in the report are reviewed at the program level and by governance committees, helping us build on successes and make informed changes to improve our programs. The report represents our dedication to transparency and facilitates positive change to address challenges in the merit review process.

Merit reviewers have shared their thoughts on their experience working with us. Here is what some of them had to say:

“SSHRC program officers did an excellent job of intervening and providing clear guidance when questions about relevant and non-relevant criteria for reviewing applications arose during adjudication meetings.”

Committee member, Doctoral Awards

“I generally love the way that scores are managed. I like that scores are calibrated so that they are more likely to be consistent with the evaluations of other committee members. At the same time, we can see our original scores, and change either our scores or overall scores. I like how discrepancies are flagged so that we can see where there may be issues worth discussing. The score document used during the evaluation meetings is full of useful information. At the same time, it is a flexible, living document that is easily changed to reflect the evaluation committee's discussions.”

Committee member, Partnership Development Grants

“The identification of a range of reviewers working in different sectors and roles in relation to GBV [gender-based violence] was a strength of the adjudication committee. These diverse perspectives helped us to fairly adjudicate the applications.”

Committee member, Knowledge Synthesis Grants

We are grateful to the many experts who contributed to the merit review process, giving their time and sharing valuable insights into their experience.

For details, visit Open Government to read the 2022-23 report on competitions.

Highlights from the 2022-23 report

Our support to merit review committees

Overall views of committee member survey respondents (number=418):

97%

rated the support from SSHRC staff as good (12%) or excellent (85%)

90%

were satisfied (43%) or very satisfied (47%) with the quality of SSHRC's merit review process

Aggregated survey respondent views on SSHRC evaluation processes:

85%

rated the evaluation criteria and subcriteria as extremely useful (34%) or very useful (51%)

62%

rated the various SSHRC guidelines for evaluation as extremely useful (21%) or very useful (41%)

78%

rated the evaluation tools SSHRC provides as extremely useful (32%) or very useful (46%), overall

Who were our committee members in 2022-23?

In 2022-23:

  • Number of competitions: 22
  • Number of committees: 106
  • Number of committee members: 938
  • Average ageFootnote 249
  • Average number of years servedFootnote 3:
    • One: 58%
    • Two: 24%
    • Three: 12%
    • Four: 5%
  • Average acceptace rate: 38%
  • Average rate of returning membersFootnote 432%
  • Number of committee members who withdrew from the process: 69

Self identificationFootnote 5:

  • 51% Women
  • 42% Men
  • - OtherFootnote 6
  • 4% Indigenous identity
  • 9% Persons with disabilities
  • 17% Visible minorities
  • 4% Prefer not to answer (on average to designated-group questions)

Language profileFootnote 7:

  • English: 75%
  • French: 25%

Sectoral representation:

  • 98% Postsecondary
  • < 1% Industry
  • 1% Not-for-profit
  • 1% Public

Institutional representationFootnote 8:

  • 44% Large
  • 28% Medium
  • 18% Small
  • 1% College
  • 4% International
  • 5% Other

Institutional positions:

  • 36% Associate professor
  • 27% Full professor
  • 24% Assistant professor
  • 12% Other
  • 1% Adjunct professor
Figure 1
Description of figure 1

Committee member disciplines

This ring graph shows the disciplines of committee members in 2022-23. The percentages are calculated based on member participation and the number of participants who identified these subject areas as one of their main disciplines. Individuals participating on more than one committee during the year were counted each time they participated. Sixty-eight percent of committee members were from the social sciences, 26% were from the humanities, 5% identified their disciplines as interdisciplinary, and 1% were from other disciplines.

Committee workload

Demanding volunteer workloads is a key challenge that we monitor and try to reduce in competition processes. Over the last four years, the average number of applications assigned to committee members for review has decreased for most competitions.

58% of survey respondents in 2022-23 (n=418) cited “workload” as a reason that would deter them from serving again, compared to 59% in 2021-22 (n=475).

Number of applications assigned to SSHRC committee members for review (2018-2023)

Figure 2
Description of figure 2

Research Training and Talent Development

This line graph shows the number of applications assigned to SSHRC committee members for review over the past five years (2018-19 to 2022-23). For the Research Training and Talent Development program, the number has trended downwards for each funding opportunity, except for the Impact Awards. Over this period, applications reviewed per committee member for the SSHRC Postdoctoral Fellowships decreased from about 32 to approximately 20. For SSHRC Doctoral Fellowships, the number decreased from about 53 to just under 38. For the Impact Awards, the number went from about 14 to less than 18.

Figure 3
Description of figure 3

Insight Research

This line graph shows the number of applications assigned to SSHRC committee members for review over the past five years (2018-19 to 2022-23). Workload levels have trended downwards for both Insight Research funding opportunities. The number of applications per committee member for Insight Grants has decreased from about 16 to just under 12 over the past five years; and for Insight Development Grants, the number has decreased from 20 to approximately 16.

Figure 4
Description of figure 4

Research Partnerships

This line graph shows the number of applications assigned to SSHRC committee members for review within SSHRC programming areas over the past five years (2018-19 to 2022-23). Within the Research Partnerships program, the number of applications per committee member has trended downwards for each funding opportunity (except Partnership Engage Grants). The number of applications per committee member has decreased for Partnership Grants from 16 to 15; for Partnership Development Grants from about 22 to approximately 16; and for Connection Grants from about 16 to approximately 9. For Partnership Engage Grants, it rose from about 10 to just under 12.

Figure 5
Description of figure 5

Future Challenges Directorate

This line graph shows the number of applications assigned to SSHRC committee members for review within the Future Challenges Division over the past four years (2019-20 to 2022-23). The number of applications assigned has slightly decreased for Knowledge Synthesis Grants (multiple competitions combined), from about 16 to approximately 13. The 2018-19 KSG competition (Canada-United Kingdom trade relationships) is not represented in this graph, as it was a pilot and average workload was very low (5.3 applications assigned per member).

Correspondence language of committee members, overall

  • English: 75%
  • French: 25%
Description of figure 7

Correspondence language of committee members, overall

This pie graph shows the correspondence language of committee members for the 2022-23 application adjudication year. The pie graph shows that, overall, 25% of committee members’ language of correspondence was French and 75% was English.

Application language of applicants, overall

  • English: 83%
  • French: 17%
Description of figure 6

Application language of applicants, overall

This pie graph shows the application language of applicants for the 2022-23 application adjudication year. The pie graph shows that, overall, 17% of applications were submitted in French and 83% were submitted in English.

Application rates by application language

  • English: 82.8%
  • French: 17.2%

Award rates by application language

  • English: 80.5%
  • French: 19.5%
Date modified: