Review, Promotion, and Tenure Project

How can research institutions incentivize openness and accessibility? 

visual overview of review, promotion, and tenure project

One of the key components of workplace advancement at the university level are the review, promotion, and tenure (RPT) packets that are typically submitted every other year by early career faculty. The importance of RPT guidelines and forms makes them a natural place to effect change towards an opening of access to research (something both Canada and the US have been pushing for through federal policies and laws). This project examined the RPT process in the US and Canada in ways that can directly inform actions likely to translate into behavioural change and to a greater opening of research.

To do so, we collected and analyzed more than 850 RPT guidelines from research institutions across Canada and the US and assessed the degree to which they included guidelines specific to open access, open data, and open education. We also explored the use of the Journal Impact Factor in these documents, analyzing how often the controversial was mentioned and how it was defined. Finally, we investigated faculty members’ perceptions about the RPT process, including what publishing strategies they believe will be rewarded and how this influences their dissemination choices.

To find out more about the RPT project, visit the ScholCommLab’s media page, read about it on our blog, or check out one of the publications below.

Click here for a visual overview of the review, promotion, and tenure project.

Related Publications

1298012 RPT 1 apa 50 date 1 50 https://www.scholcommlab.ca/wp-content/plugins/zotpress/
%7B%22status%22%3A%22success%22%2C%22updateneeded%22%3Afalse%2C%22instance%22%3Afalse%2C%22meta%22%3A%7B%22request_last%22%3A0%2C%22request_next%22%3A0%2C%22used_cache%22%3Atrue%7D%2C%22data%22%3A%5B%7B%22key%22%3A%22Q8YBFUI2%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Dawson%20et%20al.%22%2C%22parsedDate%22%3A%222022-04-06%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BDawson%2C%20D.%20%28DeDe%29%2C%20Morales%2C%20E.%2C%20McKiernan%2C%20E.%20C.%2C%20Schimanski%2C%20L.%20A.%2C%20Niles%2C%20M.%20T.%2C%20%26amp%3B%20Alperin%2C%20J.%20P.%20%282022%29.%20The%20role%20of%20collegiality%20in%20academic%20review%2C%20promotion%2C%20and%20tenure.%20%26lt%3Bi%26gt%3BPLOS%20ONE%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B17%26lt%3B%5C%2Fi%26gt%3B%284%29%2C%20e0265506.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0265506%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0265506%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22The%20role%20of%20collegiality%20in%20academic%20review%2C%20promotion%2C%20and%20tenure%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Diane%20%28DeDe%29%22%2C%22lastName%22%3A%22Dawson%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Esteban%22%2C%22lastName%22%3A%22Morales%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Erin%20C.%22%2C%22lastName%22%3A%22McKiernan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%20A.%22%2C%22lastName%22%3A%22Schimanski%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meredith%20T.%22%2C%22lastName%22%3A%22Niles%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20Pablo%22%2C%22lastName%22%3A%22Alperin%22%7D%5D%2C%22abstractNote%22%3A%22Review%2C%20promotion%2C%20and%20tenure%20%28RPT%29%20processes%20at%20universities%20typically%20assess%20candidates%20along%20three%20dimensions%3A%20research%2C%20teaching%2C%20and%20service.%20In%20recent%20years%2C%20some%20have%20argued%20for%20the%20inclusion%20of%20a%20controversial%20fourth%20criterion%3A%20collegiality.%20While%20collegiality%20plays%20a%20role%20in%20the%20morale%20and%20effectiveness%20of%20academic%20departments%2C%20it%20is%20amorphic%20and%20difficult%20to%20assess%2C%20and%20could%20be%20misused%20to%20stifle%20dissent%20or%20enforce%20homogeneity.%20Despite%20this%2C%20some%20institutions%20have%20opted%20to%20include%20this%20additional%20element%20in%20their%20RPT%20documents%20and%20processes%2C%20but%20it%20is%20unknown%20the%20extent%20of%20this%20practice%20and%20how%20it%20varies%20across%20institution%20type%20and%20disciplinary%20units.%20This%20study%20is%20based%20on%20two%20sets%20of%20data%3A%20survey%20data%20collected%20as%20part%20of%20a%20project%20that%20explored%20the%20publishing%20decisions%20of%20faculty%20and%20how%20these%20related%20to%20perceived%20importance%20in%20RPT%20processes%2C%20and%20864%20RPT%20documents%20collected%20from%20129%20universities%20from%20the%20United%20States%20and%20Canada.%20We%20analysed%20these%20RPT%20documents%20to%20determine%20the%20degree%20to%20which%20collegiality%20and%20related%20terms%20are%20mentioned%2C%20if%20they%20are%20defined%2C%20and%20if%20and%20how%20they%20may%20be%20assessed%20during%20the%20RPT%20process.%20Results%20show%20that%20when%20collegiality%20and%20related%20terms%20appear%20in%20these%20documents%20they%20are%20most%20often%20just%20briefly%20mentioned.%20It%20is%20less%20common%20for%20collegiality%20and%20related%20terms%20to%20be%20defined%20or%20assessed%20in%20RPT%20documents.%20Although%20the%20terms%20are%20mentioned%20across%20all%20types%20of%20institutions%2C%20there%20is%20a%20statistically%20significant%20difference%20in%20how%20prevalent%20they%20are%20at%20each.%20Collegiality%20is%20more%20commonly%20mentioned%20in%20the%20documents%20of%20doctoral%20research-focused%20universities%20%2860%25%29%2C%20than%20of%20master%5Cu2019s%20universities%20and%20colleges%20%2831%25%29%20or%20baccalaureate%20colleges%20%2815%25%29.%20Results%20from%20the%20accompanying%20survey%20of%20faculty%20also%20support%20this%20finding%3A%20individuals%20from%20R-Types%20were%20more%20likely%20to%20perceive%20collegiality%20to%20be%20a%20factor%20in%20their%20RPT%20processes.%20We%20conclude%20that%20collegiality%20likely%20plays%20an%20important%20role%20in%20RPT%20processes%2C%20whether%20it%20is%20explicitly%20acknowledged%20in%20policies%20and%20guidelines%20or%20not%2C%20and%20point%20to%20several%20strategies%20in%20how%20it%20might%20be%20best%20incorporated%20in%20the%20assessment%20of%20academic%20careers.%22%2C%22date%22%3A%222022-04-06%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1371%5C%2Fjournal.pone.0265506%22%2C%22ISSN%22%3A%221932-6203%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fjournals.plos.org%5C%2Fplosone%5C%2Farticle%3Fid%3D10.1371%5C%2Fjournal.pone.0265506%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222022-04-06T23%3A14%3A11Z%22%7D%7D%2C%7B%22key%22%3A%22UXNVD57J%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22lastModifiedByUser%22%3A%7B%22id%22%3A9264554%2C%22username%22%3A%22oaguiar%22%2C%22name%22%3A%22%22%2C%22links%22%3A%7B%22alternate%22%3A%7B%22href%22%3A%22https%3A%5C%2F%5C%2Fwww.zotero.org%5C%2Foaguiar%22%2C%22type%22%3A%22text%5C%2Fhtml%22%7D%7D%7D%2C%22creatorSummary%22%3A%22Morales%20et%20al.%22%2C%22parsedDate%22%3A%222021-10-28%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMorales%2C%20E.%2C%20McKiernan%2C%20E.%20C.%2C%20Niles%2C%20M.%20T.%2C%20Schimanski%2C%20L.%2C%20%26amp%3B%20Alperin%2C%20J.%20P.%20%282021%29.%20How%20faculty%20define%20quality%2C%20prestige%2C%20and%20impact%20of%20academic%20journals.%20%26lt%3Bi%26gt%3BPLOS%20ONE%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B16%26lt%3B%5C%2Fi%26gt%3B%2810%29%2C%20e0257340.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0257340%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0257340%26lt%3B%5C%2Fa%26gt%3B%20%26lt%3Ba%20title%3D%26%23039%3BDownload%26%23039%3B%20class%3D%26%23039%3Bzp-DownloadURL%20zp-getDownloadURL%26%23039%3B%20data-zp-dl%3D%26%23039%3Bapi_user_id%3D1298012%26amp%3Bdlkey%3DX4ZHBX67%26amp%3Bcontent_type%3Dapplication%5C%2Fpdf%26%23039%3B%20href%3D%26%23039%3Bjavascript%3Avoid%280%29%3B%26%23039%3B%26gt%3BDownload%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22How%20faculty%20define%20quality%2C%20prestige%2C%20and%20impact%20of%20academic%20journals%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Esteban%22%2C%22lastName%22%3A%22Morales%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Erin%20C.%22%2C%22lastName%22%3A%22McKiernan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meredith%20T.%22%2C%22lastName%22%3A%22Niles%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%22%2C%22lastName%22%3A%22Schimanski%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20Pablo%22%2C%22lastName%22%3A%22Alperin%22%7D%5D%2C%22abstractNote%22%3A%22Despite%20the%20calls%20for%20change%2C%20there%20is%20significant%20consensus%20that%20when%20it%20comes%20to%20evaluating%20publications%2C%20review%2C%20promotion%2C%20and%20tenure%20processes%20should%20aim%20to%20reward%20research%20that%20is%20of%20high%20%26quot%3Bquality%2C%26quot%3B%20is%20published%20in%20%26quot%3Bprestigious%26quot%3B%20journals%2C%20and%20has%20an%20%26quot%3Bimpact.%26quot%3B%20Nevertheless%2C%20such%20terms%20are%20highly%20subjective%20and%20present%20challenges%20to%20ascertain%20precisely%20what%20such%20research%20looks%20like.%20Accordingly%2C%20this%20article%20responds%20to%20the%20question%3A%20how%20do%20faculty%20from%20universities%20in%20the%20United%20States%20and%20Canada%20define%20the%20terms%20quality%2C%20prestige%2C%20and%20impact%20of%20academic%20journals%3F%20We%20address%20this%20question%20by%20surveying%20338%20faculty%20members%20from%2055%20different%20institutions%20in%20the%20U.S.%20and%20Canada.%20While%20relying%20on%20self-reported%20definitions%20that%20are%20not%20linked%20to%20their%20behavior%2C%20this%20study%5Cu2019s%20findings%20highlight%20that%20faculty%20often%20describe%20these%20distinct%20terms%20in%20overlapping%20ways.%20Additionally%2C%20results%20show%20that%20marked%20variance%20in%20definitions%20across%20faculty%20does%20not%20correspond%20to%20demographic%20characteristics.%20This%20study%5Cu2019s%20results%20highlight%20the%20subjectivity%20of%20common%20research%20terms%20and%20the%20importance%20of%20implementing%20evaluation%20regimes%20that%20do%20not%20rely%20on%20ill-defined%20concepts%20and%20may%20be%20context%20specific.%22%2C%22date%22%3A%222021-10-28%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0257340%22%2C%22ISSN%22%3A%221932-6203%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fjournals.plos.org%5C%2Fplosone%5C%2Farticle%3Fid%3D10.1371%5C%2Fjournal.pone.0257340%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222022-04-06T23%3A31%3A28Z%22%7D%7D%2C%7B%22key%22%3A%22ZM7AERC9%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22Niles%20et%20al.%22%2C%22parsedDate%22%3A%222020-03-11%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BNiles%2C%20M.%20T.%2C%20Schimanski%2C%20L.%20A.%2C%20McKiernan%2C%20E.%20C.%2C%20%26amp%3B%20Alperin%2C%20J.%20P.%20%282020%29.%20Why%20we%20publish%20where%20we%20do%3A%20Faculty%20publishing%20values%20and%20their%20relationship%20to%20review%2C%20promotion%20and%20tenure%20expectations.%20%26lt%3Bi%26gt%3BPLOS%20ONE%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B15%26lt%3B%5C%2Fi%26gt%3B%283%29%2C%20e0228914.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0228914%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.1371%5C%2Fjournal.pone.0228914%26lt%3B%5C%2Fa%26gt%3B%20%26lt%3Ba%20title%3D%26%23039%3BDownload%26%23039%3B%20class%3D%26%23039%3Bzp-DownloadURL%20zp-getDownloadURL%26%23039%3B%20data-zp-dl%3D%26%23039%3Bapi_user_id%3D1298012%26amp%3Bdlkey%3DDBRK73TH%26amp%3Bcontent_type%3Dapplication%5C%2Fpdf%26%23039%3B%20href%3D%26%23039%3Bjavascript%3Avoid%280%29%3B%26%23039%3B%26gt%3BDownload%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Why%20we%20publish%20where%20we%20do%3A%20Faculty%20publishing%20values%20and%20their%20relationship%20to%20review%2C%20promotion%20and%20tenure%20expectations%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meredith%20T.%22%2C%22lastName%22%3A%22Niles%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%20A.%22%2C%22lastName%22%3A%22Schimanski%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Erin%20C.%22%2C%22lastName%22%3A%22McKiernan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20Pablo%22%2C%22lastName%22%3A%22Alperin%22%7D%2C%7B%22creatorType%22%3A%22editor%22%2C%22firstName%22%3A%22Sergio%20A.%22%2C%22lastName%22%3A%22Useche%22%7D%5D%2C%22abstractNote%22%3A%22%22%2C%22date%22%3A%222020-3-11%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.1371%5C%2Fjournal.pone.0228914%22%2C%22ISSN%22%3A%221932-6203%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdx.plos.org%5C%2F10.1371%5C%2Fjournal.pone.0228914%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222020-06-09T12%3A51%3A15Z%22%7D%7D%2C%7B%22key%22%3A%22VGUMDEVE%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22lastModifiedByUser%22%3A%7B%22id%22%3A4061605%2C%22username%22%3A%22bubblbu%22%2C%22name%22%3A%22Asura%20Enkhbayar%22%2C%22links%22%3A%7B%22alternate%22%3A%7B%22href%22%3A%22https%3A%5C%2F%5C%2Fwww.zotero.org%5C%2Fbubblbu%22%2C%22type%22%3A%22text%5C%2Fhtml%22%7D%7D%7D%2C%22creatorSummary%22%3A%22Alperin%20et%20al.%22%2C%22parsedDate%22%3A%222020%22%2C%22numChildren%22%3A2%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BAlperin%2C%20J.%20P.%2C%20La%2C%20M.%2C%20McKiernan%2C%20E.%20C.%2C%20Niles%2C%20M.%20T.%2C%20%26amp%3B%20Schimanski%2C%20L.%20A.%20%282020%29.%20The%20value%20of%20data%20and%20other%20non-traditional%20scholarly%20outputs%20in%20academic%20review%2C%20promotion%2C%20and%20tenure%20in%20Canada%20and%20the%20United%20States.%20%26lt%3Bi%26gt%3BOpen%20Handbook%20of%20Linguistic%20Data%20Management%26lt%3B%5C%2Fi%26gt%3B.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-ItemURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fhcommons.org%5C%2Fdeposits%5C%2Fitem%5C%2Fhc%3A32909%5C%2F%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fhcommons.org%5C%2Fdeposits%5C%2Fitem%5C%2Fhc%3A32909%5C%2F%26lt%3B%5C%2Fa%26gt%3B%20%26lt%3Ba%20title%3D%26%23039%3BDownload%26%23039%3B%20class%3D%26%23039%3Bzp-DownloadURL%20zp-getDownloadURL%26%23039%3B%20data-zp-dl%3D%26%23039%3Bapi_user_id%3D1298012%26amp%3Bdlkey%3DYDK94QMX%26amp%3Bcontent_type%3Dapplication%5C%2Fpdf%26%23039%3B%20href%3D%26%23039%3Bjavascript%3Avoid%280%29%3B%26%23039%3B%26gt%3BDownload%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22The%20value%20of%20data%20and%20other%20non-traditional%20scholarly%20outputs%20in%20academic%20review%2C%20promotion%2C%20and%20tenure%20in%20Canada%20and%20the%20United%20States%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20Pablo%22%2C%22lastName%22%3A%22Alperin%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Michelle%22%2C%22lastName%22%3A%22La%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Erin%20C.%22%2C%22lastName%22%3A%22McKiernan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meredith%20T.%22%2C%22lastName%22%3A%22Niles%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%20A.%22%2C%22lastName%22%3A%22Schimanski%22%7D%5D%2C%22abstractNote%22%3A%22Academics%20are%20regularly%20involved%20in%20a%20wide%20range%20of%20activities%20spanning%20research%2C%20teaching%20and%20service%2C%20and%20the%20breadth%20of%20necessary%20outputs%20for%20review%2C%20promotion%2C%20and%20tenure%20%28RPT%29%20in%20each%20category%20only%20continues%20to%20grow.%20How%20do%20faculty%20manage%20their%20academic%20careers%20in%20the%20face%20of%20such%20growing%20sets%20of%20demands%3F%20Although%20we%20know%20that%20discussions%20of%20research%20assessment%20across%20the%20academy%20are%20increasingly%20recognizing%20the%20need%20to%20value%20the%20creation%20of%20outputs%20beyond%20research%20published%20in%20peer-reviewed%20journals%2C%20it%20is%20not%20clear%20whether%20these%20discussions%20have%20made%20their%20way%20into%20formal%20assessment%20structures.%20By%20analyzing%20the%20extent%20to%20which%20non-traditional%20outputs%2C%20including%20data%20and%20software%2C%20are%20mentioned%20in%20the%20RPT%20documents%20of%20a%20representative%20set%20of%20129%20universities%20from%20the%20United%20States%20and%20Canada%2C%20this%20chapter%20offers%20empirical%20evidence%20from%20across%20many%20disciplines%20of%20which%20types%20of%20faculty%20work%20are%20recognized%20in%20the%20RPT%20processes%2C%20and%20which%20are%20not.%20We%20confirm%20that%20traditional%20outputs%20such%20as%20peer-reviewed%20journal%20articles%2C%20book%20chapters%20and%20monographs%20are%20mentioned%20almost%20universally%2C%20whereas%20data-related%20items%20such%20as%20datasets%20and%20databases%20are%20mentioned%20only%20by%20a%20fraction%20of%20institutions.%20We%20find%20that%20research-intensive%20institutions%20acknowledge%20more%20types%20of%20research%20outputs%20in%20general%2C%20whereas%20institutions%20that%20focus%20more%20on%20undergraduate%20and%20master%5Cu2019s%20degree%20programs%20tend%20to%20mention%20fewer%20forms%20of%20scholarship%20in%20their%20RPT%20guidelines.%20Within%20research-intensive%20institutions%2C%20units%20from%20the%20life%20sciences%20present%20a%20greater%20range%20of%20outputs%20in%20the%20guidelines%20offered%20to%20faculty%2C%20including%20the%2015%25%20that%20explicitly%20mention%20data-related%20outputs.%20In%20contrast%2C%20none%20of%20the%20academic%20units%20in%20mathematics%20and%20physical%20and%20social%20sciences%20in%20our%20sample%20recognize%20data-related%20outputs%2C%20and%20generally%20recognize%20fewer%20forms.%20Overall%2C%20we%20conclude%20that%20many%20current%20structures%20for%20faculty%20assessment%20do%20not%20explicitly%20recognize%20the%20increasing%20complexity%20and%20demands%20of%20faculty%20work.%22%2C%22date%22%3A%222020%22%2C%22language%22%3A%22en-US%22%2C%22DOI%22%3A%22%22%2C%22ISSN%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fhcommons.org%5C%2Fdeposits%5C%2Fitem%5C%2Fhc%3A32909%5C%2F%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222021-07-26T06%3A35%3A18Z%22%7D%7D%2C%7B%22key%22%3A%22AA3FN8E7%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22creatorSummary%22%3A%22McKiernan%20et%20al.%22%2C%22parsedDate%22%3A%222019-07-31%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BMcKiernan%2C%20E.%20C.%2C%20Schimanski%2C%20L.%20A.%2C%20Mu%26%23xF1%3Boz%20Nieves%2C%20C.%2C%20Matthias%2C%20L.%2C%20Niles%2C%20M.%20T.%2C%20%26amp%3B%20Alperin%2C%20J.%20P.%20%282019%29.%20Use%20of%20the%20Journal%20Impact%20Factor%20in%20academic%20review%2C%20promotion%2C%20and%20tenure%20evaluations.%20%26lt%3Bi%26gt%3BELife%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B8%26lt%3B%5C%2Fi%26gt%3B%2C%20e47338.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.7554%5C%2FeLife.47338%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.7554%5C%2FeLife.47338%26lt%3B%5C%2Fa%26gt%3B%20%26lt%3Ba%20title%3D%26%23039%3BDownload%26%23039%3B%20class%3D%26%23039%3Bzp-DownloadURL%20zp-getDownloadURL%26%23039%3B%20data-zp-dl%3D%26%23039%3Bapi_user_id%3D1298012%26amp%3Bdlkey%3DNRYNFHEQ%26amp%3Bcontent_type%3Dapplication%5C%2Fpdf%26%23039%3B%20href%3D%26%23039%3Bjavascript%3Avoid%280%29%3B%26%23039%3B%26gt%3BDownload%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22Use%20of%20the%20Journal%20Impact%20Factor%20in%20academic%20review%2C%20promotion%2C%20and%20tenure%20evaluations%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Erin%20C%22%2C%22lastName%22%3A%22McKiernan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%20A%22%2C%22lastName%22%3A%22Schimanski%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Carol%22%2C%22lastName%22%3A%22Mu%5Cu00f1oz%20Nieves%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lisa%22%2C%22lastName%22%3A%22Matthias%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meredith%20T%22%2C%22lastName%22%3A%22Niles%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20P%22%2C%22lastName%22%3A%22Alperin%22%7D%5D%2C%22abstractNote%22%3A%22We%20analyzed%20how%20often%20and%20in%20what%20ways%20the%20Journal%20Impact%20Factor%20%28JIF%29%20is%20currently%20used%20in%20review%2C%20promotion%2C%20and%20tenure%20%28RPT%29%20documents%20of%20a%20representative%20sample%20of%20universities%20from%20the%20United%20States%20and%20Canada.%2040%25%20of%20research-intensive%20institutions%20and%2018%25%20of%20master%5Cu2019s%20institutions%20mentioned%20the%20JIF%2C%20or%20closely%20related%20terms.%20Of%20the%20institutions%20that%20mentioned%20the%20JIF%2C%2087%25%20supported%20its%20use%20in%20at%20least%20one%20of%20their%20RPT%20documents%2C%2013%25%20expressed%20caution%20about%20its%20use%2C%20and%20none%20heavily%20criticized%20it%20or%20prohibited%20its%20use.%20Furthermore%2C%2063%25%20of%20institutions%20that%20mentioned%20the%20JIF%20associated%20the%20metric%20with%20quality%2C%2040%25%20with%20impact%2C%20importance%2C%20or%20significance%2C%20and%2020%25%20with%20prestige%2C%20reputation%2C%20or%20status.%20We%20conclude%20that%20use%20of%20the%20JIF%20is%20encouraged%20in%20RPT%20evaluations%2C%20especially%20at%20research-intensive%20universities%2C%20and%20that%20there%20is%20work%20to%20be%20done%20to%20avoid%20the%20potential%20misuse%20of%20metrics%20like%20the%20JIF.%22%2C%22date%22%3A%222019-07-31%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.7554%5C%2FeLife.47338%22%2C%22ISSN%22%3A%222050-084X%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Felifesciences.org%5C%2Farticles%5C%2F47338%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222020-06-09T12%3A51%3A59Z%22%7D%7D%2C%7B%22key%22%3A%22QZHNNA7E%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22lastModifiedByUser%22%3A%7B%22id%22%3A9264554%2C%22username%22%3A%22oaguiar%22%2C%22name%22%3A%22%22%2C%22links%22%3A%7B%22alternate%22%3A%7B%22href%22%3A%22https%3A%5C%2F%5C%2Fwww.zotero.org%5C%2Foaguiar%22%2C%22type%22%3A%22text%5C%2Fhtml%22%7D%7D%7D%2C%22creatorSummary%22%3A%22Schimanski%20and%20Alperin%22%2C%22parsedDate%22%3A%222018-10-05%22%2C%22numChildren%22%3A1%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BSchimanski%2C%20L.%20A.%2C%20%26amp%3B%20Alperin%2C%20J.%20P.%20%282018%29.%20The%20evaluation%20of%20scholarship%20in%20academic%20promotion%20and%20tenure%20processes%3A%20Past%2C%20present%2C%20and%20future.%20%26lt%3Bi%26gt%3BF1000Research%26lt%3B%5C%2Fi%26gt%3B%2C%20%26lt%3Bi%26gt%3B7%26lt%3B%5C%2Fi%26gt%3B%2C%201605.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.12688%5C%2Ff1000research.16493.1%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.12688%5C%2Ff1000research.16493.1%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22journalArticle%22%2C%22title%22%3A%22The%20evaluation%20of%20scholarship%20in%20academic%20promotion%20and%20tenure%20processes%3A%20Past%2C%20present%2C%20and%20future%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%20A.%22%2C%22lastName%22%3A%22Schimanski%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20Pablo%22%2C%22lastName%22%3A%22Alperin%22%7D%5D%2C%22abstractNote%22%3A%22Review%2C%20promotion%2C%20and%20tenure%20%28RPT%29%20processes%20significantly%20affect%20how%20faculty%20direct%20their%20own%20career%20and%20scholarly%20progression.%20Although%20RPT%20practices%20vary%20between%20and%20within%20institutions%2C%20and%20affect%20various%20disciplines%2C%20ranks%2C%20institution%20types%2C%20genders%2C%20and%20ethnicity%20in%20different%20ways%2C%20some%20consistent%20themes%20emerge%20when%20investigating%20what%20faculty%20would%20like%20to%20change%20about%20RPT.%20For%20instance%2C%20over%20the%20last%20few%20decades%2C%20RPT%20processes%20have%20generally%20increased%20the%20value%20placed%20on%20research%2C%20at%20the%20expense%20of%20teaching%20and%20service%2C%20which%20often%20results%20in%20an%20incongruity%20between%20how%20faculty%20actually%20spend%20their%20time%20vs.%20what%20is%20considered%20in%20their%20evaluation.%20Another%20issue%20relates%20to%20publication%20practices%3A%20most%20agree%20RPT%20requirements%20should%20encourage%20peer-reviewed%20works%20of%20high%20quality%2C%20but%20in%20practice%2C%20the%20value%20of%20publications%20is%20often%20assessed%20using%20shortcuts%20such%20as%20the%20prestige%20of%20the%20publication%20venue%2C%20rather%20than%20on%20the%20quality%20and%20rigor%20of%20peer%20review%20of%20each%20individual%20item.%20Open%20access%20and%20online%20publishing%20have%20made%20these%20issues%20even%20murkier%20due%20to%20misconceptions%20about%20peer%20review%20practices%20and%20concerns%20about%20predatory%20online%20publishers%2C%20which%20leaves%20traditional%20publishing%20formats%20the%20most%20desired%20despite%20their%20restricted%20circulation.%20And%2C%20efforts%20to%20replace%20journal-level%20measures%20such%20as%20the%20impact%20factor%20with%20more%20precise%20article-level%20metrics%20%28e.g.%2C%20citation%20counts%20and%20altmetrics%29%20have%20been%20slow%20to%20integrate%20with%20the%20RPT%20process.%20Questions%20remain%20as%20to%20whether%2C%20or%20how%2C%20RPT%20practices%20should%20be%20changed%20to%20better%20reflect%20faculty%20work%20patterns%20and%20reduce%20pressure%20to%20publish%20in%20only%20the%20most%20prestigious%20traditional%20formats.%20To%20determine%20the%20most%20useful%20way%20to%20change%20RPT%2C%20we%20need%20to%20assess%20further%20the%20needs%20and%20perceptions%20of%20faculty%20and%20administrators%2C%20and%20gain%20a%20better%20understanding%20of%20the%20level%20of%20influence%20of%20written%20RPT%20guidelines%20and%20policy%20in%20an%20often%20vague%20process%20that%20is%20meant%20to%20allow%20for%20flexibility%20in%20assessing%20individuals.%22%2C%22date%22%3A%222018-10-5%22%2C%22language%22%3A%22en%22%2C%22DOI%22%3A%2210.12688%5C%2Ff1000research.16493.1%22%2C%22ISSN%22%3A%222046-1402%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Ff1000research.com%5C%2Farticles%5C%2F7-1605%5C%2Fv1%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222022-09-08T22%3A03%3A46Z%22%7D%7D%2C%7B%22key%22%3A%22WSA97PMF%22%2C%22library%22%3A%7B%22id%22%3A1298012%7D%2C%22meta%22%3A%7B%22lastModifiedByUser%22%3A%7B%22id%22%3A7655369%2C%22username%22%3A%22kathleengregory%22%2C%22name%22%3A%22%22%2C%22links%22%3A%7B%22alternate%22%3A%7B%22href%22%3A%22https%3A%5C%2F%5C%2Fwww.zotero.org%5C%2Fkathleengregory%22%2C%22type%22%3A%22text%5C%2Fhtml%22%7D%7D%7D%2C%22creatorSummary%22%3A%22Alperin%20et%20al.%22%2C%22parsedDate%22%3A%222018-05-23%22%2C%22numChildren%22%3A0%7D%2C%22bib%22%3A%22%26lt%3Bdiv%20class%3D%26quot%3Bcsl-bib-body%26quot%3B%20style%3D%26quot%3Bline-height%3A%202%3B%20padding-left%3A%201em%3B%20text-indent%3A-1em%3B%26quot%3B%26gt%3B%5Cn%20%20%26lt%3Bdiv%20class%3D%26quot%3Bcsl-entry%26quot%3B%26gt%3BAlperin%2C%20J.%20P.%2C%20Mu%26%23xF1%3Boz%20Nieves%2C%20C.%2C%20Schimanski%2C%20L.%2C%20McKiernan%2C%20E.%20C.%2C%20%26amp%3B%20Niles%2C%20M.%20T.%20%282018%29.%20%26lt%3Bi%26gt%3BTerms%20and%20concepts%20found%20in%20tenure%20and%20promotion%20guidelines%20from%20the%20US%20and%20Canada%26lt%3B%5C%2Fi%26gt%3B.%20%26lt%3Ba%20class%3D%26%23039%3Bzp-DOIURL%26%23039%3B%20href%3D%26%23039%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.7910%5C%2FDVN%5C%2FVY4TJE%26%23039%3B%26gt%3Bhttps%3A%5C%2F%5C%2Fdoi.org%5C%2Fhttps%3A%5C%2F%5C%2Fdoi.org%5C%2F10.7910%5C%2FDVN%5C%2FVY4TJE%26lt%3B%5C%2Fa%26gt%3B%26lt%3B%5C%2Fdiv%26gt%3B%5Cn%26lt%3B%5C%2Fdiv%26gt%3B%22%2C%22data%22%3A%7B%22itemType%22%3A%22dataset%22%2C%22title%22%3A%22Terms%20and%20concepts%20found%20in%20tenure%20and%20promotion%20guidelines%20from%20the%20US%20and%20Canada%22%2C%22creators%22%3A%5B%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Juan%20Pablo%22%2C%22lastName%22%3A%22Alperin%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Carol%22%2C%22lastName%22%3A%22Mu%5Cu00f1oz%20Nieves%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Lesley%22%2C%22lastName%22%3A%22Schimanski%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Erin%20C.%22%2C%22lastName%22%3A%22McKiernan%22%7D%2C%7B%22creatorType%22%3A%22author%22%2C%22firstName%22%3A%22Meredith%20T.%22%2C%22lastName%22%3A%22Niles%22%7D%5D%2C%22abstractNote%22%3A%22Terms%20and%20concepts%20related%20to%20open%20access%2C%20public%20engagement%2C%20research%20metrics%20and%20publication%20types%20found%20in%20review%2C%20tenure%2C%20and%20promotion%20guidelines%20from%20129%20universities%20from%20the%20United%20States%20and%20Canada.%20Publications%20from%20this%20project%20are%20forthcoming.%22%2C%22identifier%22%3A%22%22%2C%22type%22%3A%22%22%2C%22versionNumber%22%3A%22%22%2C%22date%22%3A%222018-05-23%22%2C%22repository%22%3A%22%22%2C%22repositoryLocation%22%3A%22%22%2C%22format%22%3A%22%22%2C%22DOI%22%3A%22https%3A%5C%2F%5C%2Fdoi.org%5C%2F10.7910%5C%2FDVN%5C%2FVY4TJE%22%2C%22citationKey%22%3A%22%22%2C%22url%22%3A%22https%3A%5C%2F%5C%2Fdataverse.harvard.edu%5C%2Fdataset.xhtml%3FpersistentId%3Ddoi%3A10.7910%5C%2FDVN%5C%2FVY4TJE%22%2C%22language%22%3A%22en%22%2C%22collections%22%3A%5B%5D%2C%22dateModified%22%3A%222022-04-06T21%3A59%3A09Z%22%7D%7D%5D%7D
Dawson, D. (DeDe), Morales, E., McKiernan, E. C., Schimanski, L. A., Niles, M. T., & Alperin, J. P. (2022). The role of collegiality in academic review, promotion, and tenure. PLOS ONE, 17(4), e0265506. https://doi.org/10.1371/journal.pone.0265506
Morales, E., McKiernan, E. C., Niles, M. T., Schimanski, L., & Alperin, J. P. (2021). How faculty define quality, prestige, and impact of academic journals. PLOS ONE, 16(10), e0257340. https://doi.org/https://doi.org/10.1371/journal.pone.0257340 Download
Niles, M. T., Schimanski, L. A., McKiernan, E. C., & Alperin, J. P. (2020). Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations. PLOS ONE, 15(3), e0228914. https://doi.org/10.1371/journal.pone.0228914 Download
Alperin, J. P., La, M., McKiernan, E. C., Niles, M. T., & Schimanski, L. A. (2020). The value of data and other non-traditional scholarly outputs in academic review, promotion, and tenure in Canada and the United States. Open Handbook of Linguistic Data Management. https://hcommons.org/deposits/item/hc:32909/ Download
McKiernan, E. C., Schimanski, L. A., Muñoz Nieves, C., Matthias, L., Niles, M. T., & Alperin, J. P. (2019). Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations. ELife, 8, e47338. https://doi.org/10.7554/eLife.47338 Download
Schimanski, L. A., & Alperin, J. P. (2018). The evaluation of scholarship in academic promotion and tenure processes: Past, present, and future. F1000Research, 7, 1605. https://doi.org/10.12688/f1000research.16493.1
Alperin, J. P., Muñoz Nieves, C., Schimanski, L., McKiernan, E. C., & Niles, M. T. (2018). Terms and concepts found in tenure and promotion guidelines from the US and Canada. https://doi.org/https://doi.org/10.7910/DVN/VY4TJE