The three modes
- Open: everyone sees all names.
- Single-blind: reviewers see the authors' names. The authors see the reviewers only as "Reviewer 1", "Reviewer 2", and so do the other reviewers in the discussion with the authors. This is the event's default.
- Double-blind: in addition, reviewers do not see who wrote the abstract.
Many scientific societies require a double-blind review, so that the reputation of an author or an institution does not influence the score.
Step 1: Choose the mode for the event
- Open Content And Speakers, then Call for Content Settings, and its tab Review and limits.
- Under Default review visibility, choose Double-blind.
- Save.
Every presentation type that does not set its own mode follows this one.
Step 2: Set a different mode for one presentation type or stage, if needed
- For one presentation type: open it, go to its tab Forms, and choose Review visibility.
- For one review stage: open the presentation type's tab Review stages, choose Edit on the stage, and choose its Review visibility.
For example, a congress may review its abstracts double-blind but its invited symposium talks openly.
Step 3: Hide answers that name the author
In a double-blind review, run.events hides the people of the session from the reviewers. But an answer in the submission form can still give the author away, for example an answer to "Institution" or "Department". Mark such questions so that reviewers do not see them:
- In a Smart Form: select the question in the form editor and tick Contains identifying information.
- In the event's Classic questions: open the question on the card Classic questions and tick Contains identifying information.
Reviewers then do not see these answers: not in the session, and not in the filters, columns and exports of the Sessions page.
Step 4: Close the gaps you cannot switch off
Some ways a name can still show are outside run.events' control:
- The abstract text itself. If an author writes "In our previous study at University Hospital Nordstadt…", the reviewer reads it. Ask authors in your guidelines, and in the form's question descriptions, not to name themselves, their colleagues or their institution in the abstract.
- Uploaded files. A file, such as a figure, can carry a name or a logo. In a double-blind review, a file answer is marked "May contain identifying information." unless its question is marked as identifying. If your form collects files, mark the question as identifying, or ask authors to remove names from their files.
- The roles of your committee members. Content admins always see the authors: anyone with the organizer role Admin, or the event role Event Manager or Content Owner. For the review to be blind for a committee member, they must hold only Content Team Member.
- The tab Comments. The internal comments on a session always show the name of the person who wrote them, whatever the mode.
- Five icons. With Five icons instead of a rating form, every reviewer who opens a session sees the icons the other reviewers chose, with their names and photos. For a blind review, rate with a rating form.
Common mistake
Reviewers see the authors although you chose double-blind. Check that the presentation type or the stage does not set its own mode, and that the reviewer holds no role other than Content Team Member.
Related articles