LuckPicker

Presentation Order in a Workshop

Going last after eleven presentations is a measurably worse slot. Random does not fix that.

Presentation order in a long session is unfair in a way randomness cannot repair — the twelfth slot is genuinely worse than the first because the audience is depleted, so a random draw distributes a real penalty rather than removing it.

The twelfth presentation of a session is genuinely worse than the first. The audience is depleted, attention has fallen, and the questions have dried up — and no ordering method removes that.

What randomising does is distribute a real penalty rather than concentrate it, which is the most an ordering can do.

The penalty is real and measurable

Late slots in a long session are worse on several dimensions at once. Attention declines through a session, questions get fewer and shorter as people tire, and the comparison set for whoever judges has already been formed by the earlier presenters.

There is a genuine research literature on order effects in evaluation, and while its specifics vary by context, the direction is consistent enough to plan around: position affects reception, and it does so by an amount that is not negligible relative to the differences between presenters.

That means an alphabetical order, or a sign-up-sheet order, is not neutral. It is a systematic advantage handed to whoever is early in the alphabet or quickest to sign up, repeated at every session run the same way.

What randomising achieves and what it does not

Randomising the order gives everyone the same expected position, which converts a systematic disadvantage into a variance. Over several sessions, everyone gets some good slots and some bad ones.

Over a single session it achieves nothing for the person who draws slot twelve. They still present to a depleted room, and the fact that it was fair does not improve their reception. If the session is a one-off assessment, randomisation distributes the unfairness without reducing it.

That is the honest framing: randomising is the right default and it is not a solution. Reducing the penalty requires changing the session rather than the order.

  • Randomising equalises expected position across presenters.
  • It does nothing for the individual who draws the last slot in a one-off session.
  • Over repeated sessions it converts a systematic bias into variance, which is a real improvement.
  • Reducing the penalty means restructuring the session, not reordering it.

Restructuring beats reordering

The interventions that actually reduce the late-slot penalty are structural. Breaks — a genuine one every four or five presentations — reset attention measurably. Shorter slots reduce the total elapsed time that produces the decline in the first place.

Splitting into parallel tracks is the strongest option where the format allows it: two rooms of six presentations each mean nobody presents twelfth, and the total time halves.

If judging is involved, re-randomising the order per judge is worth more than randomising once. Because every judge sees the same sequence in a single random order, the order effect is shared rather than cancelled — that is covered on the judging page and is the same problem in a different setting.

Twelve presentations, three formats

  • One block of 12: positions 10–12 present to a depleted room.
  • Two blocks of 6 with a break: worst position is 6th-after-a-break, which is considerably better.
  • Two parallel tracks of 6: nobody presents later than sixth, and the session halves in length.

Announcing the order

Draw the order in advance and publish it, rather than drawing on the day. Presenters who know they are twelfth can pace themselves, and a presenter who learns their slot thirty seconds before the session cannot.

Say that it was randomised. An unexplained order invites the assumption that someone chose it, and the assumption is usually that the organiser put their preferred presenter first.

And do not adjust it afterwards. Swapping two presenters at the request of one of them undoes the whole basis on which the order was defensible, and the other eleven will notice.

Frequently asked questions

Is a late slot really worse?

Yes. Attention declines, questions get fewer, and the comparison set has already formed. The effect is not negligible relative to differences between presenters.

Does randomising fix it?

It distributes the penalty rather than removing it. Over several sessions everyone gets some good and bad slots; in a one-off session it does nothing for whoever draws last.

Is alphabetical order neutral?

No. It is a systematic advantage to whoever is early in the alphabet, repeated at every session run the same way.

What actually reduces the penalty?

Breaks every four or five presentations, shorter slots, or parallel tracks. All of them change the session rather than the order.

Should I randomise per judge?

If there is judging, yes. A single random order is shared by every judge, so the order effect is not cancelled — only re-randomising per judge does that.

Should I publish the order in advance?

Yes. A presenter who knows they are twelfth can pace themselves; one who learns thirty seconds beforehand cannot.

Should I say it was randomised?

Yes. An unexplained order invites the assumption that someone chose it, usually to favour their preferred presenter.

Can I swap two presenters afterwards?

It undoes the basis on which the order was defensible, and the other presenters will notice. Decide the swap policy before you draw.

Tools for this job

Background reading

← All use cases