[Freesurfer] inter-rater variation in scan workups?

Hi,

We are having a small discussion at our lab regarding inter- and intra-rater reliability numbers for our scan workups. We have a number of lab technicians processing the scans, a situation which I suspect is common to many research groups. I can think of a number of steps in the processing stream where operator input could change surface thickness measures. Yet I can't recall ever seeing inter/intra-rater reliability measures in publications. Nor is it mentioned in the FS documentation, and I don't think it is presented at the FS courses. The people I have asked about it (two different labs) have all said something like "ignore it, nobody does it."

How are other people handling this issue?