The detection of lesions during small bowel (SB) capsule endoscopy (CE) depends on the cleanliness of the intestine. Quality reporting and comparison of different preparation methods require reliable scores. Three scores known as quantitative index (QI), qualitative evaluation (QE), and overall adequacy assessment (OAA), have been proposed to assess SB cleanliness, and are sometimes used in clinical practice and in clinical trials. However, none of these scores has received any external validation. The aim of our study was to re-assess the reproducibility of these three specific scores.

One-hundred-and-fifty-five complete third-generation SB-CE video recordings were extracted from a multicenter randomized controlled trial (PREPINTEST) which evaluated three modalities of SB preparation for CE. Three experts independently read the 155 SB-CE video recordings twice, in a random order, over 48 -h periods at 6-week intervals, using the QI, QE and OAA scores. Cohen’s linearly weighted kappa coefficients were calculated to assess intra-observer and inter-observer agreements.

Intra-observer reproducibility was fair to moderate, with kappa coefficients between 0.37 and 0.46 for QI, 0.41 and 0.51 for QE, 0.41 and 0.50 for OAA. Inter-observer reproducibility was fair to substantial according to kappa coefficients between experts varying from 0.40 to 0.64, 0.29 to 0.65, and 0.52 to 0.71, for QI, QE and OAA, respectively.

QI, QE and OAA scores, currently used for evaluation of the quality of the preparation of SB-CE, are not sufficiently reproducible. Other scores or methods are therefore needed for SB-CE cleanliness assessment.