The Bookmark Technique is a standard-setting method used in educational assessment to determine performance levels or cut scores for standardized tests. Developed in the late 1990s, this technique aims to provide a more efficient and intuitive approach to setting performance standards compared to traditional methods.
Key features of the Bookmark Technique include:
Ordered item booklet: Test items are arranged in order of difficulty, from easiest to most challenging.
Panel of experts: A group of subject matter experts and educators review the ordered items.
Conceptual understanding: Panelists consider what knowledge and skills a student should possess at each performance level.
Bookmark placement: Experts place a “bookmark” at the point in the ordered item booklet where they believe a student at the borderline of a particular performance level would have a specified probability (usually 2/3) of answering the item correctly.
Discussion and iteration: Panelists discuss their bookmark placements and may adjust them based on group consensus.
Statistical analysis: Cut scores are determined based on the bookmark placements and item response theory (IRT) statistics.
The Bookmark Technique is widely used in large-scale assessments due to its efficiency, transparency, and ability to handle complex item types. However, like all standard-setting methods, it requires careful implementation and consideration of potential biases.
