遇见数据集

BTI Pilot Calibration Study — Raw Scoring Data v1.0

收藏
Zenodo2026-03-16 更新2026-05-26 收录
官方服务:

资源简介:

Two pilot calibration exercises for the BTI (Boundary Transparency Instrument) rubric (DOI: 10.5281/zenodo.18989054), assessing rubric accessibility and preliminary inter-rater reliability under naive-rater conditions. **Calibration Study A** (N = 6 matched pairs): Two independent raters scored 12 blinded records (6 Baseline DMV + 6 DER-structured) using BTI v1.1. ICC(2,1) = 0.977; MAD = 0.67; Baseline mean 3.0, DER mean 11.3 (/12). **Calibration Study B** (N = 12 matched pairs): Two naive raters (Rater 1: secondary school student; Rater 2: undergraduate student) scored 12 blinded records (6 Baseline + 6 DER-structured). Both raters independently assigned higher BTI scores to DER-structured records: Rater 1 (Baseline M = 3.50 vs. DER M = 10.33; t(10) = 5.59, p = .0002, d = 3.54, direction 6/6); Rater 2 (Baseline M = 4.83 vs. DER M = 7.83; t(10) = 4.15, p = .002, d = 2.63, direction 5/6). ICC(2,1) = 0.644. Field-level exact agreement ranged from 17% (F5: Unknowns) to 75% (F6: Oversight). This dataset constitutes pilot instrument-calibration evidence. Professional-population inter-rater reliability validation remains future work. Indexed in the project Root Index (https://doi.org/10.5281/zenodo.17992916). Author: Hon Bor So ORCID: 0009-0008-2768-7494 Author note: The author also publishes under the name Sing So (Chöndrel Dorje).

提供机构:
Zenodo
创建时间:
2026-03-16
二维码
社区交流群
二维码
科研交流群
商业服务