2020/08/22 by Dima Damen, Michael Wray, Damen, Dima +1
Medicine · Psychology · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Family and Disability Support Research #Resilience and Mental Health #Simulation-Based Education in Healthcare
paper · pdf · doi:10.48550/arxiv.2008.09890
openalex publication_date 2020/08/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
We propose a three-dimensional discrete and incremental scale to encode a method's level of supervision - i.e. the data and labels used when training a model to achieve a given performance. We capture three aspects of supervision, that are known to give methods an advantage while requiring additional costs: pre-training, training labels and training data. The proposed three-dimensional scale can be included in result tables or leaderboards to handily compare methods not only by their performance, but also by the level of data supervision utilised by each method. The Supervision Levels Scale (SLS) is first presented generally fo any task/dataset/challenge. It is then applied to the EPIC-KITCHENS-100 dataset, to be used for the various leaderboards and challenges associated with this dataset.