Coding and inferences from visual and other behavioural data

Hans Henrik Krogh Sønderstrup-Andersen, Henning Boje Andersen, B.G. Hilburn, R. Zon, A. Blechko, J. Ober, G. Hauland

    Research output: Book/ReportReportResearch

    209 Downloads (Pure)


    In this report we focus on developing and testing methods for the analysis of team situation awareness. That is, focus is on methods for analysing team situation awareness relating visual and other behavioural data; development of tools to facilitate usability and efficiency of Eye Point of Gaze (EPOG) data collection; and exploration and documentation of EPOG data measurement techniques.

    The objective is to develop methods at a semantic level for analysing shared situational awareness relating visual and other behavioural data and to demonstrate how (a) objective measures (eye tracking) (b) subjective measures (Workload, Situation Awareness (SA), Self-assessment) and (c) elicitation of subjects' awareness of team-mates' current SA correlate. Measures of subjects' awareness of team-mates was developed and tested during small-scale experiments. Specifically focus has been the combination of visual and other behavioural data, of subjective (where raw data are interpretations) and objective data (where raw data are recordings of directly observable behaviour), and of data representing voluntary/intentional behaviour (actions) and EPOG data (that do not directly represent intentions).

    A series of small-scale experiments was carried out in the following domains: Flight Simulation, Nuclear Power Plant Operation, Air Traffic Control Simulation and Anaesthesia Simulation.

    A device has been developed (JAZZ) that provides operators with real-time as well as historic data on co-operators attention mode. The prototype is based on a model that distinguishes three modes of mental activity (described as planning, monitoring and exploration). According to this model, visual activity increases across the planning, monitoring and explorations modes respectively. It is the thought that this model could be utilised to give feedback to operators in terms of team-mates current mental mode and thereby support maintenance of team situation awareness.
    Original languageEnglish
    Place of PublicationRoskilde
    PublisherDanmarks Tekniske Universitet (DTU)
    Number of pages219
    ISBN (Print)87-550-3360-1
    Publication statusPublished - 2004
    SeriesDenmark. Forskningscenter Risoe. Risoe-R


    • Risø-R-1474
    • Risø-R-1474(EN)

    Fingerprint Dive into the research topics of 'Coding and inferences from visual and other behavioural data'. Together they form a unique fingerprint.

    Cite this