A) Computation of saliency and feature-specific maps, for visual and auditory stimuli

This part of the software computes saliency maps based on feature discontinuities at different scales, which are then combined into a single saliency map (Itti and Koch 2001, in Nat Rev Neurosci). For vision, the software can utilise Intensity, Orientation, Colour, Motion, Flicker and binocular Disparity contrasts. For audition, the saliency maps consider discontinuities in Intensity, Frequency, Time and Orientation (Kalinli and Narayanan 2009, in IEEE Trans Audio Speech Lang Process). This part of the code includes functions from the SaliencyToolbox and the SIFTflow.

B) Processing of eye-movement data

This set of functions process eye-movement data that we typically acquire while subjects view complex naturalistic stimuli. Following some initial processing (e.g. conversion to visual degrees, exclusion of blinks and artefacts), the eye-tracking data are combined with information about “what stimulus was presented when” and fixations/saccades are identified.

C) Data-driven analyses of fMRI time series (brain Modes)

This part of the software combines inter-subjects synchronization analyses (Hasson et al., 2004, in Science) and cluster analyses to isolate functionally-relevant brain networks during viewing of complex and dynamic stimuli (bModes). The procedure is fully data-driven and can identify transient coupling between brain areas, irrespective of the signal shape within each area. This new approach is particularly suited to investigate multi-components control processes using naturalistic stimuli during fMRI.