Linking neuronal activity to behaviour using AI-based online detection:
How is behavior causally linked to neuronal activity?
The AI-based system DeepLabStream (DLSteram) can automatically detect behavioral sequences and instantly react by modifying the underlying neuronal circuits.
In general, animal behavior can be described as the neuronal-driven sequence of reoccurring postures through time. Most of the available current technologies focus on offline pose estimation with high spatiotemporal resolution. However, to correlate behavior with neuronal activity it is often necessary to detect and react online to behavioral expressions. We have developed DeepLabStream (DLStream), a versatile closed-loop tool providing real-time pose estimation to deliver posture dependent stimulations. DLStream has a temporal resolution in the millisecond range, can utilize different input, as well as output devices and can be tailored to multiple experimental designs. We employed DLStream to optogenetically label neuronal ensembles active during specific head directions.