Realtime Visualization and Analysis of Scientific Video Data


Sponsor: National Science Foundation (NSF)
Grant Number: ACI-9721348
Period: 1998 - 2003
Amount: $134,608
PI:
Kay A. Robbins

Abstract

The objectives of this project are to develop practical tools for online analysis and visualization of experimental video data that should be applicable in both research and teaching laboratories. The system will have a familiar web-based interface, promote collaborative visualization and remote access and take advantage of distributed computing resources to attain near-realtime performance. The system will be particularly oriented towards the seamless acquisition of video data in order to detect transitions during the running of experiments. Fast display techniques and spatial Karhunen-Loeve reconstructions will be among the techniques implemented to allow experimentalists to map out bifurcation structure as experimental parameters are changed.

Applications:

Combustion and pattern formation
Distributed neural processing
Davis data viewing system
Data acquisition in Antarctica
Smarts project
Waves

Students

Kevin Allen     (undergraduate)
Robert Baltimore     (graduate)
Fernando Cano     (undergraduate)
Laura Connor     (graduate)
Daniel Espinoza     (undergraduate)
Todd Fichtemaier     (graduate)
Igor Grinshpan     (graduate)
Andrew Hudson     (undergraduate)
Raymond Hunley     (graduate)
Jason Johnson     (undergraduate)
Lea Leite     (undergraduate)
Mark Robinson     (graduate)
Brent Shumaker     (graduate)
Jeremy Stevens     (undergraduate)
Keyin Tu     (graduate)
Zheng Zhi     (graduate)

Collaborators

Donald D. Blankenship   Web (SOAR, UT Austin)
Bijoy Ghosh   Web (Washington University St. Louis)
Michael Gorman   Web (University of Houston)
David Senseman   Web (Department of Biology UTSA)
Philip Ulinski,   Web (University of Chicago)

Publications

Synchronized views for exploring populations of neurons
K. A. Robbins, I. Grinshpan, K. Allen and D. M. Senseman (2004)
Data Visualization and Analysis '2004, accepted.

Using derivatives to compare cortical waves across preparations
K. A. Robbins and D. M. Senseman (2003)
Neurocomputing, 52-54:885-891.

High-speed VSD imaging of visually evoked cortical waves: Decomposition into intra- and intercortical wave motions
D. M. Senseman and K. A. Robbins
J. Neurophysiology (2002) 87(3):1499-1514.

Visualizing splitting and merging processes
Kay A. Robbins, Clinton Jeffery and Steven Robbins
Journal of Visual Languages and Computing (2000) vol. 11 no. 6:593-614.

Fast Visualization Methods for Comparing Dynamics: A Case Study in Combustion
Kay A. Robbins and Michael Gorman
IEEE Visualization '2000 (2000) 433-436.

Using Process-Level Packet Routing to Support Real-time Data Visualization: A Case Study in Antarctica
Laura Connor and Kay Robbins
Communications in Computing'2000 (2000) 47-53.

Modal behavior of cortical neural networks during visual processing.
D. M. Senseman and K. A. Robbins
J. Neuroscience, (1999) vol. 19 RC3:1-7.

Visualization of scientific video data using KL decomposition
Kay A. Robbins
IEEE Trans. Visualization and Computer Graphics (1998) vol. 4 no. 4, 330-343.

Visualizing differences in movies of cortical activity
Kay A. Robbins and David M. Senseman
IEEE Visualization '98, (1998) 217-224.


Theses

Linear Data Decomposition Methods for Forced Non-Linear Spatio-temporal Systems: PCA Versus ICA
Brent Shumaker
Master's Thesis, University of Texas at San Antonio, August, 2001

Real-time Airborne Dataq Visualization under QNX: Performance Evaluation of a Geophysical Application in Antartica
Laura Connor
Master's Thesis, University of Texas at San Antonio, June 1999

Computer Techniques and Algorithms for the Detection of Heteroclinic Connections in Experimental Data
Mark Grechanik
Master's Thesis, University of Texas at San Antonio, June 1998


Abstracts and Presentations

Exploring behavior of neuronal populations with Davis
K. A. Robbins I. Grinshpan, K. Allen and D. M. Senseman
Soc. For Neuroscience Abstracts 2003.

Dynamical systems analysis of propagating waves in turtle visual cortex
P. Ulinski, B. Ghosh, K. A. Robbins and D. M. Senseman
2003 SIAM Conf. on Applications of Dynamical Systems (DS03), Snowbird, UT.

Extraction of wave structure from biological data
K. A. Robbins and D. M. Senseman
2003 SIAM Conf. on Applications of Dynamical Systems (DS03), Snowbird, UT.

Exploring behavior of neuronal populations with Davis
K. A. Robbins I. Grinshpan, K. Allen and D. M. Senseman
2003 RCMI Spring Symp., Abstract 1021, San Antonio, TX.

Dynamic analysis of propagating waves generated by the cholinergic theta oscillator in rat neocortex: KL decomposition of high-speed VSD movies
A. R. Kohl, K. A. Robbins and D. M. Senseman
Soc. for Neuroscience Abstracts, (2002) 28:651.5.

Dynamics of propagating cortical waves in vitro and in silico
L. Flores, K. A. Robbins and D. M. Senseman
GUM'2002, San Antonio TX.

Visualizing neuronal models for exploration
I. Grinshpan and K. A. Robbins
GUM'2002, San Antonio TX, 2002.

Comparison of cerebellar activation by afferent and direct electrical stimulation using high-speed VSD imaging
M. Ariel, H. Lu, K. A. Robbins, J. M. Bower and D. M. Senseman
Soc. for Neuroscience Abstracts, (2002) 28:360.2.

Using derivatives to compare cortical waves across preparations
K. A. Robbins and D. M. Senseman
Computational Neuroscience (CNS'2002), Chicago, IL.

Modal analysis of excitatory waves in the visual cortex
K. A. Robbins and D. M. Senseman
First SIAM Conference on the Life Sciences, (2002) Boston, MA.

Localization and characterization of entorhinal theta band oscillators by KL Decomposition of VSD movie
D. M. Senseman and K. A. Robbins
Soc. for Neuroscience Abstracts, (2001) 27:537.8.

Modal structure of the cortical response to moving and non-moving stimuli in the intact turtle brain
D. M. Senseman and K. A. Robbins
Soc. for Neuroscience Abstracts, (2000) 26:446.

Anisotropic spread of depolarization between visual cortical areas provides a physical basis for the modal structure of coherent activity
D. M. Senseman and K. A. Robbins
Soc. for Neuroscience Abstracts, (1999) 25:1421.

Visual interpretation of transitions in spatiotemporal systems
K. A. Robbins and D. M. Senseman
Fifth SIAM Conf. on Applications of Dynamical Systems, (1999) Snowbird, UT.

Characterization of three intrinsic modes of visually-driven cortical activation
D. M. Senseman and K. A. Robbins
Soc. for Neuroscience Abstracts, (1998) 24:530.