Neural Dynamics of Stuttering
Computational modeling of how neural dynamics support fluent speech motor control, and what goes wrong in stuttering. Details will follow publication.
Fifteen projects, each with a live, procedurally generated visual. Filter by field, or open a card for the details.
Computational modeling of how neural dynamics support fluent speech motor control, and what goes wrong in stuttering. Details will follow publication.
Full pipeline for NeuroPace RNS iEEG, from artifact rejection to theta bouts measured against the aperiodic background and related to behavior.
Cortical E/I network in which top-down attention gates inhibitory interneurons to suppress competing talkers.
Online learning for biomimetic robot control and vision based on cortical predictive coding. Event demarcation lets it learn hierarchical timescales.
Self-supervised incremental learning on non-stationary, temporally correlated data streams of the kind open-world agents see.
Agents in the open world see non-stationary, temporally correlated streams. Standard SGD assumes i.i.d. samples from a stationary distribution. Co-designed with Shivang Patel, this framework learns quickly and stays stable on data with temporal dependencies.
A real-time Siamese tracker that adapts at test time to adverse visibility on CPU-only edge devices.
Few-shot domain adaptation for elongated, non-convex cells such as bacteria, built on Omnipose with specialized contrastive losses.
Retraining a segmentation model for every new microscopy collection costs annotation and compute. With Voke Brume, I designed contrastive losses that adapt to the target domain with pseudo-labels while staying anchored to the source. The result is clearly better segmentation of non-convex cell instances from only a few labeled samples.
Few-shot domain-adaptive instance segmentation for convex cells, extended to 3D volumes and integrated into syGlass.
Adaptive 3D cell tracking, tracing, counting and segmentation, shipped in a VR microscopy product.
VAE-LSTM anomaly detection on vaccine filling-line telemetry, deployed for real-time streaming inference.
A receptive-field shunting network with Hebbian-like learning, in which predictive coding emerges from the formulation itself.
A receptive-field-based shunting network with neurophysiologically valid dynamics and Hebbian-like learning for object recognition. Predictive coding emerged from the formulation, and a formal derivation produced a neurophysiologically plausible training procedure for deep networks.
Biologically plausible Bayesian learning for continual adaptation, using a LIF-like variational threshold extended to spiking networks.
A biologically plausible Bayesian learning framework for continual adaptability and reasoning under uncertainty. An adaptive thresholding mechanism acts as a variational activation that mimics leaky integrate-and-fire dynamics, and it was extended to spiking neural networks for neuromorphic hardware.
Entropy- and contrastive-inspired losses that improve cell segmentation with no new labels and no source data.
A test-time adaptation method for cellular instance segmentation on top of Cellpose. New losses inspired by Shannon entropy and self-supervised contrastive learning improve performance without additional labels or access to the source data.
Uses object detection as attention across 1,000 species and five plant organs, and released a long-tailed benchmark.
A bottom-up approach that detects plant organs (leaf, flower, fruit, bark, high-density leaves) and fuses the predictions of a variable number of organ-based species classifiers. This counters data variability and long-tail effects. Presented at WVU 2020, URDC 2021 and NCUR 2021.
IoT system for autonomous Fitbit collection (heart rate, activity, sleep staging) with models that infer health outcomes.
Autonomous collection of wearable physiological time series, with cleaning, resampling and windowed feature extraction for irregularly sampled streams, and models trained to infer target health outcomes. Part of the NSF Artificial Intelligence and Health 2020 workshop.