Learning from Time Series for Health

Edward Choi

Towards building a reasoning agent for electrocardiogram

Abstract: Electrocardiograms (ECG) are one of the most often studied clinical signals by the AI community due to their frequent usage in hospitals as well as data availability on the web. In this talk, we introduce how we tried/try to contribute to this effort in three different dimensions, namely representation learning, question answering, and a reasoning agent, and share what we have learned along the way.

Towards Foundation Models for Time Series in Healthcare

Abstract: Time series data underpin nearly every aspect of modern healthcare, from continuous monitoring in the ICU to longitudinal signals from wearable sensors. Yet most machine learning models in this domain either assume shared dynamics across highly heterogeneous populations or are designed at the individual level, requiring sufficient personal data before meaningful predictions can be made. Our analyses across multiple ICU and wearable cohorts reveal substantial heterogeneity within and across subpopulations. This talk will argue that one way to address this heterogeneity while still pursuing the vision of foundation models for temporal health data, lies in learning dynamic subgroup-level embeddings: representations that can adapt across individuals, time scales, and data modalities. I will present our recent progress toward this goal, including a nonparametric Bayesian approach. These efforts aim to create a new wave of adaptive time series models capable of supporting individualized healthcare on time and at scale.

Daniel McDuff

Foundation Models & Agentic AI that Supports Healthy Living

Abstract: A new era of wearable foundation models that capture rich information about behavior and physiology present the opportunity to discover novel biomarkers of disease and forecast health states into the future. These models, combined with Personal Health Agents, built using agentic AI, will provide new opportunities for people to interface with these data, learn about them in a personalized way, and make healthy choices. In this talk I will present several of our latest projects that bridge these topics.

Causal Modeling, Neuroscience, Genomics

Abstract: TBD.

Foundation Models for Structured Electronic Health Record Data

Abstract: In the past two years, we've seen the emergence of zero-shot capable foundation models for EHR data, including models like ETHOS, CEHR-GPT, and COMET. In this talk, I'll discuss this advancement, including the key innovations that led to these models (and some of the great ideas that didn't), the major problems and questions they face, their potential clinical utility, and where the field may go next.

Jaya Narain

Data Efficient and Domain-Driven Representations with Sensors and Speech

Abstract: Learning robust embedding can help create reliable models in challenging data-scarce situations. Methods that allow utilizing embedding from pre-trained models across tasks and modalities can be particularly impactful in time series domains, where labeled data is often limited. In this talk, I present several recent projects towards training and characterizing the use of foundation models for time series signals — including selecting signal-rich labels to use embeddings from public models for speech characterizations and related fairness considerations for atypical speech, sharing embeddings across speech and wearable sensor signals, and leveraging contextual knowledge from LLMs for multi-modal fusion.

Wearables and Mobile Health, Sensor Hardware

Abstract: TBD.