We use multimodal perioperative data to forecast patient deterioration. Our models give clinicians the time to intervene and prevent avoidable harm.