Lightning Talk: Bridging the Gap: Engineering Compliant... Muhammad Saqib Hussain & Mohaddisa Maryam

This talk features Muhammad Saqib Hussain and Mohaddisa Maryam from Neurosonic, focusing on creating compliant "Glass Box" medical AI using PyTorch. They discuss the challenges posed by the EU AI Act, which categorizes medical AI as high-risk and necessitates transparency and auditability in deployment. The session presents a "Clinical Auditing System" that transforms opaque deep learning models into interpretable systems, showcasing a workflow that traces predictions back to EEG spectral signatures. Key technical elements include implementing IntegratedGradients for model verification and a demonstration of cross-modal reasoning that connects 4D fMRI data to 1D EEG frequency bands, making this presentation essential for developers looking to ensure regulatory compliance in healthcare applications.