The goal of this study is to capitalizing on recent developments in Deep Learning (DL) applied to medical imaging. Specifically, we aim to (i) identify cartilage, meniscus, bone marrow edema (BEM) and ACL ligament lesions and assess severity providing full knee lesion severity assessment, and (ii) provide a condensed clinical history of patients in an automated manner.