Multi-Modal Data

What special considerations are necessary when combining data modes, such as image data, say from MRI along with data from electronic health records or DICOM metadata?