arxiv Endowing Language Models with Multimodal Knowledge Graph Representations