2021/10/20 by Chengxi Li, Li, Chengxi, Brent Harrison +1
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
paper · pdf · doi:10.48550/arxiv.2110.10704
openalex publication_date 2021/10/20 · openalex created_date 2021/10/25 · openalex updated_date 2026/07/28
In this paper, we propose to build a stylish image captioning model through a Multi-style Multi modality mechanism (2M). We demonstrate that with 2M, we can build an effective stylish captioner and that multi-references produced by the model can also support explaining the model through identifying erroneous input features on faulty examples. We show how this 2M mechanism can be used to build stylish captioning models and show how these models can be utilized to provide explanations of likely errors in the models.