Multimodal Mathematical Expressions Recognition: Case of Speech and HandwritingReport as inadecuate




Multimodal Mathematical Expressions Recognition: Case of Speech and Handwriting - Download this document for free, or read online. Document in PDF available to download.

1 irccyn-ivc IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes 2 LIUM - Laboratoire d-Informatique de l-Université du Maine

Abstract : In this work, we propose to combine two modalities, handwriting and speech, to build a mathematical expression recognition system. Based on two sub-systems which process each modality, we explore various fusion methods to resolve ambiguities which naturally occur independently. The results that are reported on the HAMEX bimodal database show an improvement with respect to a mono-modal based system.

Keywords : Multimodality graphical languages data fusion handwriting speech





Author: Sofiane Medjkoune - Harold Mouchère - Petitrenaud Simon - Christian Viard-Gaudin -

Source: https://hal.archives-ouvertes.fr/



DOWNLOAD PDF




Related documents