Skip to main navigation Skip to search Skip to main content

An optimization approach for elementary school handwritten mathematical expression recognition

  • Sergio F. Chevtchenko
  • , Ruan Carvalho
  • , Luiz Rodrigues
  • , Everton Souza
  • , Daniel Rosa
  • , Filipe Cordeiro
  • , Cicero Pereira
  • , Thales Vieira
  • , Marcelo Marinho
  • , Diego Dermeval
  • , Ig Ibert Bittencourt
  • , Seiji Isotani
  • , Valmir Macario

Research output: Chapter in Book / Conference PaperChapterpeer-review

2 Citations (Scopus)

Abstract

This study introduces a novel approach to Handwritten Mathematical Expression Recognition (HMER), focusing on elementary school mathematical expressions. Recognizing the challenges posed by limited training data and the unique characteristics of elementary students' handwriting, we present a multiobjective optimization method tailored for small training datasets. We employ state-of-the-art HMER methods, including transformer-based and attention mechanism models, and optimize them using a custom dataset comprised of elementary school arithmetic equations. This dataset contains 1237 images and includes both horizontal and vertical equations and isolated numbers, featuring common errors in children's handwriting. Additional similar datasets are also leveraged for training augmentation. Our experimental results demonstrate the efficacy of the optimization approach, significantly improving the performance of the evaluated models in terms of expression recognition rate and inference speed. This study contributes to the field of HMER by providing an effective optimization approach for SOTA models and by introducing a specialized dataset for elementary school mathematics. The dataset is available upon request.
Original languageEnglish
Title of host publicationArtificial Intelligence in Education, Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky, 25th International Conference, AIED 2024, Recife, Brazil, July 8-12, 2024, Proceedings, Part II
EditorsAndrew M. Olney, Irene-Angelica Chounta, Zitao Liu, Olga C. Santos, Ig Ibert Bittencourt
Place of PublicationSwitzerland
PublisherSpringer
Pages234-241
Number of pages8
ISBN (Electronic)9783031643125
ISBN (Print)9783031643118
DOIs
Publication statusPublished - 2024

Publication series

NameCommunications in Computer and Information Science
Volume2151 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Keywords

  • Deep Learning
  • HMER
  • Optimization

Fingerprint

Dive into the research topics of 'An optimization approach for elementary school handwritten mathematical expression recognition'. Together they form a unique fingerprint.

Cite this