Handwritten equation detection in disconnected, low-cost mobile devices

Everton Souza, Ermesson L. dos Santos, Luiz Rodrigues, Daniel Rosa, Filipe Cordeiro, Cicero Pereira, Sergio Chevtchenko, Ruan Carvalho, Thales Vieira, Marcelo Marinho, Diego Dermeval, Ig Ibert Bittencourt, Seiji Isotani, Valmir Macario

Research output: Chapter in Book / Conference PaperConference Paperpeer-review

Abstract

Artificial Intelligence in Education (AIED) implementation in underserved regions faces challenges due to limited digital infrastructure, such as restricted device and internet access. A solution to these challenges lies in AIED Unplugged, a framework designed to address these challenges by tailoring AI solutions to the specific issues prevalent in such regions. AIED Unplugged incorporates principles like Conformity, Disconnect, Proxy, Multi-User, and Unskillfulness, ensuring accessibility by aligning with existing infrastructure, operating offline, simplifying interfaces, and accommodating users' digital skills. Particularly, the framework leverages computer vision to digitalize students' activities and enable AIED-based learning on disconnected, low-cost devices, wherein object detection is crucial to identify which solution areas to digitalize. However, prior research has not assessed the technical feasibility of such applications in the context of AIED unplugged for math education. Therefore, this paper addresses the intersection of "conformity" and "disconnected" principles with an empirical analysis of handwritten equation detection on disconnected, low-cost mobile devices. By optimizing state-of-the-art algorithms for offline inference and considering device constraints, we utilize a dataset of student equations, explore YOLOv8 models, and evaluate its predictive performance. The trained model is converted to Tensorflow Lite for mobile deployment, and a testbed application assesses inference times on diverse low-cost devices, contributing valuable empirical insights to the intersection of AIED Unplugged, Computer Vision, and Education in underserved regions.
Original languageEnglish
Title of host publicationArtificial Intelligence in Education
Subtitle of host publicationPosters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky, 25th International Conference, AIED 2024, Recife, Brazil, July 8-12, 2024. Proceedings, Part II
EditorsAndrew M. Olney, Irene-Angelica Chounta, Zitao Liu, Olga C. Santos, Ig Ibert Bittencourt
Place of PublicationSwitzerland
PublisherSpringer Nature
Pages132-139
Number of pages8
ISBN (Electronic)9783031643125
ISBN (Print)9783031643118
DOIs
Publication statusPublished - 2024
Event25th International Conference on Artificial Intelligence in Education, AIED 2024 - Recife, Brazil
Duration: 8 Jul 202412 Jul 2024

Publication series

NameCommunications in Computer and Information Science
Volume2151
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference25th International Conference on Artificial Intelligence in Education, AIED 2024
Country/TerritoryBrazil
CityRecife
Period8/07/2412/07/24

Keywords

  • Computer Vision
  • Mobile
  • Object Detection
  • Unplugged
  • YOLO

Fingerprint

Dive into the research topics of 'Handwritten equation detection in disconnected, low-cost mobile devices'. Together they form a unique fingerprint.

Cite this