TY - GEN
T1 - Handwritten equation detection in disconnected, low-cost mobile devices
AU - Souza, Everton
AU - Santos, Ermesson L. dos
AU - Rodrigues, Luiz
AU - Rosa, Daniel
AU - Cordeiro, Filipe
AU - Pereira, Cicero
AU - Chevtchenko, Sergio
AU - Carvalho, Ruan
AU - Vieira, Thales
AU - Marinho, Marcelo
AU - Dermeval, Diego
AU - Bittencourt, Ig Ibert
AU - Isotani, Seiji
AU - Macario, Valmir
PY - 2024
Y1 - 2024
N2 - Artificial Intelligence in Education (AIED) implementation in underserved regions faces challenges due to limited digital infrastructure, such as restricted device and internet access. A solution to these challenges lies in AIED Unplugged, a framework designed to address these challenges by tailoring AI solutions to the specific issues prevalent in such regions. AIED Unplugged incorporates principles like Conformity, Disconnect, Proxy, Multi-User, and Unskillfulness, ensuring accessibility by aligning with existing infrastructure, operating offline, simplifying interfaces, and accommodating users' digital skills. Particularly, the framework leverages computer vision to digitalize students' activities and enable AIED-based learning on disconnected, low-cost devices, wherein object detection is crucial to identify which solution areas to digitalize. However, prior research has not assessed the technical feasibility of such applications in the context of AIED unplugged for math education. Therefore, this paper addresses the intersection of "conformity" and "disconnected" principles with an empirical analysis of handwritten equation detection on disconnected, low-cost mobile devices. By optimizing state-of-the-art algorithms for offline inference and considering device constraints, we utilize a dataset of student equations, explore YOLOv8 models, and evaluate its predictive performance. The trained model is converted to Tensorflow Lite for mobile deployment, and a testbed application assesses inference times on diverse low-cost devices, contributing valuable empirical insights to the intersection of AIED Unplugged, Computer Vision, and Education in underserved regions.
AB - Artificial Intelligence in Education (AIED) implementation in underserved regions faces challenges due to limited digital infrastructure, such as restricted device and internet access. A solution to these challenges lies in AIED Unplugged, a framework designed to address these challenges by tailoring AI solutions to the specific issues prevalent in such regions. AIED Unplugged incorporates principles like Conformity, Disconnect, Proxy, Multi-User, and Unskillfulness, ensuring accessibility by aligning with existing infrastructure, operating offline, simplifying interfaces, and accommodating users' digital skills. Particularly, the framework leverages computer vision to digitalize students' activities and enable AIED-based learning on disconnected, low-cost devices, wherein object detection is crucial to identify which solution areas to digitalize. However, prior research has not assessed the technical feasibility of such applications in the context of AIED unplugged for math education. Therefore, this paper addresses the intersection of "conformity" and "disconnected" principles with an empirical analysis of handwritten equation detection on disconnected, low-cost mobile devices. By optimizing state-of-the-art algorithms for offline inference and considering device constraints, we utilize a dataset of student equations, explore YOLOv8 models, and evaluate its predictive performance. The trained model is converted to Tensorflow Lite for mobile deployment, and a testbed application assesses inference times on diverse low-cost devices, contributing valuable empirical insights to the intersection of AIED Unplugged, Computer Vision, and Education in underserved regions.
KW - Computer Vision
KW - Mobile
KW - Object Detection
KW - Unplugged
KW - YOLO
UR - http://www.scopus.com/inward/record.url?scp=85199764594&partnerID=8YFLogxK
UR - https://go.openathens.net/redirector/westernsydney.edu.au?url=https://doi.org/10.1007/978-3-031-64312-5_16
U2 - 10.1007/978-3-031-64312-5_16
DO - 10.1007/978-3-031-64312-5_16
M3 - Conference Paper
AN - SCOPUS:85199764594
SN - 9783031643118
T3 - Communications in Computer and Information Science
SP - 132
EP - 139
BT - Artificial Intelligence in Education
A2 - Olney, Andrew M.
A2 - Chounta, Irene-Angelica
A2 - Liu, Zitao
A2 - Santos, Olga C.
A2 - Bittencourt, Ig Ibert
PB - Springer Nature
CY - Switzerland
T2 - 25th International Conference on Artificial Intelligence in Education, AIED 2024
Y2 - 8 July 2024 through 12 July 2024
ER -