A Gesture-Based System Puts AI in the Classroom

0 3 minutes read

This article is part of the exclusive IEEE Magazine Monitoring Series In partnership with IEEE XPLORE.

As long as the classrooms are present, the students “T’s” crossed and mixed “I’s” on paper using pens, pencils or paint. But a group of researchers in Taiwan imagines a completely different approach to learning via the AI account.

The platform allows students to draw the handwriting and artworks in the air with their fingers, while the movement that follows the movement displays their writings on the computer screen at the front of the semester. The approach, described in a study published on April 10 in IEEE Canadian Journal of Electrical and Computer EngineeringTeachers can help more efficiently manage and educate large groups of students-for example, by the ability to see results in the actual time for students to work on a large screen simultaneously.

Liang-Bi Chen Associate Professor and Head of the Department of Computer Science and Information Engineering at Penghu National University of Science and Technology, in Magong, Taiwan. It indicates that there are many different challenges that can hinder the efficiency of teaching in the classroom, especially since individual teachers become responsible for larger numbers of students.

“these [challenges] “The limited interaction includes teachers and students, and students who are struggling to understand the content of the lesson in the actual time,” says Chen.

AI tools for education

The new system suggested by Chen and its colleagues can help address all these issues. Each student is equipped with a device that contains a screen and a web camera, which can be able to track 21 different common points of hand via a Medipipe. The artificial intelligence model determines the specified hand gestures and learn when users want to switch conditions (for example, by switching from writing to color choice). The work of the individual student appears on the screen in front of them, but it can also be transferred to the larger screen at the front of the classroom.

Students raise their fingerTo enter the “drawing mode” and grip their grip when they want to determine a different color. If the system discovers the movement of the finger towards the virtual menu area on the edge of the fabric, it leads to the operation of the menu operations. Since every student makes manual suggestions in the air, virtual writing or his art is on a large screen at the front of the semester.

https://www.youtube.com/watch?IEEE SECTRUM/YouTube

“The teacher receives video results and actual time drawing from each student, which is combined and displayed on a large screen to facilitate the teaching and simultaneous interaction,” Chen explains, adding that the results of students writing are automatically loaded on a cloud platform, allowing the handwriting rating after separation as well.

In their study, Chen and his colleagues explore the accuracy of the system-which means its ability to track the video data constantly and accurately captured by the end of students-where they are used by more and more students at the same time. The results show that the system performs 100 percent accurately when it is used between 5 and 10 program students. This accuracy decreased to 96 percent when 30 students used it at once. But in general, Chen says these results show “a strong and viable performance in actual time, making it completely suitable for practical classroom applications.”

Chen notes that the total cost of the system is low, by about $ 6,250 for 30 students, and will circumvent the need to buy classroom supplies routinely. He adds that the touch -free system also enhances better hygiene in the semester.

Chen says that the current system restrictions are that the time of its response is gradually decreasing with the increase in the number of users. It is also limited to virtual writing and drawing features, but his team works to develop more interactive educational functions, such as tests or group discussions.

The researchers have pirate the system and are looking to cooperate with educational institutions or manufacturers of devices to present it to schools in Taiwan. They are looking to build on the system and its functions, for example by developing automated registration systems and learn about the expression of the face to assess the attention of students.

“We believe that education is one of the most promising areas of digital transformation,” Chen says. “Our goal is to constantly improve this system and promote it, making sure that every child has access to a safe, interactive educational environment at reasonable prices.”

From your site articles

Related articles about the web