Grade-School Students Teach a Robot to Help Themselves Learn Geometry

NYU, AZ State, and Carleton U. researchers create rTAG, a tangible learning environment that utilizes teachable agent framing, together with a physical robotic agent to get students away from the traditional computer monitor, keyboard, and mouse
     Computer technology has become integral to the learning process. According to the National Center for Education Statistics, at the end of the last decade, some 97 percent of U.S. teachers had one or more computers located in the classroom every day, and the ratio of students to computers in the classroom every day was a little over 5 to 1.  With the advent of tablet and hand-held computing devices, this ratio is fast approaching 1 to 1.
     Up until very recently, mainstream educational software for computing devices in the classroom has been designed based upon a style of interaction utilizing the traditional WIMP (window, icon, menu, pointing device) paradigm.  Student engagement is then an isolated one-on-one experience, individual student to individual machine
     To better engage students with their environment through educational technologies, researchers have begun exploring a variety of solutions that provide more embodied and tangible interactions—ranging from collaborative activities surrounding an interactive tabletop, to interactive robots that teach language learning. 

     “Successful integration of any new technology into the classroom environment requires an understanding of the facilitators for and barriers to deployment,” says Winslow Burleson, PhD, associate professor, New York University Rory Meyers College of Nursing, lead investigator on the study.  “While such technologies are shown to be highly engaging for students and perhaps foster learning in new ways, our research looks at the need to understand the far-reaching utility of these technologies, particularly in classroom settings.”
     In order to examine how the utility of one such solution played out in a classroom setting, Burleson teamed up with researchers from Arizona State University and Carleton University to study the implementation of a tangible learning environment that utilizes teachable agent framing coupled with a physical robotic agent--Robo-Tangible Activities for Geometry (rTAG). 

How it works:
     rTAG projects a Cartesian plane onto a white floor mat, upon which a LEGO® robot named Quinn navigates. An iPod Touch mounted on top of the LEGO® components displays Quinn’s face and outputs its voice, through which it can give affective responses. The iPod also provides the entry point for interacting with Quinn. The final component is the mobile interface, another iPod Touch, held by a student when interacting with the system. 
     To issue a command to Quinn, students must first touch the mounted iPod, which will trigger a popup on the mobile interface, where they can choose from a variety of actions, including: move units, turn and plot point. 
     “Requiring students to touch Quinn’s mounted iPod before every command, ensures they too will move,” says Kasia Muldner, PhD., Assistant Professor, Carleton University.  
     Before using the system, students are told they must help Quinn solve a geometry problem. After plotting the point, students can check if their solution is correct by tapping on the “Check Answer” button on the mobile interface, triggering Quinn’s visual and audio response. 
     To test both the efficacy and feasibility of the rTAG system, the researchers developed a virtual platform called vTAG, encompassing the same features, but all the interactions and actions take place through a regular WIMP-based interface, on a single screen divided into three sections for the plane, Quinn’s face, and command line. Together, the rTAG and vTAG versions form the TAG system.
     Researchers conducted a weeklong study to evaluate the impact of the TAG system in a school setting, inviting teachers from a California public school district to bring their students to one or more sessions. Twelve teachers, from four different schools, took the researchers up on their offer. Classes had 25-40 students, with eight classes from 3rd, three from 4th and one from 5th grade. Sessions were held in a room with one rTAG and three vTAG modules setup.
     To better understand the affordances and limitations of integrating the TAG system within a school setting, researchers analyzed how teachers planned their lessons around the TAG system and how teachers used the rTAG setup, and if it differed from the more common vTAG setup. 
     “From the twelve sessions we held, we found most teachers did not give students an introduction to the TAG system prior to their session, however some chose to impart domain knowledge such as angle and coordinates, ahead of the session” said Cecil Lozano, PhD, Arizona State University.
     In terms of the session introduction, every teacher had their students gather around a specific station, generally a vTAG one, and would explain how the system worked, half of the teachers opted to have a researcher explain the system instead. The only exception to this method was one instance in which a teacher had a “very tech savvy” student man the station while she explained how it worked. After the demonstration teachers would have their students divvy up into groups and rotate around the stations. 

Benefits and Limitations Observed During Implementation: 
     During the experiments, the researchers sought to understand what value teachers placed on the TAG system, and to describe the barriers teachers faced in its implementation. 
     “Student engagement was, by far, perceived as one of the strongest assets of the system,” said Dr. Burleson. “When the time came for students to rotate stations, every time a facilitator asked which group wanted to use the rTAG station next, students would promptly raise their hands. Furthermore, on group rotation, students who didn’t get a chance to interact with Quinn in the rTAG group would loudly express their discontent.” 
     Several teachers perceived the physical robot as a key benefit of the system. One teacher noted her students’ excitement for Quinn fomented a session in which students didn’t even realize they were learning, “they just think they went and played with a robot.” Another teacher noted that personifying Quinn allowed the students the students to relate to it, motivating students to “persist in a problem and to get Quinn where he was supposed to go.” The researchers posit this heightened engagement may be due to a novelty effect, which they anticipate will subside as students grow accustomed to the system. 
     Another common theme among teachers was related to the value of exposing students to technology. 
     “We found many teachers in the school sought students’ proficiency in the use of digital tools,” said Victor Girotto, PhD, Arizona State University. “To them, this was another opportunity of showing their students some of the affordances made possible by technology, possibly making them more proficient in its use, while also leveraging their curiosity.”
     As noted by many teachers, rTAG also allowed students to practice domain-general skills such as critical thinking and problem solving. Teachers usually divided students into smaller, rotating, groups to facilitate collaboration. 
     Generally, when a group used vTAG, however, only those few close to the monitor were engaged, while the rest would just sit back and watch, or wander around the room. On the physical setup, however, more students usually tried to participate together with who was currently using the system. 
     One teacher noted: “I see eight or nine kids jumping in and trying to help, or looking to see if it’s time to touch. It’s just they’re more involved, more willing to maybe offer a solution.” In many rTAG sessions, several students could be seen standing on the foam mat discussing the problem, constantly passing the iPod Touch around and taking turns on who would be interacting with Quinn.
     Given the feedback from the teachers and the twelve class sessions, researchers resolved their reflections on the TAG system to four design recommendations, this includes:
1) target multiple learning objectives, 
2) emphasize the collaborative affordances, 
3) optimize for training, and 
4) innovate the use of known system components.
     “Our findings are in agreement with some previous research, which shows that group experiences appear to foster participation,” remarks Dr. Burleson, “so designers should model systems with tangible and embodied elements which explore their affordances to foster collaboration by design, rather than planning for students to individually use the technology.”
     Researchers also note barriers to rTAG implementation, including lack of time for setup, lack of training for instructors, student intimidation by the rTAG setup, and limitations related to the number of students per station. Specifically, teachers mentioned there were too many students at each station, and particularly prevalent in vTAG stations, some students relegated to a passive viewer role. 
     While the overall interaction with the system may be unusual and requires specific training, the familiarity with some of the system components (iPods) may help to bring down this barrier, as well as possibly reducing apprehension of using it. 
     “This allows schools to reuse technology they already have, detracting from the cost of the unit. Furthermore, students’ familiarity with existing technology allows them to better understand how the system as a whole functions because they are already familiar with its parts,” said Dr. Burleson.

This paper was presented at CHI '16 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems Pages 919-930  ACM New York, NY, USA ©2016 table of contents ISBN: 978-1-4503-3362-7 doi>10.1145/2858036.2858454

Researcher Affiliations: Victor Girotto1, Cecil Lozano1, Kasia Muldner2, Winslow Burleson3, Erin Walker1
1Arizona State University Tempe, AZ, USA  2 Carleton University, Ottawa, Ontario, Canada 3 New York University, New York, NY, USA

Acknowledgements:  The authors would like to thank Elissa Thomas for her help with the data collection, as well as the teachers and administrators of the district. This research was funded by NSF 1249406: EAGER: A Teachable Robot for Mathematics Learning in Middle School Classrooms and by the CAPES Foundation, Ministry of Education of Brazil, Brasília - DF 70040-020, Brazil.
About the NYU Rory Meyers College of Nursing
NYU Rory Meyers College of Nursing is a global leader in nursing education, research, and practice. It offers a Bachelor of Science with a major in Nursing, a Master of Science and Post-Master’s Certificate Programs, a Doctor of Nursing Practice degree and a Doctor of Philosophy in nursing research and theory development.
About the Ira A. Fulton Schools of Engineering
The Ira A. Fulton Schools of Engineering at Arizona State University include nearly 19,000 students and more than 300 faculty members who conduct nearly $100 million in research, spanning a broad range of engineering, construction and technology fields. Across the six schools contained within the Fulton Schools, 24 undergraduate and 32 graduate programs are offered on ASU’s Tempe and Polytechnic campuses and online. The schools’ educational programs emphasize problem solving, entrepreneurship, multidisciplinary interactions, social context and connections. Arizona State University includes more than 80,000 students and 1,600 tenured or tenure-track faculty on multiple campuses in metropolitan Phoenix as well as online.
About Carleton University 
Founded in 1942, Carleton University has grown into a dynamic research and teaching institution with a tradition of anticipating and leading change. The university provides an excellent education and experience to its more than 24,000 full- and part-time students at the undergraduate and graduate levels. Its more than 875 academic staff are recognized internationally for their scholarship and cutting-edge research in more than 50 disciplines.  Carleton’s reputation is built on its strengths in the fields of journalism, public affairs, international affairs, architecture and high technology. Its students benefit from the interdisciplinary, active, hands-on approach to teaching and research practiced by its faculty members and from the numerous partnerships the university has with the federal government, other universities and private sector partners.