App promotes interaction for children on autism spectrum

Games help players remember faces and recognize emotions

Jon Bowman

Jon Bowman

A weekend cram session in an Oak Bay house hammered the final nails in seven years of programming for a social tablet app to help children on the autism spectrum.

The scrapbook app Let’s Face It was developed by the University of Victoria’s Centre for Autism Research Technology Education (CARTE).

“Our goal is to develop cutting-edge tools and technology to help children on the autism spectrum and their families in their everyday lives,” said lead James Tanaka, a professor of psychology at UVic. “What we wanted to do is develop an app to work on their face recognition skills.”

The educational games app is a culmination of seven years of UVic work, during which Tanaka garnered input from student volunteers and community members, including high schoolers and those on the autism spectrum.

“We started developing it before the iPad was introduced,” Tanaka said.

While the science is Tanaka’s bailiwick, the programming came down to volunteer time from psychology and computer science students like Jon Bowen. Tanaka also introduced the perfect inspiration for students: food and competition.

“We would have Saturday hack-a-thons,” Bowen said. “We did it for fun and for sushi.”

The two-day culmination, he added, “was fun.”

“The final push, we rented a house in Oak Bay for the weekend and did a 48-hour intensive,” Tanaka said.

The iPad app allows those with Autism Spectrum Disorder to make an interactive album of faces and names. It also has  science-based games that train facial recognition through interactive play.

“Our innovative twist is their using faces from their everyday lives,” Tanaka said.

Bowen, a recent UVic grad and software developer on the iPad app, passes the tablet around the table to snap a series of selfies – an activity he and Tanaka are clearly familiar with. Bowen takes a still selfie, then a short video showing his go-to “surprised” face. Tanaka opts for a smile, no smile, smile for his video clip. The still and video clip selfies – a skill most everyone possesses these days Tanaka noted – translate to an album on the tablet. Bowen labels them with corresponding names and begins the Name Game – simply selecting the name that correctly correlates to the face. A second similar game connects the emotions with those displayed on the faces. A third game, Fuse, slices the images in half with the eyes atop and the mouth below, challenging the user to find, for example, the surprised eyes and happy mouth then fusing the image.

Then there’s Splash.

The pinnacle.

They worked hard to employ the same principles that see people spend ample time with games such as CandyCrush and Angry Birds, said Bowen. “We spent a very long time on Splash but it’s by far our most polished.”

It features a series of levels and various games that feature the same photo album but also offer more of the play aspect.

Among the benefits of this app, Tanaka said, is the way the games encourage social interaction, rather than solitary play.

“It’s a social app. It really encourages people to interact and add their faces, and their friends’ faces,” Tanaka said. “I use it to learn the names of students in my class. It has uses beyond those in the autism spectrum.”

Calling on the idea of flash cards, Bowen brings up his album of wild mushroom images each correctly labeled. Students can use it as an effective tool for studying biology, fine arts, psychology and virtually any subject that involves visual images.

“It is a selfie culture and I hope our app will be adopted by anyone who finds it useful,” Tanaka said. “Parents and educators can create their own storybook from people and objects in their children’s lives.”

Let’s Face It is free on iTunes.

Get local stories you won't find anywhere else right to your inbox.
Sign up here

Just Posted

(Black Press Media file photo)
Court-registered sex offender arrested for breach of parole in Langford

Cameron Ratelle returned to correctional facility after female youth approached at bus stop

Jerry Dyck plans to purchase a new RV to drive across Canada in, once it’s safe to travel again. (Courtesy BCLC)
Victoria man plans post-pandemic cross-Canada RV trip after $2M lottery win

Retired electrician bought the winning ticket in Duncan

Marc Porpaczy said he’s glad he delayed his daily walk with his dog, Juno, after a car crashed just outside his driveway just before 8 p.m. on Tuesday, Jan. 25. (Aaron Guillen/News Staff)
VIDEO: Dramatic crash highlights need for sidewalks, say Colwood residents

‘The residents have gone from frustrated to angry’

Crews with Discovery Channel film as an Aggressive Towing driver moves a Grumman S2F Tracker aircraft around a 90-degree turn from its compound and onto the road on Saturday, Jan. 23, 2021. It was the “most difficult” part of the move for the airplane, one organizer said. (Jenna Hauck/ Chilliwack Progress)
VIDEO: Vintage military plane gets towed from Chilliwack to Greater Victoria

Grumman CP-121 Tracker’s eventual home the British Columbia Aviation Museum on Vancouver Island

Residents of the Cowichan Valley decorated more than 55 vehicles with anti-racist slogans for a car rally in support of Cowichan Tribes on Saturday, January 24. (Kevin Rothbauer/Citizen)
Dozens join anti-racism car rally and virtual panel in Cowichan Valley

Provincial ministry and BC Green caucus issue joint statement detailing concerns

Jesse Savidant, 31, is wanted by the RCMP after failing to appear in provincial court in Nanaimo in December. Police warn Savidant should be considered violent. (Photo Submitted)
Warrant out for man accused of stolen property offences across Vancouver Island

Jesse Savidant did not appear for court date in Nanaimo last month, say RCMP

Rolling seven-day average of cases by B.C. health authority to Jan. 21. Fraser Health in purple, Vancouver Coastal red, Interior Health orange, Northern Health green and Vancouver Island blue. (B.C. Centre for Disease Control)
2nd COVID vaccine doses on hold as B.C. delivery delayed again

New COVID-19 cases slowing in Fraser Health region

The Pacific Rim National Park Reserve is urging visitors to stay on designated trails after a hiker became injured in an unsanctioned area last week. (Westerly file photo)
Injured hiker rescued in Pacific Rim National Park Reserve

“Safety is everyone’s responsibility.”

Provincial health officer Dr. Bonnie Henry talk about the next steps in B.C.’s COVID-19 Immunization Plan during a press conference at Legislature in Victoria, B.C., on Friday, January 22, 2021. Two more cases of the COVID-19 strain first identified in South Africa have been diagnosed in British Columbia, bringing the total to three as of Jan. 16.THE CANADIAN PRESS/Chad Hipolito
B.C. now has three cases of South African COVID-19 variant, six of U.K. strain

Both variants are thought to spread faster than earlier strains

Rodney and Ekaterina Baker in an undated photo from social media. The couple has been ticketed and charged under the Yukon’s <em>Civil Emergency Measures Act</em> for breaking isolation requirements in order to sneak into a vaccine clinic and receive Moderna vaccine doses in Beaver Creek. (Facebook/Submitted)
Great Canadian Gaming CEO resigns after being accused of sneaking into Yukon for vaccine

Rod Baker and Ekaterina Baker were charged with two CEMA violations each

Police discovered a makeshift nightclub in a Vancouver apartment on Jan. 23, 2021, and say it wasn’t the first time this month officers have been called to the unit over social gathering concerns. (Phil McLachlan - Capital News)
Doorman of makeshift ‘booze-can’ in Vancouver apartment fined; police look to court order

This marks the fourth complaint about social gatherings inside the apartment in January

Local musician and artist Daisy Melville created a watercolour portrait of U.S. Senator Bernie Sanders from the recent American inauguration, and with help from her mom, is now selling t-shirts and more with funds going to the Comox Valley Food Bank. Image submitted
Island artist turns Sanders inauguration meme into art for good

All proceeds from the sale of shirts, sweaters and more will go to the Comox Valley Food Bank

Most Read