Letter: Be wary of ‘political’ survey questions

Survey is a worthy initiative but be wary of politically shaped questions and how the results get positioned

Last month one of those coincidences occurred that has interesting, if not immediately obvious implications.

Our council launched the municipality’s first-ever community satisfaction and priorities survey. And McGill University psychologist/neuroscientist Daniel J. Levitin released a new book bearing the delightfully subversive title, A Field Guide to Lies: Critical Thinking in the Information Age.

The connection? Well, Levitin describes his book as helping us “spot problems with the facts you encounter…that may lead you to draw the wrong conclusions,” and “sift through the various claims we hear and to recognize when they contain misinformation, pseudo-facts, distortions, and outright lies.” The problems, he says, arise from a range of issues, including how data is both collected and reported. This is particularly critical when looking at “topics that are highly politicized.”

And that’s where the Oak Bay survey comes in. Most of the online survey comprises straightforward and useful questions about community concerns, and service and information satisfaction levels. It only runs into trouble when it veers into a set of questions that appear to have been driven primarily by political considerations.

As Levitin says, “how something is defined or categorized can make a big difference in the statistic you end up with.”

Take the question about creating a “dog park.” It doesn’t define what a “dog park” involves, and then suggests that it would likely entail purchasing property, without explaining why.

Or the questions about deer, which immediately plunge into whether there’s an “overpopulation,” without defining that term, or first exploring community values around wildlife. (Full disclosure, I’m married to the president of the Urban Wildlife Stewardship Society, but not a member or participant).

If you answer “no,” you’re jumped over questions about your willingness to pay an increase in taxes to “reduce the deer population,” and whether you support a deer cull.

The latter question also hinges on a cull being the “only option available” (it isn’t) and being “humane” (the BCSPCA is already on record as “strongly” opposing Oak Bay’s approach to deer culls).

Given such shaky foundations, it’s hard to see how valid results could emerge or useful conclusions be drawn from these questions.

And then there’s the questions about balancing tax increases with services and the funding of future projects. Stripped of the choices and trade-offs that could be involved, they are devoid of real meaning.

Unfortunately, these suffer from the same kind of “political sculpting” as the 2014 Oak Bay amalgamation ballot question, where residents were asked, without any substantive community discussion or information, whether they would be willing to take a leap into “being amalgamated into a larger regional municipality.” While more than 60 per cent quite reasonably said “no” under those conditions, nearly 40 per cent said “yes.” That might suggest there’s a high level of interest in further exploring the issue, rather than that it has now been “settled.”

Overall, a community satisfaction and priorities survey is a worthy initiative and council deserves kudos for taking a step toward greater accountability to its electors. Oak Bay residents, however, should be wary of the handful of politically shaped questions it contains, and how the results get positioned and used.

As Levitin says, “If a statistic is composed of a series of poorly defined measures, guesses, misunderstandings, oversimplifications, mismeasurements, or flawed estimates, the resulting conclusions will be flawed.”

Bruce Kilpatrick

Oak Bay

Bruce Kilpatrick is a communications professional and 35-year Oak Bay resident. He’s been a volunteer board member for community organizations and a youth soccer and baseball coach.

 

 

Get local stories you won't find anywhere else right to your inbox.
Sign up here

Just Posted

Cindy Foggit plays the lead role of Eliza in Passion and Performance’s film production Eliza: An Adaption of a Christmas Carol. (Courtesy of Rachel Paish)
Victoria adult dance studio releases modern adaption of A Christmas Carol

Instead of usual stage performance, dance studio turns to film

Willow, a kitten belonging to a Victoria family, was rescued by firefighters on Thursday after she got stuck in a basement drain pipe. (City of Victoria/Twitter)
Victoria kitten stuck in basement drain pipe rescued by firefighters

Willow the cat on the mend, owner feeling ‘enormous gratitude’

(Black Press Media file photo)
Blue-green algae bloom confirmed in Elk Lake, water-based activities not recommended

Blue-green algae can be lethal to dogs, cause health issues for humans

Victoria police arrested a man Jan. 15 after he rammed his minivan into an occupied police vehicle. (Black Press Media file photo)
Victoria man arrested for ramming minivan into occupied police vehicle

Man caught after fleeing, crashing into cement retaining wall

Mayor Rob Martin and Costa Canna president Phil Floucault cut the ribbon on Colwood’s first cannabis retail store. (Jane Skrypnek/News Staff)
Cowichan Tribes’ Costa Canna cannabis store opens in Colwood

Cowichan Tribes has one-year deal to grow, sell cannabis

Keith the curious kitten is seen on Nov. 4, 2020 at the Chilliwack SPCA. Friday, Jan. 22, 2021 is Answer Your Cat’s Questions Day. (Jenna Hauck/ Chilliwack Progress file)
Unofficial holidays: Here’s what people are celebrating for the week of Jan. 17 to 23

Answer Your Cat’s Questions Day, Pie Day and International Sweatpants Day are all coming up this week

(Phil McLachlan - Capital News)
‘Targeted’ shooting in Coquitlam leaves woman in hospital

The woman suffered non-life threatening injuries in what police believe to be a targeted shooting Saturday morning

JaHyung Lee, “Canada’s oldest senior” at 110 years old, received his first dose of the COVID-19 vaccine on Thursday, Jan. 14, 2021. He lives at Amenida Seniors Community in Newton. (Submitted photo: Amenida Seniors Community)
A unique-looking deer has been visiting a Nanoose Bay property with its mother. (Frieda Van der Ree photo)
A deer with 3 ears? Unique animal routinely visits B.C. property

Experts say interesting look may be result of an injury rather than an odd birth defect

Terry David Mulligan. (Submitted photo)
Podcast: Interview with longtime actor/broadcaster and B.C. resident Terry David Mulligan

Podcast: Talk includes TDM’s RCMP career, radio, TV, wine, Janis Joplin and much more

Chief public health officer Dr. Theresa Tam provides an update on the COVID-19 pandemic in Ottawa on Friday, Jan. 8, 2021. THE CANADIAN PRESS/Sean Kilpatrick
Canada’s top doctor says to avoid non-essential travel as B.C. explores legal options

Premier John Horgan says he is seeking legal advice on whether it can limit interprovincial travel

Seasonal influenza vaccine is administered starting each fall in B.C. and around the world. (Langley Advance Times)
After 30,000 tests, influenza virtually nowhere to be found in B.C.

COVID-19 precautions have eliminated seasonal infection

Lilly and Poppy, two cats owned by Kalmar Cat Hotel ownder Donna Goodenough, both have cerebellAr hypoplasia, a genetic neurological condition that affects their ability to control their muscles and bones. Photo by Alistair Taylor – Campbell River Mirror
VIDEO: Wobbly Cats a riot of flailing legs and paws but bundles of love and joy to their owner

Woman urges others to not fear adopting cats with disabilities

Martin Luther King Jr. addresses the crowd during the march on Washington, D.C., in August of 1963. Courtesy photo
Government reinforces importance of anti-racism act on Black Shirt Day

B.C. Ministers say education “a powerful tool” in the fight for equity and equality

Most Read