Letter: Be wary of ‘political’ survey questions

Survey is a worthy initiative but be wary of politically shaped questions and how the results get positioned

Last month one of those coincidences occurred that has interesting, if not immediately obvious implications.

Our council launched the municipality’s first-ever community satisfaction and priorities survey. And McGill University psychologist/neuroscientist Daniel J. Levitin released a new book bearing the delightfully subversive title, A Field Guide to Lies: Critical Thinking in the Information Age.

The connection? Well, Levitin describes his book as helping us “spot problems with the facts you encounter…that may lead you to draw the wrong conclusions,” and “sift through the various claims we hear and to recognize when they contain misinformation, pseudo-facts, distortions, and outright lies.” The problems, he says, arise from a range of issues, including how data is both collected and reported. This is particularly critical when looking at “topics that are highly politicized.”

And that’s where the Oak Bay survey comes in. Most of the online survey comprises straightforward and useful questions about community concerns, and service and information satisfaction levels. It only runs into trouble when it veers into a set of questions that appear to have been driven primarily by political considerations.

As Levitin says, “how something is defined or categorized can make a big difference in the statistic you end up with.”

Take the question about creating a “dog park.” It doesn’t define what a “dog park” involves, and then suggests that it would likely entail purchasing property, without explaining why.

Or the questions about deer, which immediately plunge into whether there’s an “overpopulation,” without defining that term, or first exploring community values around wildlife. (Full disclosure, I’m married to the president of the Urban Wildlife Stewardship Society, but not a member or participant).

If you answer “no,” you’re jumped over questions about your willingness to pay an increase in taxes to “reduce the deer population,” and whether you support a deer cull.

The latter question also hinges on a cull being the “only option available” (it isn’t) and being “humane” (the BCSPCA is already on record as “strongly” opposing Oak Bay’s approach to deer culls).

Given such shaky foundations, it’s hard to see how valid results could emerge or useful conclusions be drawn from these questions.

And then there’s the questions about balancing tax increases with services and the funding of future projects. Stripped of the choices and trade-offs that could be involved, they are devoid of real meaning.

Unfortunately, these suffer from the same kind of “political sculpting” as the 2014 Oak Bay amalgamation ballot question, where residents were asked, without any substantive community discussion or information, whether they would be willing to take a leap into “being amalgamated into a larger regional municipality.” While more than 60 per cent quite reasonably said “no” under those conditions, nearly 40 per cent said “yes.” That might suggest there’s a high level of interest in further exploring the issue, rather than that it has now been “settled.”

Overall, a community satisfaction and priorities survey is a worthy initiative and council deserves kudos for taking a step toward greater accountability to its electors. Oak Bay residents, however, should be wary of the handful of politically shaped questions it contains, and how the results get positioned and used.

As Levitin says, “If a statistic is composed of a series of poorly defined measures, guesses, misunderstandings, oversimplifications, mismeasurements, or flawed estimates, the resulting conclusions will be flawed.”

Bruce Kilpatrick

Oak Bay

Bruce Kilpatrick is a communications professional and 35-year Oak Bay resident. He’s been a volunteer board member for community organizations and a youth soccer and baseball coach.

 

 

Just Posted

West Shore RCMP K9 Halla. (Black Press Media file photo)
Sound of RCMP dog enough to stop suspects in Oak Bay

West Shore RCMP K9 unit called in, didn’t get to chase

A patio built by The Village is shared by three eateries in Estevan. (Christine van Reeuwyk/News Staff)
Oak Bay eateries sharing communal patio space in Estevan Village

The Village invested $25,000 in streetside patio, hopes to make it permanent

Improving safety at Keating Cross Road and the Pat Bay Highway is the goal of the flyover project currently in the works. The province aims to reveal the final cost and design this fall. (Screencap/Ministry of Transportation and Infrastructure)
Final budget, design of Keating flyover in Central Saanich still in the works

Ministry of Transportation and Infrastructure says information coming by this fall

Proposed design for the Topaz Park bike and skate park elements. (Courtesy City of Victoria)
Victoria requesting feedback on Topaz Park redesign

Public input now being taken for proposed skate, bike park ideas

Colin Davidson won $100K on a Set for Life scratch ticket in Sooke. (BCLC photo)
Sooke man does ‘happy dance’ after scratching a $100,000 Set for Life win

Colin Davidson plans to renovate his home and invest in his daughter’s education

People watch a car burn during a riot following game 7 of the NHL Stanley Cup final in downtown Vancouver, B.C., in this June 15, 2011 photo. THE CANADIAN PRESS/Geoff Howe
10 years ago: Where were you during the 2011 Vancouver Stanley Cup Riots?

Smashed-in storefronts, looting, garbage can fires and overturned cars some of the damage remembered today

Ivy was thrown out of a moving vehicle in Kelowna. Her tail was severely injured and will be amputated. (BC SPCA)
Kitten thrown from moving vehicle, needs help: Kelowna SPCA

The seven-week-old kitten had severe tail and femur injuries

There is an emergency shelter near the Golden Ears peaks. (Facebook/Special to The News)
Hiker fogged in on Golden Ears, spends 2 nights

Talon Helicopters, Ridge Meadows Search and Rescue bring him home Monday

Annamie Paul, leader of the Green Party of Canada, speaks at a news conference on Parliament Hill in Ottawa, on June 10, 2021. THE CANADIAN PRESS/Justin Tang
Green Leader Annamie Paul facing no-confidence motion from party brass

move follows months of internal strife and the defection of MP Jenica Atwin to the Liberals

Tulips bloom in front of the Supreme Court of Canada in Ottawa, Thursday, May 10, 2018. Day two of a full week of scheduled hearings will be heard in Federal Court today on a case involving Indigenous children unnecessarily taken into foster care by what all parties call Canada’s “broken child welfare system.” THE CANADIAN PRESS/Sean Kilpatrick
AFN slams Ottawa for ‘heartless’ legal challenge of First Nations child compensation

2019 decision awarded $40,000 to each Indigenous child removed before 2006

Rick Ruppenthal of Saltair will host a 12-hour talk-a-thon Friday, June 18 over Facebook live. (Photo submitted)
Talk-a-thon to focus on men’s mental health issues

Island man spearheading a campaign to generate more conversation during fundraiser

The Canadian Anti-Fraud Centre estimates that less than five per cent of mass-marketing fraud is ever reported.
Tips to avoid scams targeting Vancouver Island seniors

In most cases, fraudsters impersonate an individual, business or agency seniors recognize and trust

Vancouver courthouse. (Photo: Tom Zytaruk)
Man loses bid to appeal conviction for 1999 rape at Abbotsford music festival

James Redden, 53, formerly of Nanaimo, was found guilty in 2019 following six-day trial

A health-care worker holds up a sign signalling she needs more COVID-19 vaccines at the ‘hockey hub’ mass vaccination facility at the CAA Centre during the COVID-19 pandemic in Brampton, Ont., on Friday, June 4, 2021. This NHL-sized hockey rink is one of CanadaÕs largest vaccination centres. THE CANADIAN PRESS/Nathan Denette
‘Vaxxed to the max’: Feds launch Ask an Expert campaign to encourage COVID shots

Survey shows that confidence in vaccines has risen this spring

Most Read