Tag Archives: Skepticism

Awareness of Awareness Statistics

Leave a reply

I often talk about how we can become better consumers of information. One subtle way that information is often presented in a misleading manner is through what I will call “awareness statistics.” These statistics inform you about the number of people who “know of someone” who knows someone.

You hear these awareness statistics all the time. You hear that x of every y people know someone who has suffered from cancer, or abuse, or gun violence, or sexism, or ageism, or police brutality, or has been unfairly profiled, or has been burgled, or who uses personal pronouns.

While all of these issues I cited as examples are real and are important, drawing conclusions – both qualitative and quantitative – from these kind of awareness statistics can be very misleading. Worse, these kind of statistics are often intended to mislead, to exaggerate, and to induce a heightened reaction.

In very rare situations, awareness statistics can be legitimate. They can tell us how deeply a particular narrative has seeped into a population. It can tell us how many people are aware of a particular issue.

But that is not generally, or even often, the point of these statistics. Typically the point of citing such statistics is to serve as a surrogate for direct measurement. Rather than directly reporting the number of people who have been injured in motorcycle accidents, we report how many people know of someone who has been injured in a motorcycle accident. The intent is not to measure mere awareness, but to convey an impression of actual accident frequency.

The underlying problem is that awareness relationships in a population are extremely complex, highly uneven, and skewed. Some few people have many more relationships than others. We simply cannot correlate “awareness” with actual frequency in any straight-forward manner. If Britney Spears tweets about her bad hair day, millions of people know of someone who had a bad hair day. If Nicki Minaj tweets about her friend’s testicular reaction to the Covid vaccine, tens of millions of people “know someone” who had a terrible reaction to the vaccine.

Consider the example of sexual behavior. Experts strongly suspect that a relatively few men have relationships with a much larger number of women. No one knows the exact numbers, but let’s just make up some to illustrate. Let’s say that 1 guy has affairs with 10 women during a period of time. Each woman tends to share this information with 5 close friends. Now, when surveyed, 50 women report that they “know of someone” who has had an affair. It sounds like lots of guys are having affairs, but it’s really just that one really horny studmuffin. Most women are led to believe that lots of guys are having affairs and most of the guys are wondering why they are such losers at love.

So how should we assimilate such awareness statistics?

First, You should be skeptical whenever you hear awareness statistics. Actively skeptical. It is not enough that you merely be aware of their limitations, because they can still be successful in creating a lasting misleading impression despite your academic skepticism. You must not only be aware of their limitations, but actively suspicious of them.

You should always ask whether awareness statistics are being presented simply because we cannot measure the actual number directly. If that is the case, you should consider this to be no more than a very unreliable indicator.

But if awareness statistics are being presented despite the fact that the actual number can be directly measured, then you should assume that the intent is to manipulate your reaction. If advocates report that 2.5 million people know someone who knows someone who has been murdered, that sounds far more alarming then saying there were 1000 murders committed. It is their intent to alarm you when the raw numbers are insufficiently alarming.

Finally, resist the urge to accept statistical exaggerations when you support the cause and even when you think people need to be more alarmed. The problem is that the other side can play the same game. Anything you can exaggerate with awareness statistics, they can exaggerate just as easily. Sixty-five million people know someone who has been a victimized by cancel culture and 27 million people know of someone who was saved by a hero with a handgun.

Stay true to real facts. Don’t be swayed by manipulative statistics – especially when you believe in your heart that some exaggeration is warranted. After all, over 45 million people know of someone who knows someone who has been a victim of awareness statistics.

Better yet, just don’t use them at all unless you are a sophisticated demographer.

Would you Buy a Used Car from this Guy?

Leave a reply

Used Car SalesmanWhen someone makes a claim, how do you decide whether to accept it or to reject it? Ideally you make an independent assessment of the truth of the claim. But that assessment must necessarily factor in, and factor in quite heavily, the character of the person making the claim. Do they have legitimate knowledge regarding the claim, do they have ulterior motives to misrepresent their claim, and do they have a history of making false and misleading claims?

If any such character questions fail, one should be legitimately skeptical of any claim made by that person. As judges in court proceedings often instruct their jury, if a witness is caught in even one lie, it is reasonable to be skeptical of their entire testimony. If enough questions of character arise, then one should be skeptical that even the most legitimate-sounding claim made by that person may simply be “too good to be true.”

The merits of a claim can be misrepresented. Therefore a character assessment must sometimes be factored in even more strongly than our judgement about the merits of an assertion. Conversely, we should seriously consider even doubtful claims from those of high character and a strong record of being correct.

An offer is a kind of a claim. An offer makes an implicit claim that you have something of value to the recipient that you are willing to share. As with any other claim, the decision whether to accept or reject the offer must necessarily consider the character of the person or entity making the offer.

President Trump has made more false claims that one can count. Well, actually someone did count more than 20,000 false and misleading claims just since taking office (see here). Moreover, he has unfailingly demonstrated that he lacks judgment, is completely self-serving, has total disregard for facts and truth, and considers fakery and manipulation to be a high ideals. He lacks any ethical core and even his sanity is in legitimate doubt.

Given his deplorable character and his clear and almost entirely blemished record of deceit, it is truly mind-boggling how anyone can believe anything Mr. Trump says, no matter how plausible it may sound or how much they want it to be true. Gullible people are those who believe false claims, often willfully ignoring the character of even known liars or confidence men making the claims. Anyone who believes anything Mr. Trump says without exceptional external validation is simply gullible.

Similarly, one cannot be criticized for being skeptical regarding any offer made by Mr. Trump or by his Administration. It is unfortunate when public officials pretend to ignore his character when expressing skepticism regarding his policy offers and recommendations. For example, in interviews regarding Trump’s offer to deploy Federal police into cities to deal with rioting, several Mayors have been asked “Would you reject Federal law enforcement assistance if the offer did not come from the Trump Administration?” The question suggests that considering the source of the offer would be somehow “politically motivated.” Those Mayors tend to skirt the character issue completely and give vague answers about how Federal assistance is not needed.

The correct answer, both rationally and politically, should be “Of course I have to consider veracity and motives of the person making any claim or offer, particularly one of such great consequence as this.”

And of course Mr. Trump’s character must influence the reluctance of those Mayors to accept his offer of “assistance.” If the same offer was made by any of our previous Presidents, it might be reasonable to consider it more favorably. Those Mayors might feel far more comfortable in doing so because no other President has demonstrated such an egregious degree of disingenuous lies and manipulations for their own benefit or spite. Coming from any other President, Mayors would have less reason for concern that the offer was politically motivated let alone another step on the road toward the realization of his Dictatorial aspirations. If the offer had come from any other President, those Mayors would have had far less cause to consider that the offer originated from a morally corrupt and even mentally unstable individual.

It is of course unfortunate that even if Donald Trump were to make some claim or offer that is actually truthful and helpful, most sane and ethical people should be rightfully skeptical of it. That is why an individual as fundamentally untrustworthy as Donald Trump should never hold a position of public trust.

 

Studies Show That…

2 Replies

One of the most compelling arguments in support of religion is the totally pragmatic one. What does it matter if religion is false, if god is totally made up, if faith is only a placebo effect, or even if it’s all ultimately just a scam to separate you from your hard-earned money? In the end isn’t all that matters that it makes you happier and more successful?

Reporters and opinion writers propagate this pragmatic justification of religion every day. It is actually difficult to get through any newspaper issue without encountering yet another article or op-ed touting the benefits of religion and faith. Here is an example of the typical kind of happiness claims put out there most every day in popular media:

Research suggests that children who attend church perform better in school, divorce less as adults and commit fewer crimes. Regular church attendees even exhibit less racial prejudice than their nonreligious peers. (see here).

happinessThese articles invariably cite scientific studies and statistics to support their claims. But those claims frequently go far beyond study design or the conclusions made by the scientists involved.

There are many ways that studies are misused by advocates to advance their causes or market their products. So we must all be very savvy when we see broad, sweeping conclusions being supported by narrow scientific studies, particularly by social science studies.

To help you to recognize these manipulations, following are some of the typical falsehoods and distortions used by advocates to misrepresent science or to promote bad science.

Failing to Mention the Negatives
Studies show that chocolate supplies 11 grams of fiber! Wow, maybe we should all eat chocolate to get our fiber! But to get that 11 grams of fiber from chocolate you have to consume a whopping 600 calories. Likewise, studies tout selected admirable ethical qualities of religious people, but fail to mention other studies that show, for example, that religious people are far more likely to support torture, guns, violence, and drone attacks.

Failing to Mention Better Alternatives
Another way advocates misuse studies is by failing to mention far better alternatives. For example, the chocolate industry fails to mention that practically any fruit, vegetable, or grain is a far healthier source of fiber. That may not be their responsibility, but if they are implying that you should eat chocolate in order to get your fiber, they are lying. Likewise, advocates often tout the morality of religious people, implying that religion is the only way to achieve these values. But you don’t need to consume 600 calories to get your fiber and you do not need religion along with all its negative characteristics to be a good person.

Failing to Quantify the Benefits
Advocates will often claim a benefit without quantifying it, thereby giving a false impression of how important it is. For example, religion advocates may cite studies showing that fewer religious people go to prison, without mentioning that this difference is inconsequentially tiny.

Misrepresenting Statistics
Advocates often misrepresent statistics. If they are trying to magnify a small difference they report it as a percentage or ratio. If they are trying to exaggerate a tiny difference in a huge population, they cite the numerical difference.  For example, religion advocates might claim that “secular people are twice as likely to commit suicide as religious ones.” Sounds fantastic right? But this could very well mean that out of a population of 10,000 people, 1 religious person committed suicide and 2 non-religious people committed suicide. Not quite as alarmingly persuasive when presented that way.

Using Bad Indicators
In epidemiology, an indicator is a specific test that can be used to measure a more general condition. But a bad indicator tells one little or nothing about the general trait being evaluated. For example, religious advocates typically conclude that believers are “happier” based upon highly questionable measurements such as divorce rate which have little to do with happiness. As we all know, married people can be far more miserable than divorced ones.

Failing to Prove Causation
Most clinical studies are observational, or association studies. That is, they simply show that two variables are both observed in or associated with a given population. This is valuable information. But proving that those two variables are directly related to each other is quite difficult. Proving causality between one and the other is even more difficult. Even if two things seem to be related, they may be indirectly associated through some third thing called a confounding factor. For example, a study may show that church-goers cheat less on their spouses. That is merely an association. But advocates use that observed association to claim that church attendance promotes ethical behavior even though the researchers themselves never made that claim. However, it may well be that church attendance and marital fidelity are not directly related at all, let alone that church attendance causes fidelity as advocates claim. The most we could say based on the research is that, for whatever reason, people who go to church are also more likely to be people who have fewer affairs. Maybe the reality is that unattractive people tend to go to church in a desperate and futile attempt to start an affair. Attractiveness may the just one confounding factor here. That we cannot determine or even imagine what the confounding factors may be is not proof of causality.

Failing to Consider Reporting Bias
Many of the narrow social studies used to make sweeping claims rely upon self-reporting. However, self-reporting is incredibly unreliable. People intentionally or unintentionally report all kinds of things in all kinds of ways for all kinds of reasons. For example, men are likely to brag about their infidelity while women are likely to conceal it. Self-reports are poor measures of the relative level of infidelity between the sexes. Likewise, religious people are deeply invested in the fiction that religion makes them happier and are very likely to report that they are even if they are totally miserable.

Failure to Mention Study Limitations
Years ago, upon reading commonly cited statistics that “98% of women report incidents of sexual abuse,” radio host Dr. Laura Schlessigner did what a good consumer of information should do. On-air, she called the scientist who conducted the study being referenced to support this claim. The researcher was eager to express her frustration with all of the advocacy groups citing her research without mentioning that her study narrowly targeted an extremely at-risk population. Dr. Laura then called the head of one of those women’s advocacy groups employing this scare-tactic and asked her why she knowingly misrepresented this research. When confronted, the head of the organization stood firm, saying that anything is justified if it raises awareness of real issues faced by women.

Choosing the Wrong Measurement
Even if we could measure happiness, it should not be assumed that happiness is the best or only goal. Believing that  global warming is a hoax probably does make one sleep sounder. Allowing your kids to eat pizza at every meal will probably result in fewer observed food-related tantrums. But clearly these measures of happiness do not justify accepting those positions. Likewise with religion.

Selective Skepticism
We tend to do pretty good at being skeptical about things we disagree with. But when it’s something we’re predispositioned to like and want, like chocolate or religion, we tend to set all skepticism aside and whole-heartedly embrace any arguments in favor, no matter how much of a stretch they may be. The happiness-arguments supporting religion are definitely one area in which our society demonstrates far too little critical scrutiny, as evidenced by the huge number of happiness claims repeated in major publications with virtually no skeptical analysis.

Baby With the Bath Water
Please, please, please don’t conclude from this that you can never trust social studies and that these studies never have any value at all. Association studies are very valuable. We need to know when things are observed together in a given population. However, you should be a smart consumer of these studies and understand the ways that advocates misuse study results to contrive claims that advance their cause. This is particularly important when we are predisposed to believe those claims. When in doubt, look past the claims made by advocates or even by seemingly objective “science reporters” and read the typically more careful and restrained conclusions reported by the scientists who conducted the studies. With the Internet at our fingertips today that is not usually very difficult to do.