Elections Why Were The Polls Wrong Yet Again?

WhiteMousse

Silver Belt
Platinum Member
Joined
Dec 16, 2015
Messages
13,330
Reaction score
14,040
It's probably wishful thinking on my part but I'd like to open an honest discussion about the nature of polls, whether or not they have provided utility in prior elections and why they've seemed to be off for almost a decade.

I understand that we're ultimately looking at a situation in which one of only two predictions are going to be correct. But the Iowa Selzer poll, amidst almost every other that came out in the weeks and months leading up to the election, demonstrate that something is seriously wrong with either the way in which the data is being gathered, or the reception to the prompts for that data.

I myself will not get rustled if you just come in to tell me how stupid I am. Maybe I am stupid. That's the reason I try to learn from different people, and it's the reason I'm making this thread. I'd ask that you be respectful to each other however. If possible, let's not let this devolve into a shit-slinging contest.

The fact is that presidential polls have, up until last month, never underrepresented a party three times in a row. Something is seriously off. I realize that there's probably no one single element, but a number of contributing factors. I'd like to examine them.

I'm going to go out on a limb and say it's pretty silly to simplify it down to "they're liberals so they favor liberals". I don't think that every single major news network aside from Fox would just lie about data. Harris' own campaign does admit in this interview that their internal polling never had a great outlook, but that was not common knowledge until after the election:


So what's going on? Everyone who has ever said "I don't care about polls" has, at one point or another, utilized polls whenever it suits them. But unless people figure out what went wrong and how it went so wrong, they'll become less and less useful.

Conversely the betting odds had it precisely correct for the most part. Harris had a short lived surge but electionbettingodds.com had it 312 for Trump almost the entire time. Some of the prominent people who are by now in hiding for a bit insisted this was due to a "mystery bettor" who placed two large bids for Trump, essentially thumbing the scales. But I think it was about a million maybe, which represented less than 1% of the pool.

Anyway I'm curious to get feedback on what could have caused the polls to get it wrong three times in a row. Some have said that Trump supporters are less likely to engage with analysts, or less likely to admit they voted for Trump. I can see this, but I have a hard time believing this is the sole element.
 
Last edited:
Always seems the poll results favor the left, it is odd.

I recall up here in Maine, Susan Collins was supposedly 10 points behind Sarah Gideon in all the polls but she ended up winning by that same margin. Thats a 20 point swing from what the pollsters claimed.
 
(S)Elections are scripted events?
 
Always seems the poll results favor the left, it is odd.

I recall up here in Maine, Susan Collins was supposedly 10 points behind Sarah Gideon in all the polls but she ended up winning by that same margin. Thats a 20 point swing from what the pollsters claimed.

I know, we'd have to go way back in ancient history to 2022 for when the polls were predicting a red wave and instead we got a red trickle
 
I know, we'd have to go way back in ancient history to 2022 for when the polls were predicting a red wave and instead we got a red trickle
How many of those were within the margin of error from the poll numbers?
 
Polls are going to be less accurate going forward because the methodology polling is based on is getting a representative sample off landlines. This is no longer truly possible at least not the way it used to be.

People don't answer their cell phones anymore so I don't really see how they adapt. A diverse cross section of society answering their phone is a neccessary component of polling science. Without it you're going to get closer and closer to the famous 1936 telephone polls where you're not getting a random sample.

The fact the older people that are more likely to own landlines are also more likely to vote has bought them some time though. That time is coming to an end though.

What can't be questioned though is the reliability of polls the last 75 years. They were sound and their track record speaks for itself.
 
Last edited:
How many of those were within the margin of error from the poll numbers?
They really weren't that far off, and certainly closer to polling numbers than the other recent elections. Senate upsets were basically Dr. Oz was ahead of Fetterman by 0.5, and Herschel Walker ahead of Warnock by only 1 point, both well within the margin of error.

Midterms have way lower turnout, so nobody knows if the people responding to polls are even voting.





silver.HOW-2022-MIDERM-FORECASTS-DID.1.png
 
Polls have been very accurate the past few cycles. The margin of error is for each candidate and it is with 95% confidence. So if the margin is X 48%/Y 47% and the MOE is 3, that means there is a 95% chance that the range is X is up by 7% to Y up 5%. If you have hundreds of polls, you'd expect a bigger error for some of them.
 
Polls have been very accurate the past few cycles. The margin of error is for each candidate and it is with 95% confidence. So if the margin is X 48%/Y 47% and the MOE is 3, that means there is a 95% chance that the range is X is up by 7% to Y up 5%. If you have hundreds of polls, you'd expect a bigger error for some of them.

 
Back
Top