(Topic ID: 288507)

Willie Wonka #1! Yikes!! Top 100 algorithm flaw?

By Hjbondar

3 years ago


Topic Heartbeat

Topic Stats

You

Linked Games

Topic Gallery

View topic image gallery

31DCA1EA-A073-464F-9DF0-5CF33790ACC2 (resized).jpeg
#1 3 years ago

So, Willie Wonks is #1? Absurd!

Why, because the raters of the CE just hit the 25 rater threshold and the Top 100 bases the ratings on the highest score of any of the versions.

Shouldn’t Stern Premiums be averaged along with LE’s to arrive at a single, blended rating. Same for JJP LE and CE. The simple logic is that these additions have the same gameplay.

It seems absurd to have 26 CE rating overwhelm the more than 150 LE raters who scored the same game(from an overall playing perspective) much lower?

Seems like this must have been addressed in the forum before?

#2 3 years ago
Quoted from Hjbondar:

So, Willie Wonks is #1? Absurd!
Why, because the raters of the CE just hit the 25 rater threshold and the Top 100 bases the ratings on the highest score of any of the versions.
Shouldn’t Stern Premiums be averaged along with LE’s to arrive at a single, blended rating. Same for JJP LE and CE. The simple logic is that these additions have the same gameplay.
It seems absurd to have 26 CE rating overwhelm the more than 150 LE raters who scored the same game(from an overall playing perspective) much lower?
Seems like this must have been addressed in the forum before?

Everyone just panic-bought all the CEs up and rated the game a 10 after a few plays, or maybe before receiving the game.

#3 3 years ago

We literally just had this discussion when the new edition of Star Wars showed up at #1.

The game will settle where or belongs as more reviews come in, just give it time. Don't review bomb it to try and bring it down, that's stupid and will ultimately result in it being ranked lower then it should be.

25
#4 3 years ago

You guys might take these reviews a bit too seriously.

#5 3 years ago

Solid showing from JJP at the top of that list. Regardless of position they do make some great games, as do the others!

#6 3 years ago
Quoted from Mike_J:

You guys might take these reviews a bit too seriously.

but muh investment

14
#7 3 years ago

Many CE owners are way too concerned about price-pumping their "investments". They embarrass themselves. It's pathetic.

#8 3 years ago
31DCA1EA-A073-464F-9DF0-5CF33790ACC2 (resized).jpeg31DCA1EA-A073-464F-9DF0-5CF33790ACC2 (resized).jpeg
#9 3 years ago

I am just amazed that a game that doesnt suck is actually number 1.

Its like a minor miracle.

#10 3 years ago

lot of new CE owners recently. It wouldnt be #1 for me but I believe it should be in the discussion for top 10. I love the game.

#11 3 years ago

The top 100 is completely pointless as the system is completely broken and the powers that be need to overhaul it. If a negative review gets flagged enough it does not count towards the numeric rating. So fanboys of a particular title can basically eliminate all bad reviews. Reviews are reviews good and bad and all should be counted unless it violates a Pinside rule with something inappropriate or vulgar.

Bottom line...ignore the top 100 until Pinside overhauls the system. Even then it’s all subjective and should be taken worth a grain of salt.

#12 3 years ago

The constant obsession with this is a pinside user flaw. Yikes!

#13 3 years ago

It’s too bad because this could be very useful

#14 3 years ago
Quoted from Hjbondar:

It’s too bad because this could be very useful

It drives traffic to this site and that is its only
Purpose. It is fulfilling its use.

#15 3 years ago
Quoted from IdahoRealtor:

Many CE owners are way too concerned about price-pumping their "investments". They embarrass themselves. It's pathetic.

Or maybe they all really like the game?

#16 3 years ago
Quoted from mystman12:

Or maybe they all really like the game?

Yes. People should like the games they own. I think that's obvious. But, collectively rating their Wonka CEs as the #1 pin of all time is very transparent.

#17 3 years ago

If I were to take the top 100 seriously (cough, cough), recency bias is its biggest problem. And that is plain to see because 90’s W/B games were, are, and always will be the best games and they are slipping.

-2
#18 3 years ago

what if they did it like rotten tomatoes and had the ratings as they are(with the recommended calculation adjustment) and then had a panel of 100 insiders - Have to have had at least 2 year of presence on Pinside- to act as "expert judges"?

#19 3 years ago
Quoted from Hjbondar:

what if they did it like rotten tomatoes and had the ratings as they are(with the recommended calculation adjustment) and then had a panel of 100 insiders - Have to have had at least 2 year of presence on Pinside- to act as "expert judges"?

THat sounds like a lot of work. A ton of work.

What would the people who run this site get out of this exactly, beyond a bunch of boobs continuing to complain about the top 100 from now until the end of time?

#20 3 years ago
Quoted from usandthem:

If I were to take the top 100 seriously (cough, cough), recency bias is its biggest problem. And that is plain to see because 90’s W/B games were, are, and always will be the best games and they are slipping.

I dont know... MM has been #1 forever and I wouldnt even put that in the top 20 all time

Monster Bash is still number 4 and that game frankly kinda sucks other than art.

Kinda nice to see some new games up there.

#21 3 years ago
Quoted from Elvishasleft:

I dont know... MM has been #1 forever and I wouldnt even put that in the top 20 all time
Monster Bash is still number 4 and that game frankly kinda sucks other than art.
Kinda nice to see some new games up there.

I don't know if I would go that far ... kick MM out of the top 20?

It is nice to see some of the newer pins up there. In my opinion MM and MB definitely belong in the top 10

#22 3 years ago
Quoted from Elvishasleft:

I dont know... MM has been #1 forever and I wouldnt even put that in the top 20 all time
Monster Bash is still number 4 and that game frankly kinda sucks other than art.
Kinda nice to see some new games up there.

Those two remain there because of the remakes. All the NIB-only buyers rated them up. Twilight Zone was #1 for over a decade on IPDB and early Pinside. But the NIB folks don’t rate it, or don’t rate it as high, because they can’t buy it NIB with a topper.

#23 3 years ago
Quoted from Goronic:

I don't know if I would go that far ... kick MM out of the top 20?
It is nice to see some of the newer pins up there. In my opinion MM and MB definitely belong in the top 10

Well its an opinion... doesnt mean Im right.

I owned original versions of both back in the day and not only would never want them back I wouldnt even play them in the wild.

They are OK.. but top 10 all time?

#24 3 years ago
Quoted from IdahoRealtor:

Yes. People should like the games they own. I think that's obvious. But, collectively rating their Wonka CEs as the #1 pin of all time is very transparent.

While you're probably not wrong, I would say that such a rating is 100% subjective and doesn't really mean anything at all.

Jeff

#25 3 years ago
Quoted from Elvishasleft:

Well its an opinion... doesnt mean Im right.
I owned original versions of both back in the day and not only would never want them back I wouldnt even play them in the wild.
They are OK.. but top 10 all time?

Everyone has a different Top 100 for sure, and everyone has different tastes.

#26 3 years ago

#1, hardly. But the game is no slouch either.

#27 3 years ago

Ratings are completely subjective. Just because I like a specific game, does not mean you will. That transfers to my rating on a game might be higher than yours and vice versa. I hope nobody is buying games based on pinside ratings!

#28 3 years ago
Quoted from DrJoe:

Those two remain there because of the remakes. All the NIB-only buyers rated them up. Twilight Zone was #1 for over a decade on IPDB and early Pinside. But the NIB folks don’t rate it, or don’t rate it as high, because they can’t buy it NIB with a topper.

LOL, so true.

Wonka is the tits though; such an amazing pin...I dislike the theme, and absolutely love the way it shoots and the code.

#29 3 years ago

The main algorithm flaw is people.

The first guy who comments says he "played the game at a bar" and then reviewed it.

As long as people think its OK to rate games they played once it will always be a crap system.

You should have to prove you own it or something to rate it.

#30 3 years ago
Quoted from Elvishasleft:

You should have to prove you own it or something to rate it.

That would be bad...very few people (except for those who have like 50 machines) own games that they don't like.

If you could only rate games that you own, every game would be rated "good" or "great". A machine would never get a bad rating.

#31 3 years ago

Not sure why Premium/LE models have to be rated separately
Pinside ratings used to group them (ie, Iron Maiden etc...), but that changed beginning with Deadpool onwards
Willy Wonka CE should be grouped with Willy Wonka LE (same gameplay), then we wouldn’t see this inflated current ranking

#32 3 years ago
Quoted from Hawks:

Willy Wonka CE should be grouped with Willy Wonka LE

It is.

The highest rated of the group is what is shown on the list.

Quoted from Hawks:

Pinside ratings used to group them (ie, Iron Maiden etc...), but that changed beginning with Deadpool onwards

For a while, the differences in game editions were mainly cosmetic, so only a single game listing was used in the game archive for multiple editions. However, at some point, that started changing, in addition to there being a significant difference in value between the different editions. So, once the game archive system could support grouping of separate game listings, each edition was then able to have its own game listing. However, unfortunately, for game listings that shared multiple editions prior to this point, it's simply not practical to separate them now due to all the technical hurdles that would need to be overcome.

#33 3 years ago

I posted this in a different thread, but is relevant here...

I'd like to see them implement a "favorites list" system.

Each person gets to list 20 games as being "a favorite".

Then you can rank the games by how many times they appear on someone's list.

The advantage to this is that one person can't screw with the rankings very much. The best/worst they can do is include or exclude a title on their list.

If you love MM, great...put it on your list. If you don't like it...leave it off. There won't be any of this "give it a 10 to try to move it up" or "give it a 1 to try to screw it over".

It also might reduce the "it's a new game so it must be great" factor. It will be harder to automatically include [newest release] on your favorites list if it means you have to remove one of your existing favorites from your list.

#34 3 years ago

The system is clearly flawed. NGG obviously should be #1.

#35 3 years ago
Quoted from mystman12:

Or maybe they all really like the game?

I own the game. It's incredible.

#36 3 years ago

I thought Punchy the Clown was the clear #1, that’s it ! SYSTEM IS FLAWED!!!!!

Promoted items from Pinside Marketplace and Pinside Shops!
$ 79.99
Cabinet - Armor And Blades
PinGraffix Pinside Shop
 
$ 125.00
Playfield - Toys/Add-ons
Pinball Mod Co.
 
$ 50.00
Playfield - Protection
Duke Pinball
 
12,700 (Firm)
Machine - For Sale
Bradenton, FL
11,000 (OBO)
$ 49.99
Cabinet - Toppers
Lighted Pinball Mods
 
$ 43.00
Playfield - Toys/Add-ons
The MOD Couple
 
€ 99.00
Lighting - Under Cabinet
Watssapen shop
 
$ 40.00
Playfield - Toys/Add-ons
The MOD Couple
 
From: $ 12.00
Flipper Parts
Precision Pinball prod.
 
$ 10.00
Cabinet - Other
Filament Printing
 
From: $ 30.00
$ 25.50
From: $ 49.99
Flipper Parts
FlipMods
 
$ 19.00
Playfield - Toys/Add-ons
The MOD Couple
 
$ 14.95
Playfield - Toys/Add-ons
ULEKstore
 
From: $ 47.00
$ 32.99
$ 18.95
Playfield - Toys/Add-ons
ULEKstore
 
$ 18.95
Playfield - Toys/Add-ons
ULEKstore
 
$ 79.95
Cabinet - Shooter Rods
Hookedonpinball.com
 
$ 89.00
Playfield - Toys/Add-ons
The MOD Couple
 
$ 259.99
Cabinet - Toppers
Lighted Pinball Mods
 
$ 100.00
Gameroom - Decorations
Duke Pinball
 
$ 39.00
Playfield - Other
Travahontas Mods
 
$ 427.00
Cabinet - Sound/Speakers
PinWoofer
 
15,500 (Firm)
Machine - For Sale
Minneapolis, MN
$ 24.25
Playfield - Toys/Add-ons
The MOD Couple
 
Great pinball charity
Pinball Edu

Reply

Wanna join the discussion? Please sign in to reply to this topic.

Hey there! Welcome to Pinside!

Donate to Pinside

Great to see you're enjoying Pinside! Did you know Pinside is able to run without any 3rd-party banners or ads, thanks to the support from our visitors? Please consider a donation to Pinside and get anext to your username to show for it! Or better yet, subscribe to Pinside+!


This page was printed from https://pinside.com/pinball/forum/topic/willie-wonka-1-yikes-top-100-algorithm-flaw?hl=mbrave77 and we tried optimising it for printing. Some page elements may have been deliberately hidden.

Scan the QR code on the left to jump to the URL this document was printed from.