First, let me say I agree with you.

There is so much subjectivity here and different voters consider it differently. Examples (in addition to what you wrote):

- Does inclusion of a 15" LCD means inherent better rating than a traditional DMD?
- If so, then does inclusion of a larger 27" LCD mean inherent better rating than a smaller 15" LCD?
- If so, maybe ask yourself ... is a wide body pin better than a standard (because it's bigger)?
- Are "deep" rules really better than "normal" rules? Someone could restate this as "Are complex rules better than accessible rules"? Or, are big rulesets better than smaller ruleset?

While those were aspects of how technology might impact rating, some other aspects to consider

- Should build quality be included in a review?
- Should ability to manually repair a game using commonly available tools be a factor?

I suspect there'll be lots on different answers to the above, all being inconsistency applied to the ratings.

Avoiding the JJP (and eventually Stern added) stuff, I found the filter from koji very interesting! I recreated it, which doesn't require much, he showed it all. I had never played with it.

In short, all he did was

1) Use only approved raters (pretty sure this is the default for official top 100 too)
2) Ignore ratings from raters that are no longer active (this isn't the top 100 default, I believe)
3) Enable a trimmed mean function to exclude outliers. Roughly speaking, this tosses out votes that are "extreme" (but I don't know the exact formula)

That's it!

EDIT: Well, not quite. As pointed out, he also required 250 votes. The info below is based on requiring 25 votes.

A result of using the custom view is that games are no longer grouped. You might think your favorite game at 30 has moved a lot further down, but that because the 17 variations of each recent Stern and JJP game are ranked individually.

If you look closer, you'll see interesting things such as

1) Stern JP Pro is rated about the same a CFTBL (#33 and #34)
2) However, #32 is MMr "LE"
3) Whereas the OG MM is #1
4) And the OG MMr (aka Standard) is #7
5) EHOH is #48 sandwiched between Deadpool LE and Torn Legacy LE

I think this link includes the filter settings

https://pinside.com/pinball/top-100/custom?gamefamily=mg&only_games_from=&only_games_to=&machine_manufacturer=&avgcalc=trimmed_mean&approved_raters_only=1&active_members_only=1&rate_max_age_months=0&minimum_ratings_count=25

Well, it's all a snapshot in time, isn't it?

While the Top 100 is broken in many ways, at a minimum the default should require 100 votes to be included. If a game cannot muster 100 votes, that's a sign in itself.

14 and 23 now.

Clarification:
14 is Mando
23 is RM

Was just thinking...

With how people vote, CCr will be number one in two days.

Haven’t you all heard of binary voting? Well, 1’s and 10’s.

That pinsider is a strong proponent.

Not to turn this into a discussion of rating, but I'll add one comment related to this topic.

Ratings are all relative whether you realize it or not. There's no strong definition of a 5. Or a 1. Or a 10 ...

So how does someone determine what, for example, a 10 is? Simply by looking at what other people have given a 10 (or what is a 5? what games have an average of 5?)

The result, therefore, is the values have no meaning in themselves but they are relative. And you might ask, "relative to what"? The answer to this is "it changes over time."

TL;DR. If someone likes game X more than game Y, they are going to ensure whatever numbers they give their preferred game is higher than Y. The number doesn't matter as long as it's higher. If you believe my statement, then it follows that people just give "10s" because they think the game is better than any game that doesn't have an average of 10. It doesn't mean it's a perfect game, it's just a relative value.

I myself kind of follow this, but I have a rule I don't give 10s. I'll do a 9.9.

Just my opinion. With no formal criteria, it's hard for me to imagine it plays out differently.