(Topic ID: 183308)

Regression Analysis: Pinside Rating and Game Details

By DennisK

3 years ago

Topic Stats

  • 5 posts
  • 4 Pinsiders participating
  • Latest reply 3 years ago by DennisK
  • Topic is favorited by 3 Pinsiders


Linked Games

No games have been linked to this topic.

    Topic Gallery

    There have been 2 images uploaded to this topic. (View topic image gallery).

    PinRegression2 (resized).jpg
    PinRegression (resized).jpg

    #1 3 years ago

    Hey everyone,
    robin was kind enough to provide me with a lot of game details from the Pinside database. I wanted to review the data and perform a simple regression analysis to see if there are any features of pinball machines that can be directly tied to how the game rates in the Pinside system.

    I’ve attached an image of the Excel regression output, but I’ll do my best to explain and keep things simple.

    First, I only reviewed an extract of solid state titles, so EM machines did not factor into the analysis.

    Second, because I was trying to see if a variety of independent variables impacted Pinside ratings, only those games with a rating in the system could be used. This reduced my count from the total SS listing of 1,039 to 371.

    Third, I was just using Excel, not something fancy-pants like SPSS. Excel limits the independent variable count to 16. This means I could only consider 16 categories of information (just as well, since the risk of noise increases with every variable added; those of you more into statistics know about Adjusted R Square and all that). So, I had to pick and choose what to include.

    So, what did I consider? The following categories were assessed for impact on Pinside rating:
    1: Year (listed year of manufacture)
    2: If the game was a Williams
    3: If the game had a licensed theme
    4: If the game was a designated wide body cabinet (versus say a standard or custom size)
    5: If the game has a kickback feature
    6: If the game has a multi-level playfield
    7: If the game has any spinners
    8: If the game has a shaker motor
    9: The number of flippers the game has
    10: The number of balls in a multiball that the game offers (the largest count possible)
    11: The number of drop targets
    12: The number of bumpers
    13: The number of ramps
    14: The number of captive balls
    15: The number of cannons
    16: The number of magnets

    For items that were unknown (for example, having a shaker motor has three options in the data, Yes, No, and Unknown), they were treated as if they did not exist (assumption of “No” for Unknown entries).

    Next, I had to set some sort of ground-rule of significance, where we decide whether or not the collection of these variables is predictive, and whether each individual one is predictive. I went with a p-value of 0.01 (so, p-values less than 0.01 were accepted as significant, and anything larger was rejected; this value suggests a 99% probability that any reported relationship is real and not merely due to chance).

    The Regression’s Significance F field was well under 0.01, which means we get to say these 16 variables do predict a game’s Pinside ranking in some way. So, we look at the R Square value, which is 32.6%. The regression indicates that of a Pinside rating’s value, 32.6% of its total variance is explained by these 16 variables. Or, said another way, around 1/3 of a game’s rating ties to these objective details, and the rest of the rating is determined some other way.

    Okay, since we know the collection is significant, we can look at each of the 16 variables and see which ones are individually significant. Of the 16 variables I examined, 5 came in as significant at our 99% level:
    1: The year of manufacture
    2: If the game was made by Williams
    3: The number of bumpers on the game
    4: The number of ramps on the game
    5: The number of magnets the game uses

    A shaker motor was close, but didn’t quite make the threshold (There is a 95%+ probability that a shaker motor’s presence improves a game’s Pinside rating, but since it couldn’t reach 99% probability I’m rejecting it from consideration).

    Now, if you wanted to explore any more, you can use the coefficients to see what the regression is estimating from the image. I started to write some examples on how this works, but it turned into a huge paragraph so I’ll just leave it out there as an option for those ultra-curious.

    Broadly speaking, this regression analysis suggests that: the more modern the game, the more Pinsiders like it. That a game made by Williams gets a boost in rating. And, the more bumpers on a playfield, the more ramps on a playfield, and the more magnets a game uses, the higher the game’s rating. But, that all these features only really explain roughly 1/3 of a game’s rating.

    Again, my thanks to robin for allowing me access to his stored data sets. It’s been a while since I did an analysis like this, so if anyone catches errors just let me know and I’ll edit the post to be more accurate. I’ve been curious for quite a while if the objective features of pins can actually predict how they are rated on this site, and it appears at least a few of them do tie in.

    PinRegression (resized).jpg

    #2 3 years ago

    It never ceases to amaze me how deeply people can get into a hobby.

    #3 3 years ago

    Cost variable would take care of much of the remaining % id guess

    Fun little analysis.

    #4 3 years ago

    Neat stuff.

    Are you able to re-do the analysis based on the era? (and take *time* away as a variable to study)

    I'd like to see what's more important to each era...

    Early Solid state 1977-1983 (pre-ramps)
    Late Solid state 1984-1990 (pre-dmd)
    DMD 1991-1998 (pre-modern sterns)
    Modern 1999-present (stern and others jumping in)


    #5 3 years ago
    Quoted from mof:

    Neat stuff.
    Are you able to re-do the analysis based on the era? (and take *time* away as a variable to study)
    I'd like to see what's more important to each era...
    Early Solid state 1977-1983 (pre-ramps)
    Late Solid state 1984-1990 (pre-dmd)
    DMD 1991-1998 (pre-modern sterns)
    Modern 1999-present (stern and others jumping in)


    Since each category needs to be its own variable, I've also removed those independent variables that did not have a 99%+ probability of impacting the Pinside rating. Attached are the results. I am a bit surprised, only the Late Solid era met the p < 0.01 threshold. All our previously significant categories remain significant, which isn't surprising.

    Quoted from Whysnow:

    Cost variable would take care of much of the remaining % id guess

    I've also suspected designer(s) and programmer(s) might also be significant, particularly designers.

    Before my first analysis, I did run all the major manufacturers originally (but I needed the slots for other variables). As I recall, Bally also met a p < 0.01 threshold but wasn't as strong of an impact (in other words, Williams moved the needle more than Bally, but being a Bally did significantly impact the rating). The others examined (all the other "major" designations, so Alvin, Gottlieb, Capcom, Data East, Sega, and Stern Pinball) did not meet the probability threshold to be a factor.

    PinRegression2 (resized).jpg

    Promoted items from the Pinside Marketplace
    $ 35.00
    Playfield - Toys/Add-ons
    Back Alley Creations
    $ 163.00
    Playfield - Toys/Add-ons
    The MOD Couple
    $ 18.00
    Cabinet - Decals
    Top-Notch Target Shields
    $ 64.00
    Lighting - Under Cabinet
    $ 269.00
    $ 55.00
    $ 400.00
    Maple Street Sign Shop
    $ 5,899.00
    Pinball Machine
    Little Shop Of Games
    From: $ 24.00
    $ 110.00
    Playfield - Toys/Add-ons
    $ 4.49
    Yorktown Arcade Supply
    $ 20.00
    Playfield - Decals
    $ 6.95
    $ 0.10
    Playfield - Toys/Add-ons
    Pinball Stuff
    From: $ 175.00
    Gameroom - Decorations
    Pinball Photos
    From: $ 9.99
    Matt's Basement Arcade
    $ 44.00
    Playfield - Toys/Add-ons
    From: $ 20.00
    Playfield - Other
    Gameroom Mods
    $ 7,999.00
    Pinball Machine
    Nitro Pinball USA
    $ 279.95
    Lighting - Led
    Pin Stadium Pinball LEDs
    $ 79.99
    Cabinet - Armor And Blades
    PinGraffix Pinside Shop
    $ 19.99
    From: $ 99.99
    Cabinet - Other
    Lighted Pinball Mods

    Hey there! Got a moment?

    Great to see you're enjoying Pinside! Did you know Pinside is able to run thanks to donations from our visitors? Please donate to Pinside, support the site and get anext to your username to show for it! Donate to Pinside