Congrats on your new machine. Those lights are part of the GI (general illumination) if I recall correctly, so maybe your not in the correct setting when testing but even so I'd still take the glass off and push the light into the socket as it could have become loose (the most likely scenario), then test it again.
If it still doesn't light up you'll have to slightly loosen the top screw holding the lamp in place and shift the spotlamp retainer clip that holds the lamp in its socket to get access to the lamp. Then pull out the lamp and maybe swap it with another one on the machine to see if there is an issue with that specific lamp or socket.
I could be wrong but I think all the GI lights get used at some point in time during the end of game light sequence, you might have to wait for it but they eventually get used, so that might be another way to see if everything is working.