I've rode BMXs, mountain bikes, snowboards and skateboards for the last 40 years, and I'm a physical wreck at 47 years old. I've had so many injuries it's not funny. I'm sure I've had a few concussions too. All without ever playing football or any other team sports. However, I've had a blast, and if I had to do it all over again, I probably wouldn't change a thing. I have so many good memories it's awesome.
As long as your son follows proper tackling techniques to the best of his ability to minimize head and neck injuries, I don't think you're a "monster". Especially if he wants to do it and enjoys it. As many people said, simply driving a car puts us all at greater risk for injury than a lot of the sports we partake in.