OP I believe your concerns are valid, especially if your mods require separate power shut off or similar, easily forgotten, steps for safe use. I also assume your mods are not being tested for compliance with applicable electrical standards, etc.
At a minimum, you should have an LLC to maybe avoid personal liability for a catastrophic event.
Definitely want liability insurance to cover any damages or injuries caused by your products, but it will be difficult to find and expensive because you don’t have any official testing or govt approvals. Maybe Lloyd’s of London type coverage, but will be too expensive.
You should also include with your mod a very clear warning page. You can look at warning pages from electric heaters, power tools, pinball machines, and other devices to see examples of language. You need to state there is no warranty of any kind and that buyer assumes all risks. You need as much warning language as possible and it needs to be included with mod and maybe on box or package and on a sticker on the power supply itself.
Of course it would be best to consult a lawyer, but no one ever wants to pay a lawyer.
Oh, I am an injury lawyer.
In the example you gave, a house fire, it is unlikely there would be sufficient proof that fire came from your mod specifically. But if it was determined to be the cause, you would like to be covered by some insurance and a detailed warning.