Don't forget about the added height of castors. I'm guessing they would raise the pin 3-4 inches unless you get custom legs made.
What's the layout of the room, is there open space next to the pin? Could you remove the closet door or change it to a barn door style, then you might only need to pull the pin a foot forward to access the closet.