That would be a problem.
I would just say there is no more money until you sign the piece of paper and get it from this other person, but all of our family members are totally different from each other and respond differently.
We set up a special needs trust that would start upon our death. I have been talking to the bank and was told that they could be conservators. Iām sure it is because they realize that would be their role in the future anyway, and we live in a small town but Iām tempted just a to get out from under it AND see how it will work when Iām not here. 
I too am accused of taking all of this money but he forgets the money he spends when he goes out. He will offer to take someone out and not have any money. That just happened this week and I gladly paid it. He couldnāt provide the receipt but I trusted the driver and reimbursed her. I will give her money but not him or he would use it for liquor store even though he canāt drink. Unbelievable isnāt it?