Excellent question! I had some trouble with a silk backing recently that I think was because of the glue (TB3) not liking the super smooth surface of the back I was gluing it to, but that is just a guess. I peeled of the silk, sanded the back a bit to roughen it up a bit, and applied new silk. It seems to be holding well this time. I don't know that this applies to your circumstance though.
I'll be watching the answers you get and hope to get some insight as well...
OneBow