Which glue will stick silk flowers to a woven straw hat?

I purchased and wasted money on (fabric glue, tacky glue and rhinestone gem glue) and any of the 3 attached the flowers to the hat, really these glues just made a mess and stained the flower and the hat. Which glue can I buy from the local craft shop that will stick silk flowers firmly to woven straw type hats. Thank you-