Mine has pulled out in the past. I found dried, sticky something on the gasket and on its mating surface. Thorough cleaning both the gasket & the mating surface with suds followed by isopropyl alcohol seems to have eliminated the issue.
Cleaning those surfaces is now part of camper cleaning after each trip. Thus far, no repetition of the problem. Just gluing the gasket into door might result in tearing the gasket surface with a tenacious sticky residue.
As usual, YMMV
Paul