It’s EASY to take off...I would rather take it off then put a bag over it.
I wouldn't take it off, just put the bag over it, that way you can still put things in the glovebox. I use a small magnetic tankbag which lets me use both, the tankbag sits behind the glovebox and I can still get into it without removing the bag.