It appears you can drag down as well. I just figured out that when I have a two live activities sharing the island like in my photo above, you can hide either of them by dragging down. You can also swap them. I haven't figured out the gestures to hide, i hide, and swap, exactly. I've been playing with it and I can get it to work but not exactly sure what combination of gestures does what LOL. I need a guide.