deffo say goodbye.

wouldnt you be scared if your kid just was there one minute and vanished the next???

If it was me, i would let them know you are leaving and remind them once or maybe keep reminding them so they are pepared, reassure them that you are coming back and make it a brief goodbye. if they cry, they will be over it in 5 minutes and have a wonderful time anyway!