This happens to me all the time in Reim.

The spell only checks for adding when someone joins the group, so you have to break the group and reform it to get the spell back if it drops when you are in separate rooms but still grouped.