Oh yeah.... thankfully you can - most of the times at least - just click on the objects and move them to the other layer. But it still sucks.