I know a long time ago there was a ruling that if the full set-aside/return condition wasn't met (i.e. everyone who was set aside doesn't return) then the condition wasn't met (e.g. Hamans Plot targets my Hero set aside with Pentecost, but not all the Heroes, I still don't get to draw 3). I don't remember if that is how it was settled, or if such a principle is codified anywhere, but if it is, then I would say you don't get to look and take until your guys come back. If it is not, then it probably should be codified one way or another.