The exchange is an effect, as is the exchange back. I would have to rule that based on the wording, Goshen would protect the heroes from the exchange back of the Heroes. I can't say for certain what would happen to the heroes if they were taken out after, say, three turns of being in Goshen. There are a few ideas that seem possible to me, but they all have problems. I would wait for further input before determining a result.