Castle Myers bug?

Trying to play the map but my guests just turn around and leave before making it down the entrance ramp. Anyone else have this issue or found a way around it? I know I can move the entrance but I like the castle on the hill.