in ur top view , Set ur angle like this picture :

so if ur ladder is from right to left , and ur movment direction is down (ON THE TOP VIEW), ur angle should be 270 ..
and so on ...
for doors no diffrence if ur movment direction is UP OR DOWN ONLY...
this way helped me alot ...