You have to be holding a favor orb to get into the temple gates. This was set in place as a ward against the undead army and their leaders.