I dont know if its a quick fix or if I am doing it wrong but; everytime I attack one of the callers to get aggro, the fiends that spawn attack him no matter what. However, the other preists and whatnot do not attack the caller.
Edit: Err nevermind. All I had to do, to fix it, was stand in range of the Caller.