Urasai - Manga

Saito lives in an apartment full of spirits until a priestess randomly shows up claiming that she's going to protect him, but usually does the opposite and he ends up worse.