From what I have heard, yes, you need to have runemate open in the background.  I also make sure that I open the RS client via runemate, just to be sure - but I am not sure if it makes a difference.
Regarding how it actually works, I am not certain.  I did message Arbiter but I suppose he has...