Somehow I don't find that quite so bad; I would render that as {va'o lo nu da'i} or {ganai da'i}; the {da'i} makes it clearer that I'm not literally asserting the listener does anything, but perhaps it might be ambiguous some other way?
I'm also bad at thinking of examples off the cuff, but the sentence I suddenly grew aware of went something like "It seems *you* can't choose which sentence *you* want to speak." {si'au va'ora *do* naka'e cuxna lo jufra poi *do* aidji lo ka bacru ke'a}