*=Equal Contributors
Offering voice assistants the power to navigate multi-turn conversations is a difficult downside. Dealing with multi-turn interactions requires the system to grasp numerous conversational use-cases, comparable to steering, intent carryover, disfluencies, entity carryover, and restore. The complexity of this downside is compounded by the truth that these use-cases combine with one another, usually showing concurrently in pure language. This work proposes a non-autoregressive question rewriting structure that may deal with not solely the 5 aforementioned duties, but in addition advanced compositions of those use-cases. We present that our proposed mannequin has aggressive single process efficiency in comparison with the baseline strategy, and even outperforms a fine-tuned T5 mannequin in use-case compositions, regardless of being 15 instances smaller in parameters and 25 instances quicker in latency.