Prevent agent from assigning owner in another queue

It took me some trials and error (remove option doesn’t do anything for me, I used masked instead).
Typically, I created one filter per group / queue, and apply each filter to everyone creating / editing a ticket in that queue who does not have full rights for that group / queue.

Thanks for the quick answer