Primary selection - each selection done by mouse. It is not going to clipboard until sync is enabled.
sudo apt-get install xfce4-clipman
Settings –> Clipboard Manager Settings –> Sync mouse selection (uncheck)