When You want to deselect an already selected item, SHIFT+click on this item.
Shift are used for multiple selection and act also as toggle.

For this You have to put back a flower on my avatar [B-)]