Urgent/Important buttons in Edit Task should not expand/contract

When editing an "important" task, if you click on the word "Important", the button collapses back to just a star, and the mouse cursor is now over the Urgent button, because the button shrinks to just the star again.  The same is true if you click on the word "Urgent", the cursor becomes positioned over the Duration button.

This is very annoying as you must move the mouse to undo the operation you just performed. Buttons should never move in response to actions.  Should simply click to enable, then click again to disable (without moving pointer). If you click directly on the icons instead of the words, this doesn't happen, but still.