Check the 'Move active object(s) only' option on the attribute bar of the Pick Tool.