Use Change Set|Delete to delete the selected Change Set. This will only affect the Change Set assignment, not the files nor their SVN state.