Enable "select all" and "is not" option on list view filter

My use case is specifically on the "Idea created by" filter on Idea lists. I want to exclude ideas created by myself and my team.

Currently we have 300+ portal users, and I have to go through and select/click all portal users excluding myself and my team members to set that filter. It would be a timesaver for me if we could have a "is not" filter, so I could set an "idea created by" "IS NOT" x, y, z. My team members are a more stable pool than portal users, so this would be relatively stable and could be used as a filter reliably without weekly changes. 

Alternatively the option to select all and then deselect the relevant team members would also save me time, as currently I have to go through the report each week to check if we have additional users that have been added to select them, where as if I could select all and remove the small number of team colleagues, this would be quicker.