To remove items from the pool there are three options:

When viewing the Assessment module, re-select the Added button next to the test in the Assessment list.

When in the Assignment Pool, select the ‘Bin’ icon to the left of a test in the pool.

When in the Assignment Pool, select the Remove all assignments button at the top right of the pool.