Ability to choose / remove items from lookup of cross-doc table when in Detail > Lookup-as-table view

In a normal table view, I’m able to choose and remove items for my lookup column.

In row’s table view where a lookup column is also shown as a table, I’m also typically able to choose and remove items (e.g. “Choose Row” and delete).

But if the lookup column is referencing a Cross-doc table, the ability to choose or remove items in the table view doesn’t exist.

I understand the limitation of not being able to add rows ("+") to a cross-doc table lookup, but I should still be able to choose and remove them.

See image:

Image 2021-02-21 at 3.37.22 PM.jpg