As specified, it currently doesn’t seem possible to add comments to values in a row even though rows themselves seem to have comments. I expect this to be implemented given that the focus for comment work is on row-based page workflows, and Notion already supports this for the same reason.
This in particular is hindering my effort to have a wiki-sort of implementation through tables (pages having meta data).