Your comments

I can reproduce this issue up to Unity version 2020.3.34f1

But with 2020.3.35f1 it seems to be solved.