I can confirm that it only pops up when I run the tests.
I also see this window (not blocking CI, just annoying).

We use version

6.2.1.7128 (Unity 6000.2.10f1)

I see that you are no longer opening the window for cloud builds (!UNITY_CLOUD_BUILD && !DEV).
It may be that it only appears in the headless tests.

We use something
C:\Program Files\Unity\Hub\Editor\6000.2.10f1\Editor\Unity.exe" -batchmode -projectPath C:\Project -runTests -testPlatform EditMode -assemblyNames Project.Common.Tests -testResults C:\Project\TestResults\EditMode\EditModeResults_20251218_171253.xml -logFile C:\Project\TestResults\EditMode\EditModeEditor_20251218_171253.log -enableCodeCoverage -coverageResultsPath C:\Project\Coverage\EditMode -coverageHistoryPath C:\Project\Coverage\History -coverageOptions generateHtmlReport;generateAdditionalReports;generateBadgeReport;assemblyFilters:+Project.*,-*Tests