I need wait for clear sky to test and provide feedback
Finally tested, for gain value 20 it is looks pretty same with color sensor with ISP, but background no so black as for color sensor.
For me this issue resolved, attached examples to compare (10 seconds stacks)
However, I'm curious why this issue occurs so frequently on your end. Could you please measure the SCL level using an oscilloscope? When the VEYE module is not configured, SCL should always remain high. If there are frequent and continuous level changes, it indicates that the system is operating on the I2C bus.