@veye_xumm
In case I try to set pixel_format to any other value is cause VIDIOC_STREAMON fail. I suppose this is a bug in the driver.
Some other applications like gstreamer only set pixel_format if you directly point to do this, this is why it works, but many others (e.g. trying to set default pixel_format) are not.
I need wait for clear sky to test and provide feedback
Finally tested, for gain value 20 it is looks pretty same with color sensor with ISP, but background no so black as for color sensor.
For me this issue resolved, attached examples to compare (10 seconds stacks)