I use MV-MIPI-IMX178M with Jetson AGX Orin to capture it with my Python script using OpenCV.

My pre-configuration v4l2-ctl commands are:

v4l2-ctl -d 0 -c roi_x=0,roi_y=0,preferred_stride=3136,frame_rate=22
v4l2-ctl -d 0 -v width=3088,height=2064,pixelformat=GREY

Format Video Capture:
        Width/Height      : 3088/2064
        Pixel Format      : 'GREY' (8-bit Greyscale)
        Field             : None
        Bytes per Line    : 3136
        Size Image        : 6472704
        Colorspace        : sRGB
        Transfer Function : Default (maps to sRGB)
        YCbCr/HSV Encoding: Default (maps to ITU-R 601)
        Quantization      : Default (maps to Full Range)
        Flags

In my Python script I use GStreamer and the simplified code looks like this:

import cv2

pipeline = f"v4l2src device=/dev/video0 ! appsink"
cap = cv2.VideoCapture(pipeline, cv2.CAP_GSTREAMER)

while True:
    ret, frame = cap.read()
    if not ret:
        print("Capture error")
        break
    cv2.imshow("Cam", frame)
    if cv2.waitKey(45) & 0xFF == ord("q"):
        break

cap.release()
cv2.destroyAllWindows()

It works fine!

Then I try to switch capture API from GStreamer to v4l2:

import cv2

cap = cv2.VideoCapture(0, cv2.CAP_V4L2)

cap.set(cv2.CAP_PROP_FRAME_WIDTH, 3088)
cap.set(cv2.CAP_PROP_FRAME_HEIGHT, 2064)
cap.set(cv2.CAP_PROP_FOURCC, cv2.VideoWriter_fourcc(*'GREY'))

while True:
    ret, frame = cap.read()
    if not ret:
        print("Capture error")
        break
    cv2.imshow("Cam", frame)
    if cv2.waitKey(45) & 0xFF == ord("q"):
        break

cap.release()
cv2.destroyAllWindows()

And I see stripes in the video window. I guess the reason is how the v4l2 considers the frame width and the prefered stride.

I try to set:

cap.set(cv2.CAP_PROP_FRAME_WIDTH, 3136)

...and get 'Capture error'.

My attempts to change prefered_stride property by v4l2-ctl were not successful.

The only workaround I've managed to find so far is to reduce the width of the captured frame to a multiple of 64 so that matches the prefered_stride. The closest such value to 3088 is 3072. So I preconfigure the cam with width=3072,prefered_stride=3072. And set in my Python program:

cap.set(cv2.CAP_PROP_FRAME_WIDTH, 3072)

That works fine!

But what if I had to read all 3088 pixels of width? Is there any solution for v4l2 (not GStreamer)?

I use VEYE-MIPI-IMX462 with RPI 3B+ (bullsye, 5.10.92-v7+). Kernel module veyecam2m is installed. V4l2 preview by VLC player and GStreamer works fine.
When I tried to read from Python script by OpenCV with cv.VideoCapture() no frames captured (cv.VideoCapture.isOpened() returns False). I've tried to downgrade the kernel to v5.10.17 and use previous veye327 module but this hasn't solved the problem.

import cv2 as cv


cap = cv.VideoCapture(0)
print(cap.isOpened())

while cv.waitKey(10) != 27:
    ret, img = cap.read()
    cv.imshow("video", img)

cap.release()
cv.destroyAllWindows()

How to capture video by OpenCV and v4l2 for IMX462? And why it works fine with VLC and doesn't work with Python + OpenCV?

From Python:

from ctypes import *
cdll.LoadLibrary("libdmipicam.so")

=============================
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/lib/python3.9/ctypes/init.py", line 452, in LoadLibrary
return self._dlltype(name)
File "/usr/lib/python3.9/ctypes/init.py", line 374, in init
self._handle = _dlopen(self._name, mode)
OSError: /lib/libdmipicam.so: undefined symbol: mmal_log_category

I try to use VEYE-MIPI-IMX462 with RPI 3B+ (bullsye, x32). Unfortunately v4l2 rendering was too laggy (I hope to resume experiments with it later), so I use the legacy library. veye_raspipreview works pretty good.
I followed the instruction and build libdmipicam (no errors, only warnings), install it with 644 into /usr/lib. But when I tried python_demo/preview.py I get Load libdmipicam fail. I tried different versions of libdmipicam.so - bundled and compiled - the same result.
Please, help me with that problem.