Navigation

    VEYE IMAGING Forum

    • Register
    • Login
    • Search
    • Categories
    • Tags
    • Recent
    • Popular
    • Users
    • WIKI
    • veye.cc

    UNSOLVED ROC-RK3588S-PC and IMX462

    Rockchip App camera
    2
    18
    3823
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • N
      natzguk @natzguk last edited by

      Hi @veye_xumm
      Do you know why UYVY does not work from the examples?

      1 Reply Last reply Reply Quote 0
      • N
        natzguk last edited by

        @veye_xumm Please help.

        v4l2_opencv_show1.py
        v4l2_opencv_show2.py
        v4l2_opencv_show3.py

        Do not work with ROC-RK3588S-PC and IMX462.

        veye_xumm 1 Reply Last reply Reply Quote 0
        • veye_xumm
          veye_xumm @natzguk last edited by

          @natzguk
          I'm sorry for not replying earlier.
          To be honest, we are not very familiar with OpenCV. I believe the low frame rate is due to the software-based UYVY to preview data format conversion, which involves CPU processing for each pixel, leading to inefficiency.
          I will verify the samples and your script as soon as possible.

          N 2 Replies Last reply Reply Quote 0
          • N
            natzguk @veye_xumm last edited by

            @veye_xumm

            Only format=NV12 (v4l2_opencv_show4.py) works with OpenCV but it requires videoconvert which is very slow.

            I want to use format=UYVY (v4l2_opencv_show2.py) but it does not work with
            ROC-RK3588S-PC and IMX462. I believe it is a problem with the driver for ROC-RK3588S-PC. The same code with format=UYVY works with Raspberry PI 4.

            1 Reply Last reply Reply Quote 0
            • N
              natzguk @veye_xumm last edited by

              @veye_xumm

              Did you have any chance to check the samples

              v4l2_opencv_show1.py
              v4l2_opencv_show2.py
              v4l2_opencv_show3.py

              with ROC-RK3588S-PC and IMX462?

              N 1 Reply Last reply Reply Quote 0
              • N
                natzguk @natzguk last edited by

                @veye_xumm please help

                veye_xumm 1 Reply Last reply Reply Quote 0
                • veye_xumm
                  veye_xumm @natzguk last edited by

                  @natzguk

                  @natzguk said in ROC-RK3588S-PC and IMX462:

                  Only format=NV12 (v4l2_opencv_show4.py) works with OpenCV but it requires videoconvert which is very slow.
                  I want to use format=UYVY (v4l2_opencv_show2.py) but it does not work with
                  ROC-RK3588S-PC and IMX462. I believe it is a problem with the driver for ROC-RK3588S-PC. The same code with format=UYVY works with Raspberry PI 4.

                  I apologize for the delay in responding to your question. In fact, as mentioned here, the VICAP module of RK3588 does not support outputting the UYVY format, so please use the NV12 format instead.
                  Actually, I think using the NV12 format is a good choice.It will not lead to a decrease in system efficiency.

                  @natzguk said in ROC-RK3588S-PC and IMX462:

                  Did you have any chance to check the samples
                  v4l2_opencv_show1.py
                  v4l2_opencv_show2.py
                  v4l2_opencv_show3.py
                  with ROC-RK3588S-PC and IMX462?

                  Indeed, as you said, only sample4 works correctly. These samples are just collected examples of common ways to use OpenCV to access the camera, provided for customers as a reference.
                  As mentioned before, our expertise in OpenCV development is not extensive.

                  videoconvert is indeed an issue. I believe the internal data format of OpenCV is RGBA, and regardless of whether you use UYVY or NV12, conversion is needed.

                  N 1 Reply Last reply Reply Quote 0
                  • N
                    natzguk @veye_xumm last edited by

                    @veye_xumm

                    If I use NV12 as described in sample4 I can only read frames with max 15FPS from the camera. This will not work for our application.

                    Can you show me an example which can read frames with 30FPS?

                    veye_xumm 1 Reply Last reply Reply Quote 0
                    • veye_xumm
                      veye_xumm @natzguk last edited by

                      @natzguk I believe the key issue lies in videoconvert and the display, which has low efficiency. You can refer to our GStreamer for previewing.

                      N 1 Reply Last reply Reply Quote 0
                      • N
                        natzguk @veye_xumm last edited by

                        @veye_xumm
                        I am not talking about previewing the frame. I am talking about simply reading the frame. No processing.

                        Here is the example with sample4:

                        import numpy as np
                        import cv2 as cv
                        import os
                        import time
                        
                        cap = cv.VideoCapture('v4l2src device=/dev/video0 ! video/x-raw, format=NV12, width=1920, height=1080, framerate=30/1 ! videoconvert ! appsink', cv.CAP_GSTREAMER)
                        
                        if not cap.isOpened():
                            print("Cannot capture from camera. Exiting.")
                            os._exit(0)
                        
                        last_time = time.time()
                        frame_count = 0
                        
                        while True:
                            ret, frame = cap.read()
                            if not ret:
                                break
                        
                            frame_count += 1
                            this_time = time.time()
                        
                            if this_time - last_time >= 1.0:
                                fps = frame_count / (this_time - last_time)
                                print(f"FPS: {fps}")
                                last_time = this_time
                                frame_count = 0
                        
                        
                        cap.release()
                        cv.destroyAllWindows()
                        
                        

                        Simply reading the frame is currently only getting 15 FPS on ROC-RK3588S-PC. I believe this is a driver issue with NV12.

                        veye_xumm 1 Reply Last reply Reply Quote 0
                        • veye_xumm
                          veye_xumm @natzguk last edited by

                          @natzguk pls try this:
                          https://github.com/veyeimaging/rk35xx_firefly/blob/main/linux/samples/gstreamer/veye camera/preview.sh

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post