Navigation

    VEYE IMAGING Forum

    • Register
    • Login
    • Search
    • Categories
    • Tags
    • Recent
    • Popular
    • Users
    • WIKI
    • veye.cc

    SOLVED MV-MIPI-GMAX4002M compatibility with Jetson Xavier NX, Orin NX

    Machine Vision camera
    3
    15
    2287
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • veye_xumm
      veye_xumm @newstec last edited by

      @newstec
      Please try veye_viewer.
      https://github.com/veyeimaging/veye_viewer/releases/tag/v0.1.1_jetson

      N 1 Reply Last reply Reply Quote 0
      • N
        newstec @veye_xumm last edited by

        @veye_xumm
        99.png

        Thanks for all the help!

        N 1 Reply Last reply Reply Quote 0
        • N
          newstec @newstec last edited by

          @veye_xumm Good news, it's working!

          I changed the port to "CAM1" (i2c-9).

          I believe the "v0.1.1_jetson" files were essential for proper operation.

          Thank you for your efforts in helping.

          44.jpg

          veye_xumm 1 Reply Last reply Reply Quote 0
          • veye_xumm
            veye_xumm @newstec last edited by

            @newstec Cheers!

            1 Reply Last reply Reply Quote 0
            • S
              STiwana last edited by

              Hi @veye_xumm
              I have an application that needs a very low latency (<10ms at maximum. Even less if possible) from capture to being available to the Jetson for real-tim processing. I read in some posts on the forum that veye cameras have more than 100ms latency due to ISP. In that case, is there any VEYE camera that I can still use? My requirements are:

              • Bigger pixel size for low light capture (the GMAX4002 seemed decent)
              • High frame rate (at least more than 60fps)
              • Ability to use a physical trigger signal
              • Very low latency (<10ms, even less if possible).

              Please guide me if there are any VEYE cameras which will satisfy my requirements. Thank you.

              veye_xumm 1 Reply Last reply Reply Quote 0
              • veye_xumm
                veye_xumm @STiwana last edited by

                @stiwana
                I think the post on the forum might have misled you. In fact, the latency of the VEYE series (models starting with VEYE-) is relatively high.
                The latency of the MV series, for instance MV-MIPI-GAMX4002M, is very low (below 1ms) because our ISP pipeline does not use frame buffering and only has a small amount of line buffering.

                S 1 Reply Last reply Reply Quote 0
                • S
                  STiwana @veye_xumm last edited by

                  @veye_xumm
                  Thanks so much for your answer. I am very glad I asked you this question. Of the latency is 1ms as you mention , then the rest looks suitable too. I will buy some to test.

                  Some follow up question:

                  1. With the MV-MIPI-GMAX4002 camera on Jetson, can I also use the camera inside a gstreamer pipeline (and also maintain the low latency)?
                  2. For the lowest latency and deterministic performance (the application will need to know exactly when the frame was acquired), what would you suggest with these cameras...use from opencv or gstreamer, or does it not matter? Any other tips you can give me for very low latency, real time performance with the MV cameras?
                  3. What's the usual lead time to buy these cameras in case the cameras are out of stock when purchasing (from a supply chain point of view when my device is in production)
                  4. How many years do you plan to keep these camera modules available for?

                  Best Regards

                  veye_xumm 1 Reply Last reply Reply Quote 0
                  • veye_xumm
                    veye_xumm @STiwana last edited by

                    @stiwana
                    https://wiki.veye.cc/index.php/Mv_series_camera_appnotes_4_jetson

                    For specific information, please refer to the link above. We provide a veye_viewer client for customers to initially get started and verify usage.

                    We haven't done extensive debugging on GStreamer yet. As for OpenCV, there are examples provided in the article above. Regarding the latency issue: although the camera itself has negligible delay, each image entering the Jetson system will experience some latency due to the V4L2 buffer, format conversion, and preview processes—all of which involve memory buffering queues.

                    The most fundamental solution is to develop your own program tailored to your product's specific needs, allowing flexible management of buffers. Additionally, note that the V4L2 buffer containing the camera images after they enter the Jetson system includes timestamps. It is recommended that you use these timestamps.

                    Regarding the supply of this product, we will maintain long-term availability unless the chip is discontinued. We will keep a regular inventory sufficient to meet retail demand. For bulk orders of several hundred units or more, the production cycle is typically within one month.

                    1 Reply Last reply Reply Quote 0
                    • S
                      STiwana last edited by STiwana

                      Hi @veye_xumm

                      I purchased the MV-MIPI-GMAX4002 camera with ADP-MV1-V2 adapter.

                      My setup is Jetson Xavier NX 8GB developer kit running nvidia-l4t-core 35.6.1.

                      I documented my "installation" process on the Jetson as following:

                      *** Get latest veye BSP:
                      wget https://github.com/veyeimaging/nvidia_jetson_veye_bsp/releases/latest/download/nvidia_jetson_veye_bsp.tar.gz
                      tar -xzvf nvidia_jetson_veye_bsp.tar.gz
                      cd nvidia_jetson_veye_bsp/

                      *** Find and extract the correct kernel image (mine is l4t_r35.6)
                      cd kernel_image/
                      tar -xzvf Image_l4t_r35.6_mvcam_patched_signed_4_xavier_orin.tgz

                      *** Make a backup of Old boot Image:
                      sudo cp /boot/Image /boot/Image.backup
                      sudo cp /boot/extlinux/extlinux.conf /boot/extlinux/extlinux.conf.backup

                      *** Copy Image files from extracted image folder to boot folder:
                      sudo cp Image/Image /boot/
                      sudo cp Image/Image.sig /boot/

                      *** Go back to main BSP extracted folder:
                      cd ..

                      *** Copy camera drivers (Jetpack 5.x)
                      sudo cp nvidia_jetson_veye_bsp/ko/$(uname -r)/* /lib/modules/$(uname -r)/kernel/drivers/media/i2c/ -f

                      *** Register the modules into the system:
                      sudo depmod

                      *** Copy the New Device Tree Blob (DTB) for MV cameras, my board (Xavier NX 8GB dev kit)
                      sudo cp dtbs/Xavier-NX/JetPack_5.1.4_Linux_JETSON_XAVIER_NX_TARGETS/dts\ dtb/MV-MIPI-CAM/tegra194-p3668-0000-p3509-0000.dtb /boot/

                      *** Update the bootloader CONFIGURATION
                      sudo nano /boot/extlinux/extlinux.conf

                      *** I copied the last configuration and modified it with name of my dtb file manually as following:
                      LABEL VeyeIO
                      MENU LABEL Custom Header Config: <VEYE MV-CAM Dual>
                      LINUX /boot/Image
                      FDT /boot/tegra194-p3668-0000-p3509-0000.dtb
                      INITRD /boot/initrd
                      APPEND ${cbootargs} root=PARTUUID=4210ce41-79b8-4264-8716-c03322463d38 rw rootwait rootfstype=ext4 console=ttyTCU0,115200n8 console=tty0 fbcon=map:0 net.ifnames=0 video=efifb:off nospectre_bhb nv
                      -auto-config

                      *** Then I pasted(appended) it to end of the .conf file

                      *** I also changed the second line in file to set new config as default:
                      DEFAULT VeyeIO

                      *** Reboot board:
                      sudo reboot

                      After this i powered off the Jetson, and connected the camera to the MIPI port, taking care of the MIPI cable directions (I took pictures..I will upload later from the phone). I also connected the 5V from the Jetson Xavier NX(pin4 for 5V, pin 6 for GND) to the ADP-MV1-V2 board. Anyway, after powering on the Jetson, I don't see any sign of the camera either with ls /dev/vid* or even if i do: sudo dmesg | grep "veye"

                      Can you give me some pointers where I may be going wrong??

                      veye_xumm 1 Reply Last reply Reply Quote 0
                      • veye_xumm
                        veye_xumm @STiwana last edited by

                        @stiwana
                        Please refer to the section below, part 8, for checking. Additionally, run sudo dmesg | grep mvcam to see if there is any output.

                        https://wiki.veye.cc/index.php/How_to_upgrade_the_Jetson_system_to_support_VEYE_cameras#Are_Image_and_DTB_upgrade_successful_.3F

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post