Posts made by Nathan Sinclair

@veye_xumm It reports i2c information, sensor is imx462, but i still couldn't get a preview of the camera.

Followed instructions in 327 instructions for raspberrypi

1. enabled legacy mode in bullseye raspi
2. ran ./veye_raspipreview -v -t -1 -p '0,0,1920,1080'
3. ran ./veye_raspistill -o ./test.jpg

here's the verbose output for the 2 commands

./veye_raspipreview -v -t -1 -p '0,0,1920,1080'
before create camera com time out -1

veye_raspipreview Camera App v0.3.7

Width 1920, Height 1080, filename (null)
Time delay -1, Timelapse 0
Link to latest frame enabled  no
Full resolution preview No
Capture method : Single capture

Preview Yes, Full screen No
Preview window 0,0,1920,1080
Opacity 255
Hardare version: 902120
before create camera com 
mmal: mmal_component_enable w 1920 h 1080 fps 30 

 raspipreview_create  com 

./veye_raspistill -o ./test.jpg
Hardare version: 902120
before create camera com sensor mode 0

Neither program produces any output. Confirmed that the camera is plugged correctly into the camera port.

Hello.

Just a query about whether it's possible to be sending the h264 video from the mipi-327 camera unedited, so that it can be displayed in a video element on a web page.
The way we are currently doing this, is using a library on the client side called jmuxer, which, through a websocket directly is able to display arducam cameras. Is there something similar with the mipi-327 camera as seen in libcamera-examples?

Hello,

Asking around what would be the best way to stream the mipi-327 camera over wifi, we have been looking into using gstreamer.

Is there any other library available to stream the camera (preferably mjpeg)

Thanks

Nathan

@veye_xumm Thank you for the quick response! Do you know if there will be support coming in future?

We are trialing using the banana pi m2-zero instead of raspberry pi zero going forward.
Has anyone had success running a veye arducam on the bananapi?

Thanks in advance.

Nathan

We're getting the following debug information when the camera doesn't display to screen.

veye/veye_raspcam/bin/veye_raspipreview -v -t -1 -p '0,0,1920,1080'
before create camera com time out -1

veye_raspipreview Camera App v0.3.7

Width 1920, Height 1080, filename (null)
Time delay -1, Timelapse 0
Link to latest frame enabled  no
Full resolution preview No
Capture method : Single capture

Preview Yes, Full screen No
Preview window 0,0,1920,1080
Opacity 255
Hardare version: 9000c1
before create camera com 
mmal: mmal_component_enable w 1920 h 1080 fps 30 

 raspipreview_create  com 

It doesn't do it all the time but it's come up often enough that it is a serious issue. We found if you restart the pi that it displays camera.

@veye_xumm were able to get it working. This is resolved for us.

@veye_xumm We're using buster.

Here's the steps i followed to replicate issue:

1. run ./enable_i2c_vc.sh
2. Run ./camera_i2c_config
3. Run a few commands on i2c (mirror mode)
4. Run ./veye_raspipreview -t -1 -p '0,0,1920,1080'

My system does not have an i2c line but is getting it from the csi cable. Camera and i2c enabled in raspi-config.

Expected Result:
Camera appears on screen

Actual Result:

./veye_raspipreview -t -1 -p '0,0,1920,1080'
before create camera com time out -1
Hardare version: 9000c1
before create camera com 
mmal: mmal_component_create_core: could not find component 'vc.ril.rawcam'
mmal: Failed to create camera component
mmal: main: Failed to create camera component

I did another test and worked out it's not likely to do with i2c, i reformatted sd card with a backed up image and it does the same thing as this.
I can confirm that the camera IS working as I have another image which uses the VEYE_MPI-327 and it's working without issue,

Here's the verbose log.

before create camera com time out -1

veye_raspipreview Camera App v0.3.7

Width 1920, Height 1080, filename (null)
Time delay -1, Timelapse 0
Link to latest frame enabled  no
Full resolution preview No
Capture method : Single capture

Preview Yes, Full screen No
Preview window 0,0,1920,1080
Opacity 255
Hardare version: 9000c1
before create camera com 
mmal: mmal_component_create_core: could not find component 'vc.ril.rawcam'
mmal: Failed to create camera component
mmal: main: Failed to create camera component

@veye_xumm I was just looking at the i2c program. Call this resolved.

@veye_xumm
I'm not familiar with the raspividyuv program.
I am using the following command piped to my python program:

LiveCamera.pipe = subprocess.Popen(['/home/pi/veye/veye_raspcam/bin/veye_raspividyuv', '-t', '0','-o', '-'], stdout=subprocess.PIPE)

Got it going but it appears only to run maybe a few frames per second.
Also I'm neeeding a time frame in order to get this working. It's very important that we get this flipping going for a client. To be specific:
We're using a pi zero with a usb camera and MIPI-327 and both of these cameras need to be able to be flipped in the event the camera goes upside down. We're using python because a library exists for it that allows us to display the video streams without a gui. Arducam software needs to be able to run at 30fps at 1080p.
Isn't MJPEG an option that can be used? i just need a way to get the right data from the mjpeg stream and then i'm okay.
What data is being sent based on the codec option MJPEG or H264. I just need to know where the data is and use opencv to convert it to an image.

@veye_xumm I think from previous correspondence capture2opencv was only capable of capturing 1 frame per second, we're needing a live feed. I should have said that earlier. I'll have a look at it though. Trying out the YUV. will report what i find.

@nathan-sinclair @veye_xumm
Okay here's the progress i've made.
command uses MJPEG codec and rgb rawformat.
Pythoncode:
start_pipe

LiveCamera.pipe = subprocess.Popen(['/home/pi/veye/veye_raspcam/bin/veye_raspivid', '-cd', 'MJPEG', '-rf', 'rgb', '-n',  '-t', '0', '-o', '-'], stdout=subprocess.PIPE)

read from pipe

raw_image = LiveCamera.pipe.stdout.read(LiveCamera.width * LiveCamera.height * 3)
a = raw_image.find(b'xffxd8')  # JPEG start
b = raw_image.find(b'xffxd9')  # JPEG end
if a != -1 and b != -1:
    jpg = raw_image[a:b + 2]  # actual image
    bytesarray = raw_image[b + 2:]  # other informations

    # decode to colored image
    image = cv2.imdecode(np.fromstring(jpg, dtype=np.uint8), cv2.IMREAD_COLOR)

Doesn't read any data at the moment.

@veye_xumm
Has issues running on pi zero. When installing:
usage: sudo ./install_driver.sh veyecam2m/veye327/csimx307/cssc132
Enable i2c0 adapter...
./install_driver.sh: line 81: 741 Segmentation fault sudo modprobe i2c-dev
Add dtoverlay=veye327 to /boot/config.txt
Add gpu=400M to /boot/config.txt
Add cma=128M to /boot/cmdline.txt
Installing the veye327.ko driver
install: cannot stat './driver_bin/5.10.63+/veye327.ko': No such file or directory
install: cannot stat './driver_bin/5.10.63+/veye327.dtbo': No such file or directory
./install_driver.sh: line 116: 769 Segmentation fault sudo /sbin/depmod -a $(uname -r)

I'm piping the contents of this command to a python program which accepts a numpy array for displaying to screen.

veye_raspivid -t -1 -o -

In what raw data format is this command transmitting raw video?

Hello

I'm attempting to build a gstreamer pipeline to flip a video stream received from the VEYE-327.

I've been working with the wiki provided for using on pi zero.
This is what i currently have:
./veye_raspivid -n -b 4000000 -t 10000000 -o - | gst-launch-1.0 -v fdsrc ! videoflip method=clockwise ! videoconvert ! fbdevsink

Which throws an error at fdsrc... I'm guessing from other tests that what is happening here is the gstreamer goes into a play state but can't play.

This is the output.
camera num -1
mmal: mmal_component_enable w 1920 h 1080

raspipreview_create com
mmal: Splitter has 4 output port,you could use num 2,3 for extend
mmal: file handle is stdout!
mmal: running now!!
mmal: wait_for_next_change: time out here !
mmal: running stop!! 0
Setting pipeline to PAUSED ...
Pipeline is PREROLLING ...

(gst-launch-1.0:1414): GStreamer-CRITICAL **: 16:11:42.517: gst_segment_to_stream_time: assertion 'segment->format == format' failed
ERROR: from element /GstPipeline:pipeline0/GstFdSrc:fdsrc0: Internal data stream error.
Additional debug info:
gstbasesrc.c(3055): gst_base_src_loop (): /GstPipeline:pipeline0/GstFdSrc:fdsrc0:
streaming stopped, reason not-negotiated (-4)
ERROR: pipeline doesn't want to preroll.
Setting pipeline to NULL ...
Freeing pipeline ...

@veye_xumm This is new territory for me...
Libcairo says it works on x window systems. Is it possible to use libcairo on pi zero headless?

@veye_xumm
Is there source code for raspivid?

Hello,
We are looking to use some image manipulation with opencv to write some text onto the image and display on hdmi as part of a system that accepts a numpy array for displaying on a headless pi zero. So it requires this camera to be streaming real time, at preferably 60fps, but 30fps is fine.

For this to work we need a fast video stream display with the IMX327S. I looked at the opencv example which says "displaying a YUV stream with opencv" however the frame rate is very slow. It's only getting a frame probably every 3 seconds.

Here is the code that I have used.

camera = Dcam.mipi_camera()
        print("Open camera...")
        camera.init_camera()

        while LiveCamera.running:
            height = int(align_up(1080, 16))
            width = int(align_up(1920, 32))
            if LiveCamera.first is False:
                LiveCamera.first = True
                print("-----live------")
                print("height:" + str(height))
                print("width:" + str(width))
                print("frame is read")
                print("------------------")
            frame = camera.capture(encoding='i420')
            #3133440

            image = frame.as_array.reshape(int(height*1.5), width)
            image = cv2.cvtColor(image, cv2.COLOR_YUV2BGR_I420)
            dst = cv2.cvtColor(image, cv2.COLOR_BGR2RGB)

            LiveCamera.frame = dst
            camera.release_buffer(frame)
            del frame
            sleep(0)

If the camera could be used with the picamera library, that would be ideal, though i didn't find any information for setting it up with picamera.
Or if there is a way to place overlays on the imx327S this would be a solution as well
Quick update...
Sometimes the camera loads at start up, other times it reports a select time out and segmentation fault. We are running an additional camera with the system and unsure at this stage if it is a result of this other camera. will do more testing on it.