sample_pipeline Usage Guide

Function Overview

sample_pipeline is used to implement single or multi-sensor pipeline concatenation, covering common user pipeline scenarios. Users can learn how to build various pipelines by exploring the subdirectories under sample_pipeline.

sample_pipeline Architecture Description

sample_pipeline contains multiple examples, each residing as a subdirectory under app/multimedia_samples/sample_pipeline. Each subdirectory is described below:

Directory	Description
single_pipe_vin_isp_ynr_pym_vpu	Example of a simple single-sensor pipeline concatenated with encoding
single_pipe_vin_isp_ynr_pym_gdc	Example of a single-sensor pipeline concatenated with GDC transformation
single_pipe_vin_isp_ynr_pym_gdc_vpu	Example of a single-sensor pipeline concatenated with GDC transformation and encoding
multi_pipe_vin_isp_ynr_pym_gdc_vpu	Example of a multi-sensor pipeline concatenated with encoding
uvc_capture_sample	UVC camera capture example

single_pipe_vin_isp_ynr_pym_vpu

Function Overview

The single_pipe_vin_isp_ynr_pym_vpu example concatenates the VIN, ISP, PYM, and CODEC modules, representing one of the most fundamental module concatenation examples. The image from the Camera Sensor passes through VIN and ISP processing before reaching the PYM module. The PYM module is configured with six output channels as follows:

Channel 0 outputs the full-resolution image processed by ISP and YNR. The output data from this channel is then fed into an encoder and saved as an H264 video stream.
Channel 1 outputs an NV12-formatted image scaled down by a factor of 2 in both width and height, aligned to 16 pixels.
Channel 2 outputs an NV12-formatted image scaled down by a factor of 4 in both width and height, aligned to 16 pixels.
Channel 3 outputs an NV12-formatted image scaled down by a factor of 8 in both width and height, aligned to 16 pixels.
Channel 4 outputs an NV12-formatted image scaled down by a factor of 16 in both width and height, aligned to 16 pixels.
Channel 5 outputs an NV12-formatted image scaled down by a factor of 32 in both width and height, aligned to 16 pixels.

Note: The minimum resolution supported by PYM output is 32. If either the scaled width or height is smaller than 32, the image will not be saved.

Code Location and Directory Structure

Code location: /app/multimedia_samples/sample_pipeline/single_pipe_vin_isp_ynr_pym_vpu
Directory structure:

single_pipe_vin_isp_ynr_pym_vpu
├── Makefile
└── single_pipe_vin_isp_ynr_pym_vpu.c

Compilation

Enter the single_pipe_vin_isp_ynr_pym_vpu directory and run make to compile.
The compiled binary is named single_pipe_vin_isp_ynr_pym_vpu and located in the source directory.

Execution

How to Run the Program

Directly executing ./single_pipe_vin_isp_ynr_pym_vpu displays help information:

# ./single_pipe_vin_isp_ynr_pym_vpu
No sensors specified.
Usage: single_pipe_vin_isp_ynr_pym_vpu [OPTIONS]
Options:
  -s <sensor_index>      Specify sensor index
  -l <link_port>         Specify the port for connecting serdes sensors, 0:A 1:B 2:C 3:D
  -h                     Show this help message
index: 0  sensor_name: imx219-30fps             config_file:linear_1920x1080_raw10_30fps_1lane.c
index: 1  sensor_name: sc1336_gmsl-30fps        config_file:linear_1280x720_raw10_30fps_2lane.c
index: 2  sensor_name: ar0820std-30fps          config_file:linear_3840x2160_30fps_1lane.c
index: 3  sensor_name: ar0820std-1080p30        config_file:linear_1920x1080_yuv_30fps_1lane.c

Program Option Descriptions

-s: Specifies the Camera Sensor model and configuration.
-l: Specifies the Link Port for Serdes-type sensors (e.g., Port A corresponds to -l 0).

Runtime Behavior

The single_pipe_vin_isp_ynr_pym_vpu program produces the following outputs:

Saves an NV12 image from each PYM output channel to the current working directory every 60 frames.
Feeds the output from PYM channel 0 into an encoder and saves the encoded stream to a file.

Example: Using imx219 as the sensor input, execute ./single_pipe_vin_isp_ynr_pym_vpu -s 0.

Sample log output:

# ./single_pipe_vin_isp_ynr_pym_vpu -s 0
Using index:0  sensor_name:imx219-30fps  config_file:linear_1920x1080_raw10_30fps_1lane.c
mipi mclk is not configed.
Searching camera sensor on device: /proc/device-tree/soc/vcon@0 i2c bus: 1 mipi rx phy: 0
mipi rx used phy: 00000000
mipi mclk is not configed.
Searching camera sensor on device: /proc/device-tree/soc/vcon@1 i2c bus: 2 mipi rx phy: 1
mipi rx used phy: 00000000
INFO: Found sensor_name:imx219-30fps on mipi rx csi 1, i2c addr 0x10, config_file:linear_1920x1080_raw10_30fps_1lane.c
        [0] use [isp + ynr].
                vin [hw:1]
                isp [hw:1] [slot_id:0] [mode:1]
                ynr [hw:1] [slot_id:0] [mode:1]
                pym [hw:1] [slot_id:0] [mode:1]
                vin ->online-> isp ->online-> ynr ->online-> pym

INFO: ISP channel info:
        input info: [mipi_rx: 1] [is_online: 1]
        isp channel info: [hw_id: 1] [slot_id: 0] [mode:1]

pym config:
        ichn input width = 1920, height = 1080
        ochn[0] ratio= 1, width = 1920, height = 1080 wstride=1920 vstride=1080 out[1920*1080]
        ochn[1] ratio= 2, width = 960, height = 540 wstride=960 vstride=540 out[960*540]
        ochn[2] ratio= 4, width = 480, height = 270 wstride=480 vstride=270 out[480*270]
        ochn[3] ratio= 8, width = 240, height = 134 wstride=240 vstride=134 out[240*134]
        ochn[4] ratio= 16, width = 120, height = 66 wstride=128 vstride=66 out[120*66]
        ochn[5] ratio= 32, width = 60, height = 32 wstride=64 vstride=32 out[60*32]

Encode idx: 0, init successful
####################### pym chn 0 #######################
=== Frame Info ===
Frame ID: 1
Timestamps: 1960130089350
tv: 1746703610.867799
trig_tv: 1746703610.867799
Frame Done: 8
Buffer Index: 0

=== Graphic Buffer ===
File Descriptors: 26 -1 -1
Plane Count: 2
Format: 8
Width: 1920
Height: 1080
Stride: 1920
Vertical Stride: 1080
Is Contiguous: 1
Share IDs: 181 0 0
Flags: 67108881
Sizes: 2073600 1036800 0
Virtual Addresses: 0xffff849f0000 0xffff84bea400 (nil)
Physical Addresses: 17296588800 17298662400 0
Offsets: 0 0 0
####################### pym chn 1 #######################
=== Frame Info ===
Frame ID: 1
Timestamps: 1960130089350
tv: 1746703610.867799
trig_tv: 1746703610.867799
Frame Done: 8
Buffer Index: 0

=== Graphic Buffer ===
File Descriptors: 27 -1 -1
Plane Count: 2
Format: 8
Width: 960
Height: 540
Stride: 960
Vertical Stride: 540
Is Contiguous: 1
Share IDs: 182 0 0
Flags: 67108881
Sizes: 518400 259200 0
Virtual Addresses: 0xffff84930000 0xffff849ae900 (nil)
Physical Addresses: 17299734528 17300252928 0
Offsets: 0 0 0
####################### pym chn 2 #######################
=== Frame Info ===
Frame ID: 1
Timestamps: 1960130089350
tv: 1746703610.867799
trig_tv: 1746703610.867799
Frame Done: 8
Buffer Index: 0

=== Graphic Buffer ===
File Descriptors: 28 -1 -1
Plane Count: 2
Format: 8
Width: 480
Height: 270
Stride: 480
Vertical Stride: 270
Is Contiguous: 1
Share IDs: 183 0 0
Flags: 67108881
Sizes: 129600 64800 0
Virtual Addresses: 0xffff84900000 0xffff8491fa40 (nil)
Physical Addresses: 17300520960 17300650560 0
Offsets: 0 0 0
####################### pym chn 3 #######################
=== Frame Info ===
Frame ID: 1
Timestamps: 1960130089350
tv: 1746703610.867799
trig_tv: 1746703610.867799
Frame Done: 8
Buffer Index: 0

=== Graphic Buffer ===
File Descriptors: 29 -1 -1
Plane Count: 2
Format: 8
Width: 240
Height: 134
Stride: 240
Vertical Stride: 134
Is Contiguous: 1
Share IDs: 184 0 0
Flags: 67108881
```Sizes: 32160 16080 0  
Virtual Addresses: 0xffff848f0000 0xffff848f7da0 (nil)  
Physical Addresses: 17300717568 17300749728 0  
Offsets: 0 0 0  
####################### pym chn 4 #######################  
=== Frame Info ===  
Frame ID: 1  
Timestamps: 1960130089350  
tv: 1746703610.867799  
trig_tv: 1746703610.867799  
Frame Done: 8  
Buffer Index: 0  

=== Graphic Buffer ===  
File Descriptors: 30 -1 -1  
Plane Count: 2  
Format: 8  
Width: 120  
Height: 66  
Stride: 128  
Vertical Stride: 66  
Is Contiguous: 1  
Share IDs: 185 0 0  
Flags: 67108881  
Sizes: 8448 4224 0  
Virtual Addresses: 0xffff848e0000 0xffff848e2100 (nil)  
Physical Addresses: 17300783104 17300791552 0  
Offsets: 0 0 0  
####################### pym chn 5 #######################  
=== Frame Info ===  
Frame ID: 1  
Timestamps: 1960130089350  
tv: 1746703610.867799  
trig_tv: 1746703610.867799  
Frame Done: 8  
Buffer Index: 0  

=== Graphic Buffer ===  
File Descriptors: 31 -1 -1  
Plane Count: 2  
Format: 8  
Width: 60  
Height: 32  
Stride: 64  
Vertical Stride: 32  
Is Contiguous: 1  
Share IDs: 186 0 0  
Flags: 67108881  
Sizes: 2048 1024 0  
Virtual Addresses: 0xffff848d0000 0xffff848d0800 (nil)  
Physical Addresses: 17300848640 17300850688 0  
Offsets: 0 0 0  
...  

The following files will be saved at runtime:

single_pipe_vin_isp_ynr_pym_vpu.h264  
pym_output_nv12_chn0_1920x1080_stride_1920_count_0.yuv  
pym_output_nv12_chn1_960x540_stride_960_count_0.yuv  
pym_output_nv12_chn2_480x270_stride_480_count_0.yuv  
pym_output_nv12_chn3_240x134_stride_240_count_0.yuv  
pym_output_nv12_chn4_120x66_stride_128_count_0.yuv  
pym_output_nv12_chn5_60x32_stride_64_count_0.yuv  
... ...  

single_pipe_vin_isp_ynr_pym_gdc

Function Overview

The single_pipe_vin_isp_ynr_pym_gdc sample demonstrates a basic pipeline that chains together the VIN, ISP, PYM, and GDC modules. The image from the camera sensor passes through the VIN, ISP, and PYM modules before reaching the GDC module, which applies geometric distortion correction based on a GDC bin file to generate YUV images.

Code Location and Directory Structure

Code location: /app/multimedia_samples/sample_pipeline/single_pipe_vin_isp_ynr_pym_gdc
Directory structure:

single_pipe_vin_isp_ynr_pym_gdc  
├── Makefile  
└── single_pipe_vin_isp_ynr_pym_gdc.c  

Compilation

Enter the single_pipe_vin_isp_ynr_pym_gdc directory and run make to compile.
The output binary will be single_pipe_vin_isp_ynr_pym_gdc in the source directory.

Execution

How to Run the Program

Running the program directly (./single_pipe_vin_isp_ynr_pym_gdc) displays help information:

# ./single_pipe_vin_isp_ynr_pym_gdc  
No sensors specified.  
Usage: single_pipe_vin_isp_pym_vpu [OPTIONS]  
Options:  
  -s <sensor_index>      Specify sensor index  
  -l <link_port>         Specify the port for connecting serdes sensors, 0:A 1:B 2:C 3:D  
  -f <gdc_bin_file>      Specify sensor gdc_bin_file path  
  -h                     Show this help message  
index: 0  sensor_name: imx219-30fps             config_file:linear_1920x1080_raw10_30fps_1lane.c  
index: 1  sensor_name: sc1336_gmsl-30fps        config_file:linear_1280x720_raw10_30fps_2lane.c  
index: 2  sensor_name: ar0820std-30fps          config_file:linear_3840x2160_30fps_1lane.c  
index: 3  sensor_name: ar0820std-1080p30        config_file:linear_1920x1080_yuv_30fps_1lane.c  
index: 4  sensor_name: ovx3cstd-30fps           config_file:linear_1920x1280_yuv_30fps_1lane.c  

Program Option Descriptions

-s: Specifies the camera sensor model and configuration.
-l: Specifies the link port for SerDes-type sensors (e.g., Port A corresponds to -l 0).

Note

The link port value must match the physical port on the deserializer to which the SerDes sensor is connected. Ensure the sensor is connected to the specified port.

Runtime Behavior

The single_pipe_vin_isp_ynr_pym_gdc program outputs the following:

Saves one NV12 image from each GDC output channel to the current working directory every 30 frames.

Example: Using imx219 as the sensor input, run:
./single_pipe_vin_isp_ynr_pym_gdc -s 0 -f ../../vp_sensors/gdc_bin/imx219_gdc.bin

Sample log output:

# ./single_pipe_vin_isp_ynr_pym_gdc -s 0 -f ../../vp_sensors/gdc_bin/imx219_gdc.bin  
Using index:0  sensor_name:imx219-30fps  config_file:linear_1920x1080_raw10_30fps_1lane.c  
mipi mclk is not configed.  
Searching camera sensor on device: /proc/device-tree/soc/vcon@0 i2c bus: 1 mipi rx phy: 0  
mipi rx used phy: 00000000  
mipi mclk is not configed.  
Searching camera sensor on device: /proc/device-tree/soc/vcon@1 i2c bus: 2 mipi rx phy: 1  
mipi rx used phy: 00000000  
INFO: Found sensor_name:imx219-30fps on mipi rx csi 1, i2c addr 0x10, config_file:linear_1920x1080_raw10_30fps_1lane.c  
        [0] use [isp + ynr].  
                vin [hw:1]  
                isp [hw:1] [slot_id:0] [mode:1]  
                ynr [hw:1] [slot_id:0] [mode:1]  
                pym [hw:1] [slot_id:0] [mode:1]  
                vin ->online-> isp ->online-> ynr ->online-> pym  

INFO: ISP channel info:  
        input info: [mipi_rx: 1] [is_online: 1]  
        isp channel info: [hw_id: 1] [slot_id: 0] [mode:1]  

pym config:  
        ichn input width = 1920, height = 1080  
        ochn[0] ratio= 1, width = 1920, height = 1080 wstride=1920 vstride=1080 out[1920*1080]  
        ochn[1] ratio= 2, width = 960, height = 540 wstride=960 vstride=540 out[960*540]  
        ochn[2] ratio= 4, width = 480, height = 270 wstride=480 vstride=270 out[480*270]  
        ochn[3] ratio= 8, width = 240, height = 134 wstride=240 vstride=134 out[240*134]  
        ochn[4] ratio= 16, width = 120, height = 66 wstride=128 vstride=66 out[120*66]  
        ochn[5] ratio= 32, width = 60, height = 32 wstride=64 vstride=32 out[60*32]  

gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 1, timestamp: 21677343453900  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 31, timestamp: 21678330776125  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 61, timestamp: 21679318103925  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 91, timestamp: 21680305428000  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 121, timestamp: 21681292757750  

The following files will be saved at runtime:

gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_121_ts_21681292757750.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_1_ts_21677343453900.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_31_ts_21678330776125.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_61_ts_21679318103925.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_91_ts_21680305428000.yuv  
... ...  

single_pipe_vin_isp_ynr_pym_gdc_vpu

Function Overview

The single_pipe_vin_isp_ynr_pym_gdc_vpu sample demonstrates a basic pipeline chaining the VIN, ISP, YNR, PYM, GDC, and CODEC modules. The camera sensor image flows through VIN, ISP, YNR, and PYM modules, then reaches the GDC module. GDC applies geometric distortion correction using a GDC bin file to produce YUV images, which are then passed to the encoder and saved as an H.264 video bitstream.

Code Location and Directory Structure

Code location: /app/multimedia_samples/sample_pipeline/single_pipe_vin_isp_ynr_pym_gdc_vpu
Directory structure:

single_pipe_vin_isp_ynr_pym_gdc_vpu  
├── Makefile  
└── single_pipe_vin_isp_ynr_pym_gdc_vpu.c  

Compilation

Enter the single_pipe_vin_isp_ynr_pym_gdc_vpu directory and run make to compile.
The output binary will be single_pipe_vin_isp_ynr_pym_gdc_vpu in the source directory.

Execution

How to Run the Program

Running the program directly (./single_pipe_vin_isp_ynr_pym_gdc_vpu) displays help information:

# ./single_pipe_vin_isp_ynr_pym_gdc_vpu  
No sensors specified.  
```Usage: single_pipe_vin_isp_pym_vpu [OPTIONS]  
Options:  
  -s <sensor_index>      Specify sensor index  
  -l <link_port>         Specify the port for connecting serdes sensors, 0:A 1:B 2:C 3:D  
  -f <gdc_bin_file>      Specify sensor gdc_bin_file path  
  -h                     Show this help message  
index: 0  sensor_name: imx219-30fps             config_file:linear_1920x1080_raw10_30fps_1lane.c  
index: 1  sensor_name: sc1336_gmsl-30fps        config_file:linear_1280x720_raw10_30fps_2lane.c  
index: 2  sensor_name: ar0820std-30fps          config_file:linear_3840x2160_30fps_1lane.c  
index: 3  sensor_name: ar0820std-1080p30        config_file:linear_1920x1080_yuv_30fps_1lane.c  
index: 4  sensor_name: ovx3cstd-30fps           config_file:linear_1920x1280_yuv_30fps_1lane.c  

Program Parameter Options Description

-s: Specify the Camera Sensor model and configuration.
-l: Specify the Link Port for Serdes-type sensors. For example, if connected to Port A, specify as 0: -l 0.

Note

The value for the link setting depends on the port to which the Serdes sensor is connected on the deserializer. Please ensure the Serdes sensor is connected to the specified port.

Execution Results

The output of single_pipe_vin_isp_ynr_pym_gdc_vpu is as follows:

Saves one NV12 image from each GDC output channel to the current working directory every 30 frames.
Sends the GDC channel output images to the encoder for encoding and saves the encoded data to files.

Example: Using imx219 as the sensor input, execute:
./single_pipe_vin_isp_ynr_pym_gdc_vpu -s 0 -f ../../vp_sensors/gdc_bin/imx219_gdc.bin

Sample log output:

# ./single_pipe_vin_isp_ynr_pym_gdc_vpu -s 0 -f ../../vp_sensors/gdc_bin/imx219_gdc.bin  
Using index:0  sensor_name:imx219-30fps  config_file:linear_1920x1080_raw10_30fps_1lane.c  
mipi mclk is not configed.  
Searching camera sensor on device: /proc/device-tree/soc/vcon@0 i2c bus: 1 mipi rx phy: 0  
mipi rx used phy: 00000000  
mipi mclk is not configed.  
Searching camera sensor on device: /proc/device-tree/soc/vcon@1 i2c bus: 2 mipi rx phy: 1  
mipi rx used phy: 00000000  
INFO: Found sensor_name:imx219-30fps on mipi rx csi 1, i2c addr 0x10, config_file:linear_1920x1080_raw10_30fps_1lane.c  
        [0] use [isp + ynr].  
                vin [hw:1]  
                isp [hw:1] [slot_id:0] [mode:1]  
                ynr [hw:1] [slot_id:0] [mode:1]  
                pym [hw:1] [slot_id:0] [mode:1]  
                vin ->online-> isp ->online-> ynr ->online-> pym  

INFO: ISP channel info:  
        input info: [mipi_rx: 1] [is_online: 1]  
        isp channel info: [hw_id: 1] [slot_id: 0] [mode:1]  

pym config:  
        ichn input width = 1920, height = 1080  
        ochn[0] ratio= 1, width = 1920, height = 1080 wstride=1920 vstride=1080 out[1920*1080]  
        ochn[1] ratio= 2, width = 960, height = 540 wstride=960 vstride=540 out[960*540]  
        ochn[2] ratio= 4, width = 480, height = 270 wstride=480 vstride=270 out[480*270]  
        ochn[3] ratio= 8, width = 240, height = 134 wstride=240 vstride=134 out[240*134]  
        ochn[4] ratio= 16, width = 120, height = 66 wstride=128 vstride=66 out[120*66]  
        ochn[5] ratio= 32, width = 60, height = 32 wstride=64 vstride=32 out[60*32]  

Encode idx: 0, init successful  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 1, timestamp: 21970340530375  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 31, timestamp: 21971327856500  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 61, timestamp: 21972315184900  
gdc(296805) dump yuv 1920x1080(stride:1920), buffer size: 2073600 + 1036800 frame id: 91, timestamp: 21973302504675  

The following files will be saved during execution:

single_pipe_vin_isp_ynr_pym_gdc_vpu.h264  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_1_ts_21970340530375.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_31_ts_21971327856500.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_61_ts_21972315184900.yuv  
gdc_handle_296805_chn0_1920x1080_stride_1920_frameid_91_ts_21973302504675.yuv  
... ...  

multi_pipe_vin_isp_ynr_pym_gdc_vpu

Function Overview

multi_pipe_vin_isp_ynr_pym_gdc_vpu supports simultaneous input from multiple sensors and processes video streams through multiple processing modules such as VIN, ISP, PYM, GDC, and CODEC.

Notes:

The GDC module requires a bin file as input. This sample program searches for bin files in the directory /app/multimedia_samples/vp_sensors/gdc_bin. The GDC module runs only if a suitable bin file is found.
The CODEC module requires a minimum input resolution of 256 (width) × 128 (height). If the output resolution of the selected PYM channel is smaller than this minimum, the program will exit immediately.

Code Location and Directory Structure

Code location: /app/multimedia_samples/sample_pipeline/multi_pipe_vin_isp_ynr_pym_gdc_vpu
Directory structure:

multi_pipe_vin_isp_ynr_pym_gdc_vpu  
├── Makefile  
└── multi_pipe_vin_isp_ynr_pym_gdc_vpu.c  

Compilation

Enter the multi_pipe_vin_isp_ynr_pym_gdc_vpu directory and run make to compile.
The output binary is multi_pipe_vin_isp_ynr_pym_gdc_vpu, located in the source directory.

Execution

How to Run the Program

Execute ./multi_pipe_vin_isp_ynr_pym_gdc_vpu directly to display help information:

# ./multi_pipe_vin_isp_ynr_pym_gdc_vpu  
Usage: multi_pipe_vin_isp_ynr_pym_gdc_vpu [Options]  
Options:  
-c, --config="sensor=id link=port channel=pym_chn type=TYPE output=FILE, 'channel' and 'type' and 'output' is not mandatory"  
                Configure parameters for each video pipeline, can be repeated up to 6 times  
                sensor   --  Sensor index, can have multiple parameters, reference sensor list.  
                link     --  Specify the port for connecting serdes sensors, 0:A 1:B 2:C 3:D, can be set to [0-3].  
                channel  --  Pym channel index bind to encode, default 0, can be set to [0-5].  
                type     --  Encode type, default is h264, can be set to [h264, h265].  
                output   --  Save codec stream data to file, default is 'pipeline[xx]_[width]x[height]_[xxx]fps.[type]'.  
-v, --verbose   Enable verbose mode  
-h, --help      Show help message  
Support sensor list:  
index: 0  sensor_name: imx219-30fps             config_file:linear_1920x1080_raw10_30fps_1lane.c  
index: 1  sensor_name: sc1336_gmsl-30fps        config_file:linear_1280x720_raw10_30fps_2lane.c  
index: 2  sensor_name: ar0820std-30fps          config_file:linear_3840x2160_30fps_1lane.c  
index: 3  sensor_name: ar0820std-1080p30        config_file:linear_1920x1080_yuv_30fps_1lane.c  

Program Parameter Options Description

-c, --config="sensor=id channel=vse_chn type=TYPE output=FILE"
- Configures parameters for each video pipeline. This option can be repeated multiple times (up to 6).
- sensor is mandatory; channel, type, and output are optional. If not specified, the program uses default values.
- sensor: Sensor index (mandatory). Multiple parameters are allowed; refer to the sensor list.
- link: Link Port for Serdes-type sensors (ignored for MIPI-type sensors). For example, if connected to Port A, specify as 0: -l 0.
- channel: VSE channel index (optional, default: 0, range: [0–5]).
- type: Encoding type (optional, default: h264, options: [h264, h265]).
- output: Filename for saving encoded stream data (optional, default: pipeline[xx]_[width]x[height]_[xxx]fps.[type]).
-v, --verbose
- Enables verbose mode.
-h, --help
- Displays help information.

Notes:

Serdes-type sensors must specify a Link Port.
To adjust the number of video pipelines, simply add or remove -c parameter sets.

Execution Results

The output of multi_pipe_vin_isp_ynr_pym_gdc_vpu: Each video processing pipeline encodes the processed video stream into H.264/H.265 format and saves it to a file.

Example:

Use imx219 (MIPI-type) and sc1336 (Serdes-type) as sensor inputs.
Execute the command:
./multi_pipe_vin_isp_ynr_pym_gdc_vpu -c "sensor=0" -c "sensor=1 link=0"

Sample log output:

#./multi_pipe_vin_isp_ynr_pym_gdc_vpu -c "sensor=0"  -c"sensor=1 link=0"  
Using index:0  sensor_name:imx219-30fps  config_file:linear_1920x1080_raw10_30fps_1lane.c  
sensor_type:0  
mipi mclk is not configed.  
Searching camera sensor on device: /proc/device-tree/soc/vcon@0 i2c bus: 1 mipi rx phy: 0  
mipi rx used phy: 00000000  
mipi mclk is not configed.  
Searching camera sensor on device: /proc/device-tree/soc/vcon@1 i2c bus: 2 mipi rx phy: 1  
mipi rx used phy: 00000000  
INFO: Found sensor_name:imx219-30fps on mipi rx csi 1, i2c addr 0x10, config_file:linear_1920x1080_raw10_30fps_1lane.c  
MIPI host: 0x2  
  Host 1: Used  
Using index:1  sensor_name:sc1336_gmsl-30fps  config_file:linear_1280x720_raw10_30fps_2lane.c  
sensor_type:1  
MIPI host: 0x2  
  Host 1: Used  
Pipeline index 0:  
        Sensor index: 0  
        Sensor name: imx219-30fps  
        Active mipi host: 1  
        PYM Channel: 0  
        Encode type: h264  
Pipeline index 1:  
        Sensor index: 0  
        Sensor name: sc1336_gmsl-30fps  
        Active mipi host: 4  
        PYM Channel: 0  
        Encode type: h264  
Verbose: 0  

Pipeline Connect Param:  
        [0] use [isp + ynr].  
                isp [hw:1] [slot_id:4] [mode:1]  
                ynr [hw:1] [slot_id:4] [mode:1]  
                pym [hw:1] [slot_id:4] [mode:1]  
        [1] use [isp + ynr].  
                isp [hw:1] [slot_id:5] [mode:1]  
                ynr [hw:1] [slot_id:5] [mode:1]  
                pym [hw:1] [slot_id:5] [mode:1]  

INFO: ISP channel info:  
        input info: [mipi_rx: 1] [is_online: 1]
        isp channel info: [hw_id: 1] [slot_id: 4] [mode:1]

pym config:
        ichn input width = 1920, height = 1080
        ochn[0] ratio= 1, width = 1920, height = 1080 wstride=1920 vstride=1080 out[1920*1080]
        ochn[1] ratio= 2, width = 960, height = 540 wstride=960 vstride=536 out[960*536]
        ochn[2] ratio= 4, width = 480, height = 270 wstride=480 vstride=264 out[480*264]
        ochn[3] ratio= 8, width = 240, height = 134 wstride=240 vstride=128 out[240*128]
        ochn[4] ratio= 16, width = 120, height = 66 wstride=128 vstride=64 out[120*64]
        ochn[5] ratio= 32, width = 60, height = 32 wstride=64 vstride=32 out[56*32]

        [0] use [gdc].
[0] encoder input resolution is 1920*1080, output file is pipeline0_1920x1080_30fps.h264.
Create Encode idx: 0, init successful
vc_index:0

INFO: ISP channel info:
        input info: [mipi_rx: 4] [is_online: 1]
        isp channel info: [hw_id: 1] [slot_id: 5] [mode:1]

pym config:
        ichn input width = 1280, height = 720
        ochn[0] ratio= 1, width = 1280, height = 720 wstride=1280 vstride=720 out[1280*720]
        ochn[1] ratio= 2, width = 640, height = 360 wstride=640 vstride=360 out[640*360]
        ochn[2] ratio= 4, width = 320, height = 180 wstride=320 vstride=176 out[320*176]
        ochn[3] ratio= 8, width = 160, height = 90 wstride=160 vstride=88 out[160*88]
        ochn[4] ratio= 16, width = 80, height = 44 wstride=80 vstride=40 out[80*40]
[Warning] ochn[5] ratio= 32, height = 22 < PYM_MIN_HEIGHT(32), so not enable.

        [1] not use [gdc].
[1] encoder input resolution is 1280*720, output file is pipeline1_1280x720_30fps.h264.
Create Encode idx: 1, init successful
All deserial link info:
        [link_port:0] sc1336_gmsl:0@256
        [link_port:1] sc1336_gmsl:0@256
        [link_port:2] sc1336_gmsl:0@256
        [link_port:3] sc1336_gmsl:0@256

The following files will be saved during execution:

pipeline0_1920x1080_30fps.h264
pipeline1_1280x720_30fps.h264

uvc_capture_sample

Function Overview

uvc_capture_sample is a program for testing the UVC camera video capture pipeline. It captures images from a UVC camera and saves the output images, and supports displaying ISP-related information.

Code Location and Directory Structure

Code location: /app/multimedia_samples/sample_pipeline/uvc_capture_sample
Directory structure

uvc_capture_sample
├── Makefile
├── common_utils.c
├── common_utils.h
├── uvc_capture_sample.c
├── uvc_capture_sample.h
├── v4l2_common_utils.c
└── v4l2_common_utils.h

Compilation

Enter the uvc_capture_sample directory and run make to compile.
The output binary is uvc_capture_sample, located in the source directory.

Execution

How to Run the Program

Run the program directly with ./uvc_capture_sample -h to display help information.

Program Option Descriptions

Options:

-i, --video_id <id>
- Specifies the video device node, e.g., video0, video1.
-d, --dump_file
- Whether to save image files. Enabling this option saves captured images to files.
-F, --format
- Sets the image format; choose a format supported by the UVC camera, such as YUYV or NV12.
-l, --loop_cnt <num>
- Sets the number of capture loops (i.e., how many frames to capture).
-H, --height <px>
- Sets the image height (in pixels).
-W, --width <px>
- Sets the image width (in pixels).
-E, --show_isp_info
- Displays ISP exposure and white balance information.
-h, --help
- Displays help information.

Examples:

Configure a UVC camera video pipeline using video0, specify YUYV format, and save 5 captured frames.

./uvc_capture_sample -i 0  -l 5 -W 1920 -H 1080 -F YUYV  -d

Configure a UVC camera video pipeline using video0, specify YUYV format, save 5 captured frames, and print current exposure and white balance information.

./uvc_capture_sample -i 0  -l 5 -W 1920 -H 1080 -F YUYV  -d -E

Execution Output

Run the following command:

./uvc_capture_sample -i 0  -l 5 -W 1920 -H 1080 -F YUYV  -d

Example log output:

ptc[0].video_id = 0
ptc[0].loop_cnt = 5
ptc[0].pic_width = 1920
ptc[0].pic_height = 1080
ptc[0].pic_format = 6
ptc[0].dump_mask = 1
DEBUG: index = 0, max_num = 24
pipe_num:0
TestContext[0] create pthread success
loop_cnt: 5
open device: /dev/video0 (fd=3)
     driver: uvcvideo
       card: FHD Camera Microphone: FHD Came
    version: 6.1.83
   all caps: 84a00001
device caps: 04200001
 0: Motion-JPEG 0x47504a4d 0x1
...
filedump(./yuv_dump/isp_5_s0_c0_b1_f0_005838.yuv, size(4147200) is successed
loop cnt use up
pipe(0)Test thread 281473524101408---join done.
------ Test case uvc_capture_sample done  ------

Function Overview​

sample_pipeline Architecture Description​

single_pipe_vin_isp_ynr_pym_vpu​

Function Overview​

Code Location and Directory Structure​

Compilation​

Execution​

How to Run the Program​

Program Option Descriptions​

Runtime Behavior​

single_pipe_vin_isp_ynr_pym_gdc​

Function Overview​

Code Location and Directory Structure​

Compilation​

Execution​

How to Run the Program​

Program Option Descriptions​

Runtime Behavior​

single_pipe_vin_isp_ynr_pym_gdc_vpu​

Function Overview​

Code Location and Directory Structure​

Compilation​

Execution​

How to Run the Program​

Program Parameter Options Description​

Execution Results​

multi_pipe_vin_isp_ynr_pym_gdc_vpu​

Function Overview​

Code Location and Directory Structure​

Compilation​

Execution​

How to Run the Program​

Program Parameter Options Description​

Execution Results​

uvc_capture_sample​

Function Overview​

Code Location and Directory Structure​

Compilation​

Execution​

How to Run the Program​

Program Option Descriptions​

Execution Output​

Function Overview

sample_pipeline Architecture Description

single_pipe_vin_isp_ynr_pym_vpu

Function Overview

Code Location and Directory Structure

Compilation

Execution

How to Run the Program

Program Option Descriptions

Runtime Behavior

single_pipe_vin_isp_ynr_pym_gdc

Function Overview

Code Location and Directory Structure

Compilation

Execution

How to Run the Program

Program Option Descriptions

Runtime Behavior

single_pipe_vin_isp_ynr_pym_gdc_vpu

Function Overview

Code Location and Directory Structure

Compilation

Execution

How to Run the Program

Program Parameter Options Description

Execution Results

multi_pipe_vin_isp_ynr_pym_gdc_vpu

Function Overview

Code Location and Directory Structure

Compilation

Execution

How to Run the Program

Program Parameter Options Description

Execution Results

uvc_capture_sample

Function Overview

Code Location and Directory Structure

Compilation

Execution

How to Run the Program

Program Option Descriptions

Execution Output