Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting mutiple issues in Intel Realsense Camera. #13100

Closed
ShreyasKuntnal opened this issue Jul 1, 2024 · 12 comments
Closed

Getting mutiple issues in Intel Realsense Camera. #13100

ShreyasKuntnal opened this issue Jul 1, 2024 · 12 comments
Labels

Comments

@ShreyasKuntnal
Copy link

ShreyasKuntnal commented Jul 1, 2024


Required Info
Camera Model D400
Firmware Version 05.13.00.50
Operating System & Version Ubuntu 20.04
Kernel Version (Linux Only) 5.15.0-113-generic
Platform PC
SDK Version LibRealSense v2.50.0

I tried mutiple issue threads but fed up with these mutiple issues.
When I do reaslsense launch, i am getting these issues:
roslaunch realsense2_camera rs_camera_edited.launch global_time_enabled:=true initial_reset:=true

SUMMARY
========

PARAMETERS
 * /camera/l500_depth_sensor/global_time_enabled: True
 * /camera/motion_module/global_time_enabled: True
 * /camera/realsense2_camera/accel_fps: 250
 * /camera/realsense2_camera/accel_frame_id: camera_accel_frame
 * /camera/realsense2_camera/accel_optical_frame_id: camera_accel_opti...
 * /camera/realsense2_camera/align_depth: True
 * /camera/realsense2_camera/aligned_depth_to_color_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_fisheye_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra1_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/aligned_depth_to_infra2_frame_id: camera_aligned_de...
 * /camera/realsense2_camera/allow_no_texture_points: False
 * /camera/realsense2_camera/base_frame_id: camera_link
 * /camera/realsense2_camera/calib_odom_file: 
 * /camera/realsense2_camera/clip_distance: -2.0
 * /camera/realsense2_camera/color_fps: 30
 * /camera/realsense2_camera/color_frame_id: camera_color_frame
 * /camera/realsense2_camera/color_height: 480
 * /camera/realsense2_camera/color_optical_frame_id: camera_color_opti...
 * /camera/realsense2_camera/color_width: 640
 * /camera/realsense2_camera/confidence_fps: -1
 * /camera/realsense2_camera/confidence_height: -1
 * /camera/realsense2_camera/confidence_width: -1
 * /camera/realsense2_camera/depth_fps: 30
 * /camera/realsense2_camera/depth_frame_id: camera_depth_frame
 * /camera/realsense2_camera/depth_height: 480
 * /camera/realsense2_camera/depth_optical_frame_id: camera_depth_opti...
 * /camera/realsense2_camera/depth_width: 640
 * /camera/realsense2_camera/device_type: 
 * /camera/realsense2_camera/enable_accel: True
 * /camera/realsense2_camera/enable_color: True
 * /camera/realsense2_camera/enable_confidence: True
 * /camera/realsense2_camera/enable_depth: True
 * /camera/realsense2_camera/enable_fisheye1: False
 * /camera/realsense2_camera/enable_fisheye2: False
 * /camera/realsense2_camera/enable_fisheye: False
 * /camera/realsense2_camera/enable_gyro: True
 * /camera/realsense2_camera/enable_infra1: True
 * /camera/realsense2_camera/enable_infra2: True
 * /camera/realsense2_camera/enable_infra: True
 * /camera/realsense2_camera/enable_pointcloud: False
 * /camera/realsense2_camera/enable_pose: False
 * /camera/realsense2_camera/enable_sync: True
 * /camera/realsense2_camera/filters: 
 * /camera/realsense2_camera/fisheye1_frame_id: camera_fisheye1_f...
 * /camera/realsense2_camera/fisheye1_optical_frame_id: camera_fisheye1_o...
 * /camera/realsense2_camera/fisheye2_frame_id: camera_fisheye2_f...
 * /camera/realsense2_camera/fisheye2_optical_frame_id: camera_fisheye2_o...
 * /camera/realsense2_camera/fisheye_fps: -1
 * /camera/realsense2_camera/fisheye_frame_id: camera_fisheye_frame
 * /camera/realsense2_camera/fisheye_height: -1
 * /camera/realsense2_camera/fisheye_optical_frame_id: camera_fisheye_op...
 * /camera/realsense2_camera/fisheye_width: -1
 * /camera/realsense2_camera/gyro_fps: 200
 * /camera/realsense2_camera/gyro_frame_id: camera_gyro_frame
 * /camera/realsense2_camera/gyro_optical_frame_id: camera_gyro_optic...
 * /camera/realsense2_camera/imu_optical_frame_id: camera_imu_optica...
 * /camera/realsense2_camera/infra1_frame_id: camera_infra1_frame
 * /camera/realsense2_camera/infra1_optical_frame_id: camera_infra1_opt...
 * /camera/realsense2_camera/infra2_frame_id: camera_infra2_frame
 * /camera/realsense2_camera/infra2_optical_frame_id: camera_infra2_opt...
 * /camera/realsense2_camera/infra_fps: 30
 * /camera/realsense2_camera/infra_height: 480
 * /camera/realsense2_camera/infra_rgb: False
 * /camera/realsense2_camera/infra_width: 640
 * /camera/realsense2_camera/initial_reset: True
 * /camera/realsense2_camera/json_file_path: 
 * /camera/realsense2_camera/linear_accel_cov: 0.01
 * /camera/realsense2_camera/odom_frame_id: camera_odom_frame
 * /camera/realsense2_camera/ordered_pc: False
 * /camera/realsense2_camera/pointcloud_texture_index: 0
 * /camera/realsense2_camera/pointcloud_texture_stream: RS2_STREAM_COLOR
 * /camera/realsense2_camera/pose_frame_id: camera_pose_frame
 * /camera/realsense2_camera/pose_optical_frame_id: camera_pose_optic...
 * /camera/realsense2_camera/publish_odom_tf: True
 * /camera/realsense2_camera/publish_tf: True
 * /camera/realsense2_camera/reconnect_timeout: 6.0
 * /camera/realsense2_camera/rosbag_filename: 
 * /camera/realsense2_camera/serial_no: 
 * /camera/realsense2_camera/stereo_module/exposure/1: 7500
 * /camera/realsense2_camera/stereo_module/exposure/2: 1
 * /camera/realsense2_camera/stereo_module/gain/1: 16
 * /camera/realsense2_camera/stereo_module/gain/2: 16
 * /camera/realsense2_camera/tf_publish_rate: 0.0
 * /camera/realsense2_camera/topic_odom_in: odom_in
 * /camera/realsense2_camera/unite_imu_method: linear_interpolation
 * /camera/realsense2_camera/usb_port_id: 
 * /camera/realsense2_camera/wait_for_device_timeout: -1.0
 * /camera/rgb_camera/global_time_enabled: True
 * /camera/stereo_module/emitter_enabled: 0
 * /rosdistro: noetic
 * /rosversion: 1.16.0

NODES
  /camera/
    realsense2_camera (nodelet/nodelet)
    realsense2_camera_manager (nodelet/nodelet)

ROS_MASTER_URI=http://localhost:11311

process[camera/realsense2_camera_manager-1]: started with pid [65431]
process[camera/realsense2_camera-2]: started with pid [65432]
[ INFO] [1719814569.977914359]: Initializing nodelet with 16 worker threads.
[ INFO] [1719814570.046404722]: RealSense ROS v2.3.2
[ INFO] [1719814570.046427020]: Built with LibRealSense v2.50.0
[ INFO] [1719814570.046435693]: Running with LibRealSense v2.50.0
[ INFO] [1719814570.072123238]:  
[ INFO] [1719814570.338266846]: Device with serial number 243522070607 was found.

[ INFO] [1719814570.338342951]: Device with physical ID 4-4-6 was found.
[ INFO] [1719814570.338353607]: Device with name Intel RealSense D435I was found.
[ INFO] [1719814570.338687587]: Device with port number 4-4 was found.
[ INFO] [1719814570.338699705]: Device USB type: 3.2
[ INFO] [1719814570.338711723]: Resetting device...
[ INFO] [1719814576.424145646]:  
[ INFO] [1719814576.607469361]: Device with serial number 243522070607 was found.

[ INFO] [1719814576.607501011]: Device with physical ID 4-4-7 was found.
[ INFO] [1719814576.607507130]: Device with name Intel RealSense D435I was found.
[ INFO] [1719814576.607658114]: Device with port number 4-4 was found.
[ INFO] [1719814576.607668189]: Device USB type: 3.2
[ INFO] [1719814576.609457711]: getParameters...
[ INFO] [1719814576.634290673]: setupDevice...
[ INFO] [1719814576.634323759]: JSON file is not provided
[ INFO] [1719814576.634340751]: ROS Node Namespace: camera
[ INFO] [1719814576.634359774]: Device Name: Intel RealSense D435I
[ INFO] [1719814576.634375547]: Device Serial No: 243522070607
[ INFO] [1719814576.634391804]: Device physical port: 4-4-7
[ INFO] [1719814576.634407663]: Device FW version: 05.13.00.50
[ INFO] [1719814576.634423790]: Device Product ID: 0x0B3A
[ INFO] [1719814576.634446306]: Enable PointCloud: Off
[ INFO] [1719814576.634463204]: Align Depth: On
[ INFO] [1719814576.634477816]: Sync Mode: On
[ INFO] [1719814576.634526538]: Device Sensors: 
[ INFO] [1719814576.723298772]: Stereo Module was found.
[ INFO] [1719814576.730262018]: RGB Camera was found.
[ INFO] [1719814576.730375238]: Motion Module was found.
[ INFO] [1719814576.730399966]: (Infrared, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1719814576.730411902]: (Confidence, 0) sensor isn't supported by current device! -- Skipping...
[ INFO] [1719814576.730662884]: num_filters: 1
[ INFO] [1719814576.730683784]: Setting Dynamic reconfig parameters.
[ INFO] [1719814580.227633005]: Done Setting Dynamic reconfig parameters.
[ INFO] [1719814580.227985417]: depth stream is enabled - width: 640, height: 480, fps: 30, Format: Z16
[ INFO] [1719814580.228129748]: infra1 stream is enabled - width: 640, height: 480, fps: 30, Format: Y8
[ INFO] [1719814580.228271211]: infra2 stream is enabled - width: 640, height: 480, fps: 30, Format: Y8
[ INFO] [1719814580.228746171]: color stream is enabled - width: 640, height: 480, fps: 30, Format: RGB8
[ INFO] [1719814580.230800057]: gyro stream is enabled - fps: 200
[ WARN] [1719814580.230828344]: No mathcing profile found for accel with fps=250
[ WARN] [1719814580.230839346]: Using default profile instead.
[ INFO] [1719814580.230847709]: accel stream is enabled - fps: 100
[ INFO] [1719814580.230862282]: setupPublishers...
[ INFO] [1719814580.232530439]: Expected frequency for depth = 30.00000
[ INFO] [1719814580.252815520]: Expected frequency for infra1 = 30.00000
[ INFO] [1719814580.268508842]: Expected frequency for infra2 = 30.00000
[ INFO] [1719814580.278794050]: Expected frequency for color = 30.00000
[ INFO] [1719814580.289490945]: Expected frequency for aligned_depth_to_color = 30.00000
[ INFO] [1719814580.300251048]: Start publisher IMU
[ INFO] [1719814580.301285264]: setupStreams...
 01/07 11:46:20,520 WARNING [139922238732032] (ds5-motion.cpp:473) IMU Calibration is not available, default intrinsic and extrinsic will be used.
[ WARN] [1719814580.796831450]: 
[ WARN] [1719814580.796875697]: frame's time domain is HARDWARE_CLOCK. Timestamps may reset periodically.
 01/07 11:46:20,796 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 300, error: Resource temporarily unavailable, number: b
 01/07 11:46:20,863 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
[ INFO] [1719814580.914600346]: SELECTED BASE:Depth, 0
[ INFO] [1719814580.930304516]: RealSense Node Is Up!
 01/07 11:46:20,986 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,037 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,088 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,139 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,258 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,308 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,359 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,411 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:21,664 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:45,644 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:45,694 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:46,746 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:46,796 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:48,076 ERROR [139920773478144] (ds5-options.cpp:88) Asic Temperature value is not valid!
 01/07 11:46:48,849 WARNING [139921805256448] (messen 01/07 11:50:49,297 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:51:11,369 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
ger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:49,081 ERROR [139920773478144] (ds5-options.cpp:88) Asic Temperature value is not valid!
 01/07 11:46:49,901 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:46:50,087 ERROR [139920773478144] (ds5-options.cpp:88) Asic Temperature value is not valid!
 01/07 11:47:09,968 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:47:26,029 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:48:47,145 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:50:49,297 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11
 01/07 11:51:11,369 WARNING [139921805256448] (messenger-libusb.cpp:42) control_transfer returned error, index: 768, error: Resource temporarily unavailable, number: 11

Can you please help me with resolving these issues?

@ShreyasKuntnal
Copy link
Author

ShreyasKuntnal commented Jul 1, 2024

realsense-viewer :

01/07 13:41:53,431 WARNING [140534140102400] (sensor.cpp:1147) RGB Camera: skipping Backlight Compensation control. descriptor: [min/max/step/default]= [0/0/0/0]
01/07 13:41:53,439 WARNING [140534140102400] (sensor.cpp:1147) RGB Camera: skipping Exposure control. descriptor: [min/max/step/default]= [0/0/0/0]
01/07 13:41:53,461 ERROR [140534140102400] (librealsense-exception.h:52) xioctl(VIDIOC_G_CTRL) failed Last Error: Invalid argument
01/07 13:41:53,461 WARNING [140534140102400] (sensor.cpp:1173) Failed to add Enable Auto Exposure control for RGB Camera

How to fix these error when realsense camera is activated?

Kernel version=5.15.0-113-generic
dkms version=1.3.26-0ubuntu1

@MartyG-RealSense
Copy link
Collaborator

Hi @ShreyasKuntnal You do not need to set global_time_enabled to true as it is already enabled by default on 400 Series cameras such as D435i.

The control_transfer returned warning can indicate that there is a communication problem between the camera and the computer / computing board, such as an issue with the USB port or USB cable. The Resource temporarily unavailable type of this warning could indicate that the computer's CPU is struggling to keep up with processing the frames that are arriving at the USB port from the camera.

If you do not need the Infra2 stream then you can disable it to reduce the processing burden, as it is not required for streaming Infra1.

Likewise, if you do not need depth-color aligned images then set align_depth to False to further reduce processing, as alignment is calculated on the computer and not the camera hardware.

Please also check whether the depth and color streams are being published in RViz, as sometimes they can be displayed normally in RViz even if control_transfer warnings are generating continuously in the log.

@ShreyasKuntnal
Copy link
Author

Have i installed right version of dkms for particular kernel and librealsense version?

image

I get these errors as soon as I start realsense-viewer. What are these, Is there need to fix these or ignoring can be ok?

@MartyG-RealSense
Copy link
Collaborator

The firmware version 5.13.0.50 is correct for librealsense 2.50.0. As you have 2.50.0, it looks as though you have the correct DKMS package version.

Are you using the official 1 meter USB cable supplied with the camera or a cable of your own choice?

Is the RGB stream of the Viewer able to be enabled despite the RGB-related errors in the Viewer log?

Is there improvement if you reset your camera's calibration to its factory-new default settings in the Viewer using the instructions at #10182 (comment)

@ShreyasKuntnal
Copy link
Author

ShreyasKuntnal commented Jul 1, 2024

I use the default cable that's provided by intel.
RGB stream is able to be enabled,
AS soon as i start realsense viewer it pops these red scary errors:

 01/07 15:24:31,467 WARNING [139753932449536] (sensor.cpp:1147) RGB Camera: skipping Backlight Compensation control. descriptor: [min/max/step/default]= [0/0/0/0]
 01/07 15:24:31,468 WARNING [139753932449536] (sensor.cpp:1147) RGB Camera: skipping Exposure control. descriptor: [min/max/step/default]= [0/0/0/0]
 01/07 15:24:31,470 ERROR [139753932449536] (librealsense-exception.h:52) xioctl(VIDIOC_G_CTRL) failed Last Error: Invalid argument
 01/07 15:24:31,471 WARNING [139753932449536] (sensor.cpp:1173) Failed to add Enable Auto Exposure control for RGB Camera

With respect to camera calibration, this is how it looks.
image

@MartyG-RealSense
Copy link
Collaborator

To unlock the Write Table button on the Camera Calibration window, you need to enable the Stereo Module (the depth stream) before opening the window. You can then click on Write Table to reset the camera's calibration to its defaults.

In general, if streams are behaving normally when enabled despite warning / error messages in the log then the messages can be ignored.

@ShreyasKuntnal
Copy link
Author

If I do camera calibration reset, is there a need to do imu calibration again.
Sorry for very vague question, I feel there might be some link.

@MartyG-RealSense
Copy link
Collaborator

MartyG-RealSense commented Jul 1, 2024

There is not information available on whether the reset affects IMU calibration.

However, if data stored in a part of the camera called the calibration table has become corrupted then it can prevent the camera from working correctly. Clicking the Write Table button overwrites the old calibration table with a new one, so it can enable the camera to work correctly if a corrupted calibration table was the cause of the problems.

@ShreyasKuntnal
Copy link
Author

ShreyasKuntnal commented Jul 1, 2024

Did Camera calibration
image

and restarted the realsense-viewer still these errors persist.

image

If we can fix the same the lets work on it or else as u said we can ignore lets ignore

@MartyG-RealSense
Copy link
Collaborator

Yes, I recommend ignoring the errors if performance of the streams is not being negatively affected.

@ShreyasKuntnal
Copy link
Author

Oh ok so even this error (librealsense-exception.h:52) xioctl(VIDIOC_G_CTRL) failed Last Error: Invalid argument can be ignored then?
Thank you so much for the faster replies.

@MartyG-RealSense
Copy link
Collaborator

You are very welcome. The VIDIOC error suggests a conflict between librealsense and the kernel, but if the streams are performing normally then it is likely just a momentary hiccup that can be ignored. Thanks very much for the update!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants