节点文献

基于单目相机和多线激光雷达的联合标定方法研究

Study on joint calibration method based on monocular camera and multi-line lidar

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 代军李文波赵俊伟袁兴起王跃功李东方程晓琦花岛直彥

【Author】 DAI Jun;LI Wenbo;ZHAO Junwei;YUAN Xingqi;WANG Yuegong;LI Dongfang;CHENG Xiaoqi;HANAJIMA Naohiko;Henan International Joint Laboratory of Advanced Electronic Packaging Materials Precision Forming,Henan Polytechnic University;School of Mechanical & Power Engineering,Henan Polytechnic University;Pingdingshan PMJ Coal Mine Machinery Equipment Co.,Ltd.;School of Mechatronic Engineering and Automation,Foshan University;Robotics and Mechanical Engineering Research Unit,Muroran Institute of Technology;

【通讯作者】 赵俊伟;

【机构】 河南理工大学河南省先进电子封装材料精密成形国际联合实验室河南理工大学机械与动力工程学院平顶山平煤机煤矿机械装备有限公司佛山科学技术学院机电工程与自动化学院室兰工业大学机器人与机械工程研究所

【摘要】 目的 针对相机和激光雷达之间的外参标定问题,为了减少两者的标定误差,得到更高的标定精度,方法 提出一种基于非线性优化的联合标定方法。首先拍摄不同角度的棋盘格标定板图像,采集足够多数据后利用工具包进行相机内参标定,得到单目相机内参;然后在激光点云和图像中检测标定板的角点特征坐标,激光点云下的角点坐标由提取的标定板点云数据和其几何特征获得,通过拟合出的图形由上至下、由左至右确定图形顶点坐标及标定板行列数,可得到各角点坐标;相机角点特征坐标采用FAST角点检测,利用角点灰度信息确定角点坐标;根据点云检测特征点到图像投影误差构建目标函数,将外参求解转化为最小二乘问题;最后通过基于列文伯格-马夸尔特的非线性优化算法,迭代求解得到最优外参。结果 最终平均标定投影误差为1.29像素,最大投影误差为2.46像素,最小投影误差为0.70像素,标准差为0.57像素。结论 根据标定的外参将点云投影至图像上可知,标定结果较好,并将结果运用到实际场景下视觉和激光雷达融合的SLAM算法中,运动轨迹平滑且与地图保持高度一致,本文方法标定过程简单,不需要棋盘格的真实物理尺寸,满足使用要求。

【Abstract】 Objectives A joint calibration method based on nonlinear optimization to address the issue of external parameter calibration between camera and lidar was proposed.The objective was to minimize the calibration error and achieve higher calibration accuracy. Methods First, images of the checkerboard calibration board were taken from different angles, and the internal parameters of the camera were calibrated by using a toolkit, resulting in obtaining the internal parameters of the monocular camera. Then, the corner point feature coordinates of the calibration board were detected in both the laser point cloud and image. The coordinates in the laser point cloud were obtained by extracting the point cloud data of the calibration board and its geometric features, followed by determining the vertex coordinates through fitting the extracted pattern. The coordinates of each corner point were obtained by counting the number of rows and columns of the calibration board. The FAST corner detection was used to detect the corner point feature coordinates of the camera, and their coordinates were determined based on the gray information of the corner points. The objective function was constructed based on the projection error of the detected feature points from the point cloud to the image. The external parameter solution was transformed into the least squares problem.Finally, the optimal external parameters were obtained through an iterative solution by using the LevenbergMarquardt nonlinear optimization algorithm. Results The final average calibration error reached 1.29 pixels, with a maximum error of 2.46 pixels, a minimum error of 0.70 pixels, and a standard deviation of 0.57 pixels.Conclusions The calibration results demonstrated good accuracy, allowing for the projection of the point cloud onto the image. The results were applied to the visual and LiDAR fusion SLAM algorithm in practical scenarios,resulting in smooth motion trajectories highly consistent with the map. The calibration process was simple and convenient. It did not require the actual physical size of the checkerboard and meet practical requirements.

【基金】 国家自然科学基金资助项目(62201151);河南省科技攻关项目(232102221028);河南省高等学校重点科研项目(22A460020);河南理工大学博士基金资助项目(B2016-22)
  • 【文献出处】 河南理工大学学报(自然科学版) ,Journal of Henan Polytechnic University(Natural Science) , 编辑部邮箱 ,2024年02期
  • 【分类号】TN958.98;TP391.41
  • 【下载频次】184
节点文献中: 

本文链接的文献网络图示:

本文的引文网络