高级检索

    3Deus:基于点云探测的复杂场景物品识别方法

    3Deus: Complex Environment Object Recognition Method Based on Point Cloud Sensing

    • 摘要: 随着人工智能技术的发展,基于视觉的物品识别作为构建物联网感知层的重要组成,与分拣机器人相结合后可应用在各类货物分拣的具体场景中.然而,在混乱摆放物品的复杂场景中,由于目标物品与干扰物品可能存在空间距离差,仅依赖物品识别算法并不能很好地区分目标物品和干扰物品,势必对机器人的正常抓取动作产生负面影响.为了解决该问题,我们提出了一种轻量化的复杂环境下的物品识别方法-3Deus.该方法将深度学习和3D点云数据处理相结合.利用3D点云对干扰物品所处的平面做整体消除,并基于改进的随机采样一致性算法区分目标物品所处平面与堆叠干扰物;运用平面扩张机制,保证目标物品所处平面点云的完整性;最后,借助物品识别算法获取目标的识别框并构建其与具体点云簇的映射关系.我们将3Deus部署在边缘计算设备上,并通过构建不同的实验场景验证了3Deus的有效性和鲁棒性.实验结果表明,与传统的随机采样一致性算法相比,3Deus能够有效地对目标物品和干扰物品进行区分,其准确度达到了95%以上,同时3Deus利用平面扩张机制将目标物品的识别准确精度提高了30.48%.

       

      Abstract: With the development of artificial intelligence technology, vision-based object recognition, as an important component of the Internet of Things perception layer, can be applied in various cargo sorting scenarios when combined with sorting robots. However, in complex environments where objects are disorganized, relying solely on object recognition algorithms may not be sufficient to distinguish target objects from interfering ones, as the difference between them may be the spatial distance. This can negatively impact the robot’s normal grasping actions. To address this issue, we propose a lightweight object recognition method for complex environments—3Deus. This method combines deep learning with 3D point cloud data processing. It uses a depth camera to synchronously capture both RGB images and 3D point cloud data in the recognition scene. The method eliminates the plane where interfering objects are located using the 3D point cloud, and distinguishes the plane containing the target object from the stacked interfering objects with an improved RANSAC algorithm. It also employs a plane expansion mechanism to ensure the integrity of the plane point cloud where the target object is located. Finally, the object recognition algorithm is used to obtain the recognition bounding box of the target object and construct its mapping relationship with the specific point cloud cluster. We deploy 3Deus on edge computing devices and validate its effectiveness and robustness by constructing different experimental scenarios. Experimental results show that compared with the traditional random sampling consensus algorithm, 3Deus can effectively distinguish the target objects from interference objects, achieving an accuracy of over 95%. Moreover, by utilizing the plane expansion mechanism, the recognition accuracy of the target object is improved by 30.48%.

       

    /

    返回文章
    返回