非结构环境下采摘机器人对扰动葡萄采摘点的视觉识别定位有实际应用价值。首先基于"挠性杆-铰链-刚性杆-质量球"模型对葡萄串形态进行分析,将其扰动状态分解为XOY和YOZ 2个平面的类单摆运动,对扰动葡萄进行视频拍摄,通过对视频中多帧葡萄图像进行Otsu阈值分割得到果实和果梗,并计算出各帧图像中葡萄串的质心;对各帧图像的葡萄串质心进行曲线拟合,计算出葡萄类单摆运动的周期与摆角,从而确定当前扰动葡萄是否适合视觉定位;对可实现视觉定位的扰动葡萄,选取类单摆中间位置质心点对应的葡萄图像,对葡萄串上方矩形区域进行Canny边缘检测,再利用霍夫直线拟合结合角度约束法实现扰动葡萄采摘点的定位。视觉定位试验结果表明:自然环境中不同光照下扰动葡萄采摘点的视觉定位准确率达80%以上,为采摘机器人应用于实际生产提供了理论基础。
The picking robot in unstructured environment has practical value in visual localization of disturbed grape.Firstly,the shape of grape was analyzed based on model of"flexible rod-hinge-rigid rodmass ball"and its disturbed state was decomposed into pendulum of XOY plane and YOZ plane,and then fruit and stalk of grape were obtained by Otsu function from multi frame image in video of which captured disturbed grape.Then centroid of grape in each frame image was calculated,and curve fitting of grape centroid of each frame image was made.The period of grape pendulum movement and swing angle were calculated to judge whether current disturbed of the grape was suitable for visual positioning.For disturbed grape that can achieve visual positioning,choosing grape images corresponding to location in the middle of centroid point of pendulum motion,Canny edge detection was carried out on the upper rectangular region.The method of Hough line fitting and angle constraint were used to localize picking point of disturbed grape.Experiment results of visual localization showed that the accuracy of visual localization for disturbed grape picking points under different illuminations were more than 80% in natural environment,which provided theoretical basis for the application of picking robot in practical production.