因采摘机器人野外试验易受收获季节、气候和场地等诸多因素的限制,为辅助试验采摘机器人视觉定位及其行为控制算法,设计了基于硬件在环仿真的葡萄采摘机器人虚拟试验。该文先利用双目立体视觉提取葡萄串采摘点及防碰包围体等空间信息;然后以实验室已有的6自由度采摘机器人样机为原型,建立三维虚拟仿真模型,运用D-H法建立机器人坐标变换,求解虚拟环境下机器人运动学正解和逆解;再以实物视觉提取的葡萄串空间信息为基础,运用VC++、Javascript等编程语言在虚拟现实平台EON上对采摘机器人视觉定位及其采摘行为进行仿真设计和编程实现,设计出一套以实物视觉与虚拟采摘机器人相结合的硬件在环仿真平台。最后,在该平台上对葡萄采摘机器人进行了34次虚拟试验,试验中视觉定位、路径规划、夹剪果梗3个环节的成功率依次为85.29%、82.35%、82.35%。结果表明,该方法可很好地运用于验证和试验采摘机器人视觉定位及其行为算法。
In the process of developing picking robot prototype, the traditional picking tests are usually performed in orchard, which are limited by certain factors such as the harvesting season, weather condition and venue. So, the investigated and designed algorithm for the vision and control system of picking robots can't be verified effectively and timely, and the prototype development cycle has to last longer. To test the vision and control algorithm of picking robot, a hardware-in-the-loop virtual experimental system based on binocular stereo vision for grape-picking robot was designed in this paper, which was composed of hardware and software units. The hardware units consisted of binocular camera, grape clusters, grape imitative leaf and stems, support structure of grape clusters and its guide rail, calibration board, and so on. The software units included vision processing part and virtual picking robot. Firstly, the spatial information such as the picking point and the anti-collision bounding volume of the grape cluster was extracted by binocular stereo vision. The picking point on the peduncle of the grape cluster was detected by using a minimum distance restraint between the barycentre of the pixel region of grape cluster and the detected lines in the ROI (region of interest) of peduncle. The anti-collision bounding volume of the grape cluster was calculated by transforming the spatial coordinates of the picking point and all detected grape berries into the coordinate system of grape clusters. Secondly, the three-dimensional models of the picking robot were constructed according to the picking robot prototype with 6 degrees of freedom which already existed in our laboratory. The Denavit-Hartenberg (D-H) method was adopted to establish the robot coordinate transformation. The direct and inverse solutions of the robot kinematics were solved by using the inverse transformation method, and then the only inverse solution was obtained. Thirdly, the moving path of picking robot was planned based on the artif