申請(qǐng)上海交通大學(xué)博士學(xué)位論文助行機(jī)器人定位關(guān)鍵技術(shù)研究專 業(yè)：機(jī)械電子工程博士生：朱笑笑導(dǎo) 師：曹其新教授上海交通大學(xué)機(jī)械與動(dòng)力工程學(xué)院2014年 2月 Ph.D. Dissertation Submitted to Shanghai Jiao Tong UniversityResearch on Key Technologies of Localization Method for Walking Assistant Robot Specialty: Mechatronics EngineeringAuthor:Zhu XiaoxiaoAdvisor: Prof. Cao QixinSchool of Mechanical and Power Engineering Shanghai Jiao Tong University February，2014 學(xué)位論文版權(quán)使用授權(quán)書本學(xué)位論文作者完全了解學(xué)校有關(guān)保留、使用學(xué)位論文的規(guī)定，同意學(xué)校保留并向國家有關(guān)部門或機(jī)構(gòu)送交論文的復(fù)印件和電子版，允許論文被查閱和借閱。本人授權(quán)上海交通大學(xué)可以將本學(xué)位論文的全部或部分內(nèi)容編入有關(guān)數(shù)據(jù)庫進(jìn)行檢索，可以采用影印、縮印或掃描等復(fù)制手段保存和匯編本學(xué)位論文。（請(qǐng)?jiān)谝陨戏娇騼?nèi)打“”） 本人鄭重聲明：所呈交的學(xué)位論文，是本人在導(dǎo)師的指導(dǎo)下，獨(dú)立進(jìn)行研究工作所取得的成果。除文中已經(jīng)注明引用的內(nèi)容外，本論文不包含任何其他個(gè)人或集體已經(jīng)發(fā)表或撰寫過的作品成果。對(duì)本文的研究做出重要貢獻(xiàn)的個(gè)人和集體，均已在文中以明確方式標(biāo)明。本人完全意識(shí)到本聲明的法律結(jié)果由本人承擔(dān)。 摘要助行機(jī)器人定位關(guān)鍵技術(shù)研究摘要助行機(jī)器人是一種可以輔助老人行走的特殊服務(wù)機(jī)器人，它的目標(biāo)是代替?zhèn)鹘y(tǒng)的助行器（如拐杖、助步架等）在保證老人行走安全的基礎(chǔ)上，大大提高其獨(dú)立生活能力及生活質(zhì)量。除了能夠提供基本的輔助行走功能，它還需具備多種智能化功能，如用戶健康狀態(tài)監(jiān)控，語音交互，定位導(dǎo)航，用戶識(shí)別，用戶計(jì)劃提醒，信息播報(bào)服務(wù)等等。定位系統(tǒng)作為助行機(jī)器人一個(gè)重要組件，是實(shí)現(xiàn)多項(xiàng)智能化功能的一個(gè)基礎(chǔ)。本文針對(duì)助行機(jī)器人定位系統(tǒng)的幾項(xiàng)關(guān)鍵技術(shù)開展研究，具體研究內(nèi)容如下。（1）環(huán)境地圖是助行機(jī)器人自主定位導(dǎo)航的重要先驗(yàn)知識(shí)，常用的 2D地圖能夠滿足機(jī)器人自定位的需求，但由于存在高度方向的不確定性，在家居狹小空間內(nèi)的自主導(dǎo)航應(yīng)用中存在明顯不足。而傳統(tǒng)的 3D地圖創(chuàng)建方法一般需要使用價(jià)格昂貴的激光傳感器，操作也較為復(fù)雜，不適合家庭使用。本文對(duì)利用 RGB-D（顏色-深度）傳感器的 3D地圖創(chuàng)建方法進(jìn)行研究，提出基于改進(jìn) KinectFusion算法的地圖創(chuàng)建方法，使其可以較為方便對(duì)家庭環(huán)境進(jìn)行創(chuàng)建。對(duì) KinectFusion算法進(jìn)行兩個(gè)方面的改進(jìn)，一方面提出使用環(huán)境中的邊線特征點(diǎn)匹配來提高其定位魯棒性，另一方面在點(diǎn)云模型中預(yù)設(shè)一個(gè)地面點(diǎn)云來減少累積誤差提高精度。并且提出了基于標(biāo)志物的子地圖拼接方法，解決 KinectFusion算法只能創(chuàng)建小規(guī)模地圖的問題。（2 ）助行機(jī)器人工作形式靈活，經(jīng)常需要在自主運(yùn)行和被動(dòng)控制之間切換，同時(shí)其運(yùn)行環(huán)境也會(huì)在室內(nèi)和室外變化。因此連續(xù)定位會(huì)頻繁的中斷，這就要求助行機(jī)器人具有較強(qiáng)的全局定位功能，可以快速地重新定位。本文對(duì)全局搜索定位算法進(jìn)行研究，提出利用旋轉(zhuǎn)不變量首先進(jìn)行位置空間搜索得到可行的機(jī)器人位置，然后在方向空間進(jìn)行搜索得到機(jī)器人的朝向，對(duì)全局搜索定位方法進(jìn)行降維，這樣大大提升了全局定位的效率。（3）傳統(tǒng)的 2D連續(xù)位置跟蹤方法較為成熟但是需要使用激光傳感器，對(duì)助行機(jī)器人的成本控制不利。本文嘗試以 RGB-D傳感器來代替 2D激光傳感器進(jìn)I 上海交通大學(xué)博士學(xué)位論文行連續(xù)定位，通過充分利用 RGB-D的 3D點(diǎn)云信息彌補(bǔ)其水平方向視野較小的缺點(diǎn)。而傳統(tǒng)的 3D點(diǎn)云配準(zhǔn)定位算法，無法達(dá)到實(shí)時(shí)定位的需求，本文提出了基于 3DLUT（Lookup Table）的 3D點(diǎn)云快速配準(zhǔn)方法，該方法可以達(dá)到實(shí)時(shí)的處理速度，同時(shí)具有較高的定位精度。（4 ）助行機(jī)器人的用戶定位功能是一項(xiàng)非常重要的功能，對(duì)提高助行機(jī)器人的易用性起很大的作用。傳統(tǒng)的基于激光傳感器的用戶定位方法由于沒有用戶區(qū)分的能力，所以在行人干擾較多的情況下無法正常工作；基于視覺的方法則因?yàn)閷?duì)光線變化，觀察角度等非常敏感，所以魯棒性不高。本文提出基于全向視覺及紅外標(biāo)志物識(shí)別的方法來定位用戶。通過調(diào)節(jié)相機(jī)曝光值，使得系統(tǒng)在室內(nèi)室外均能穩(wěn)定的識(shí)別用戶。在對(duì)全向視覺系統(tǒng)進(jìn)行標(biāo)定時(shí)，利用鏡面基底圓輪廓的成像來計(jì)算鏡面位姿確定內(nèi)部參數(shù)的方法，并提出了使用鏡面中心點(diǎn)來確定鏡面位姿兩組可能解中的真實(shí)解，同時(shí)提出了利用一種具有單一解的 Non-SVP（非單一中心）P3P解法來確定全向視覺系統(tǒng)的外部參數(shù)的方法。該標(biāo)定方法簡單快速，對(duì)標(biāo)定物要求低，并具有較高的精度。（5）根據(jù)本文提出的幾項(xiàng)關(guān)鍵技術(shù)解決方案，開發(fā)搭建了 WalkMateIII型助行機(jī)器人軟硬件系統(tǒng)。為了方便系統(tǒng)軟件的開發(fā)集成，提高系統(tǒng)的結(jié)構(gòu)清晰度，本文利用基于模塊化的方法來搭建助行機(jī)器人的軟件系統(tǒng)。最后通過實(shí)現(xiàn)兩個(gè)典型任務(wù)：開機(jī)用戶查找，用戶跟蹤的，對(duì)整套系統(tǒng)的可行性進(jìn)行驗(yàn)證。國內(nèi)助行機(jī)器人的研究剛剛起步，而助行機(jī)器人由于其特殊的工作方法和一般的移動(dòng)服務(wù)機(jī)器人有多方面的差別，還有很多問題有待解決。本文的研究目的是：通過對(duì)助行機(jī)器人的定位系統(tǒng)的研究，解決幾項(xiàng)關(guān)鍵問題。論文的研究有助于助行機(jī)器人早日進(jìn)入實(shí)用階段，為解決人口老齡化帶來的老人護(hù)理問題打下基礎(chǔ)，具有重要的社會(huì)意義和經(jīng)濟(jì)價(jià)值。關(guān)鍵詞：助行機(jī)器人，全向視覺標(biāo)定，3D點(diǎn)云地圖創(chuàng)建，全局定位，快速點(diǎn)云配準(zhǔn)算法，機(jī)器人模塊化，用戶定位II 摘要Research on Key Technologies of Localization Method for Walking Assistant Robot ABSTRACT The walking assistant robot (WAR) is a special kind of service robot which canassist the elderly to walk. The reason behind the development of the WAR is toreplace traditional walking aids such as crutches and the walking frame. Moreover,besides the walking assistant function, it also offers more intelligent functions, such ashealth condition monitoring, voice interaction, navigation, user identification, userprogram reminders, information services, etc. The localization system which is animportant component of WAR acts as a base for many intelligent functions. Thisdissertation covers a study of the localization system and the research contents hereinare as follows.1，The map of the environment is key for a-priori knowledge for the autonomouslocalization and navigation function of the WAR. Although 2D maps can meet theneeds of the robot for self-localization, its drawback of uncertainty in the verticaldirection made it unable to meet the demand for autonomous navigation in narrowenvironment such as would be encountered in a typical home setting. Traditional 3Dmapping methods need expensive equipment and the operation is complex. In thisdissertation, we studied the 3D mapping method based on RGB-D (color- depth)sensor and proposed a map creation method based on improved “KinectFusion”,enabling users to more easily re-create the family environment. This dissertationadvances the KinectFusion algorithm with two improvements. On the one hand use ismade of the environment feature to point out matching edges and consequentlyimprove its positioning robustness, on the other hand ground point cloud is preset inthe point cloud model to reduce the accumulated error and hence improve accuracy.III 上海交通大學(xué)博士學(xué)位論文Additionally, a sub-map stitching method is proposed to solve the limitation of thesize of the map built by “KinectFusion”, based on the ground consistency and thecalibration marker.2，The working style of WAR is flexible and there is often the need to switch betweenpassive control and autonomous operation, especially when its operating environmentswitches between indoor and outdoor. In this manner the continuous positioning isfrequently interrupted. This requires the robot to have a strong global positioningfeature and the ability to quickly re-orient itself. In this dissertation, the global searchpositioning dimensionality reduction method is proposed using the rotationalinvariants for the initial search for a viable space robot position, and subsequently inthe direction of the search space to get the orientation of the robot thus greatlyenhancing the efficiency of its global positioning.3，The traditional 2D continuous location tracking method is mature, but it requiresthe use of laser sensors on the WAR which is unfavorable for purposes of minimizingcost. This article attempts to employ an RGB-D sensor instead of a 2D laser sensor forcontinuous positioning. The main idea is to exclusively use RGB-D information as a3D point cloud for position tracking, making up for its disadvantage by selecting asmall field of view in the horizontal direction. Traditional 3D point cloud registrationalgorithm, cannot fulfill the demands of real-time location. This dissertation presentsa study of three-dimensional point cloud registration using RGB-D sensors, andproposes a fast 3D point cloud registration method based on 3DLUT (Lookup Table)algorithm. This method can not only achieve real-time processing speeds, but also hasa high degree of accuracy.4，The human positioning function is a very important function and plays a great roletowards improving user-friendliness of the WAR. The traditional laser-basedlocalization method lacks the capacity to identify the user hence cannot work well inan environment full of people. Vision-based methods on the other hand are verysensitive to changes in light characteristics hence have low robustness. In thisdissertation, we propose a people positioning based on omni-dimensional visual andIV 摘要infrared markers for identification. The test results proved it to be stable both indoorsand outdoors. For the omni-directional vision system (odvs) calibration, we proposeto use the image of the base circle contour to compute the posture of the mirror anddetermine the internal parameters, and then use the center of the mirror to determinethe true solution from two possibilities. Next, we propose using a special uniquesolution -Non-SVP P3P method to determine the external parameters. Thecalibration method is simple and fast, and not only places low demand on thecalibration object, but also has high accuracy.5，Using the solutions for these key technologies, the hardware and software systemfor the WalkMate III WAR was designed and built. We proposed to use the modulebased system model to make the development of the software system easier, and makethe structure of the system clearer. Finally two intelligence functions were tested inorder to evaluate the Feasibility of the whole system. These are the users findingfunction (when the robot power is switched on) and user tracking.The domestic research of WAR has just started. Because of its special workingmethods and have many differences with general mobile service robots, there aremany issues to be resolved. The purpose of this study is: research on the localizationsystem of WAR, and solve several key issues. The research contained in thisdissertation should be useful towards helping the WAR enter the practical stage assoon as possible, laying the foundation for solving the problem of caring for theelderly caused by aging population problem. Eventually this and has important socialsignificance and results in economic value.Keywords: walking assistant robot, calibration of omnidirectional camera, 3Dpoint cloud creating, global localization, fast point registration algorithm, modularrobots, people localizationV 上海交通大學(xué)博士學(xué)位論文目錄摘要 .IABSTRACT.III目錄 .VI第一章緒論 .11.1課題來源、研究背景及意義.11.1.1課題來源.11.1.2課題研究背景及意義.11.2助行機(jī)器人國內(nèi)外研究現(xiàn)狀.31.2.1國外研究現(xiàn)狀.31.2.2國內(nèi)研究現(xiàn)狀.91.3助行機(jī)器人定位關(guān)鍵技術(shù).121.3.1助行機(jī)器人功能需求.121.3.2助行機(jī)器人定位系統(tǒng)關(guān)鍵技術(shù).141.4研究內(nèi)容與論文組織.241.4.1研究內(nèi)容.241.4.2論文組織.25第二章基于改進(jìn) KinectFusion算法的 3D點(diǎn)云地圖創(chuàng)建.262.1引言.262.2 RGB-D傳感器介紹.272.3 KinectFusion算法.282.3.1 KinectFusion算法的 ICP定位方法.292.3.2 KinectFusion算法的 TSDF點(diǎn)云融合算法 .322.4改進(jìn)的 KinectFusion算法.332.4.1 KinectFusion算法的兩個(gè)問題分析.332.4.2邊線點(diǎn)對(duì)應(yīng)關(guān)系改進(jìn).352.4.3預(yù)設(shè)地面模型改進(jìn).41VI 目錄2.5基于標(biāo)志物的點(diǎn)云地圖拼接.442.5.1標(biāo)志物及其在子圖中的布置.442.5.2子地圖中標(biāo)志物坐標(biāo)提取.452.5.3相鄰子地圖位置計(jì)算.472.5.4基于 BA算法的閉環(huán)優(yōu)化.482.6實(shí)驗(yàn)與分析.502.6.1邊線點(diǎn)對(duì)應(yīng)關(guān)系改進(jìn)方法測(cè)試.502.6.2預(yù)設(shè)地面模型改進(jìn)方法測(cè)試.532.6.3子地圖拼接精度測(cè)試.532.7小結(jié).55第三章基于旋轉(zhuǎn)不變量的全局自定位方法 .563.1引言.563.2 2D距離傳感器數(shù)據(jù)的旋轉(zhuǎn)不變量.573.2.1 2D距離傳感器數(shù)據(jù)的數(shù)學(xué)定義.573.2.2旋轉(zhuǎn)不變量的定義.583.2.3基于旋轉(zhuǎn)不變量的位置濾波及其閾值確定.583.2.4旋轉(zhuǎn)不變量濾除率分析.603.3基于旋轉(zhuǎn)不變量的二步定位法.623.3.1地圖遍歷.633.3.2 Omni_Scan采集.653.3.3歐幾里得聚類.653.3.4基于相關(guān)度匹配的朝向確定.663.3.5重定位策略.673.3.6處理過程的中間結(jié)果示例.683.4實(shí)驗(yàn)與分析.683.4.1直方圖數(shù)目和距離掃描采樣數(shù)的實(shí)驗(yàn)確定.693.4.2環(huán)境中有動(dòng)態(tài)物體時(shí)的定位精度測(cè)試.733.4.3地圖尺寸對(duì)定位的影響測(cè)試.733.4.4與基于線段特征的全局定位方法對(duì)比實(shí)驗(yàn).74VII 上海交通大學(xué)博士學(xué)位論文3.4.5機(jī)器人定位精度試驗(yàn).763.5小結(jié).77第四章基于 3DLUT點(diǎn)云快速配準(zhǔn)算法的實(shí)時(shí)位置跟蹤方法.784.1引言.784.2加速 ICP算法研究現(xiàn)狀 .784.3 2DLUT（Look Up Table,查找表）算法.794.3.1配準(zhǔn)問題定義與分析.804.3.2誤差方程定義及基于 RPROP算法的誤差優(yōu)化.814.3.3 2D查找表的建立.824.3.4基于 2DLUT的連續(xù)位置跟蹤算法.844.4 3DLUT算法.844.4.1 3D查找表的建立.854.4.2內(nèi)存的優(yōu)化.864.4.3 RGB-D傳感器標(biāo)定.874.5實(shí)驗(yàn)與分析.894.5.1與 ICP算法對(duì)比實(shí)驗(yàn) .894.5.2實(shí)際環(huán)境定位精度測(cè)試.914.6小結(jié).93第五章基于全向視覺及紅外標(biāo)志的用戶定位方法 .945.1引言.945.2基于全向視覺及紅外標(biāo)志物的用戶定位.945.2.1全向視覺系統(tǒng).945.2.2紅外標(biāo)志物目標(biāo)識(shí)別.955.2.3目標(biāo)的位置確定.995.3全向視覺傳感器標(biāo)定.1005.3.1研究現(xiàn)狀.1005.3.2參數(shù)定義.1015.3.3全向視覺成像模型建立.1025.3.4基于鏡面輪廓的內(nèi)部參數(shù)標(biāo)定.103VIII 目錄5.3.5基于單一解 Non-SVP問題的外部參數(shù)標(biāo)定.1055.3.6多點(diǎn)優(yōu)化.1075.4實(shí)驗(yàn)與分析.1085.4.1全向視覺標(biāo)定實(shí)驗(yàn).1085.4.2已知高度單點(diǎn)位置測(cè)量精度實(shí)驗(yàn).1125.4.3未知高度的兩點(diǎn)測(cè)量精度實(shí)驗(yàn).1135.5小結(jié).114第六章 WalkMateIII實(shí)驗(yàn)平臺(tái)及功能測(cè)試.1156.1引言.1156.2 WalkmateIII硬件系統(tǒng) .1156.3 WalkmateIII軟件系統(tǒng) .1166.4集成功能測(cè)試.1196.4.1開機(jī)用戶查找功能.1196.4.2用戶跟隨功能.1216.5小結(jié).122zhi ku quan 20150721第七章總結(jié)與展望 .1237.1全文總結(jié).1237.2主要?jiǎng)?chuàng)新點(diǎn).1247.3研究展望.124參考文獻(xiàn) .126攻讀博士學(xué)位期間已發(fā)表或錄用的論文及專利 .134攻讀博士學(xué)位期間參與的科研項(xiàng)目 .135致謝 .136IX zhi ku quan 20150721 第一章緒論第一章緒論1.1課題來源、研究背景及意義1.1.1課題來源本論文受國家 863計(jì)劃先進(jìn)制造技術(shù)領(lǐng)域重點(diǎn)項(xiàng)目“助老/助殘機(jī)器人概念樣機(jī)研究與開發(fā)”（2006AA040203）資助。1.1.2課題研究背景及意義全球經(jīng)濟(jì)日益繁榮、科技不斷進(jìn)步的同時(shí)，世界各國也正在步入一個(gè)老齡化的階段。據(jù)統(tǒng)計(jì)1950年至2010年期間，發(fā)達(dá)國家60歲以上老年人口升至8%17%，發(fā)展中國家也升至4%6%。到本世紀(jì)中葉，這兩個(gè)數(shù)字將分別達(dá)到 26%和 14%1。而中國則面臨著更加嚴(yán)峻的人口老齡化問題，據(jù)中國社科院發(fā)布的中國老齡事zhi ku quan 20150721業(yè)發(fā)展報(bào)告(2013)2中指出截至 2012年底，我國 60歲以上老年人口數(shù)量達(dá)到1