Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedings – Annual report year: 2017Researchpeer-review



View graph of relations

In this paper we present a new method that robustly identifies doors, cabinets and their respective handles, with special emphasis on extracting useful features from handles to be then manipulated. The novelty of this system relies on the combination of a Convolutional Neural Net (CNN), as a form of reducing the search space, several methods to extract point cloud data and a mobile robot to interact with the objects. The framework consists of the following components: The implementation of a CNN to extract a Region of Interest (ROI) from an image corresponding to a door or cabinet. Several vision based techniques to detect handles inside the ROI and its 3D positioning. A complementary plane segmentation method to differentiate door/cabinet from the handle. An algorithm to fuse both approaches robustly and extract essential information from the handle for robotic grasping (i.e. handle point cloud, door plane model, grasping locations, turning orientation, orthogonal vector to door). A mobile robot for grasping the handle. The system assumes no prior knowledge of the environment.
Original languageEnglish
Title of host publicationProceedings of 2017 3rd International Conference on Control, Automation and Robotics
Publication date2017
ISBN (Print)9781509060863
Publication statusPublished - 2017
Event2017 3rd International Conference on Control, Automation and Robotics - SunPlaza Seasons Hotel, Nagoya, Japan
Duration: 24 Apr 201726 Apr 2017
Conference number: 3


Conference2017 3rd International Conference on Control, Automation and Robotics
LocationSunPlaza Seasons Hotel
Series2017 3rd International Conference on Control, Automation and Robotics (iccar)
CitationsWeb of Science® Times Cited: No match on DOI

    Research areas

  • Convolutional neural network, Image processing, Pointcloud processing, Mobile robot, Door recognition

Download statistics

No data available

ID: 134060247