Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping

Adrian Llopart Maurin, Ole Ravn, Nils Axel Andersen

    Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

    3803 Downloads (Pure)

    Abstract

    In this paper we present a new method that robustly identifies doors, cabinets and their respective handles, with special emphasis on extracting useful features from handles to be then manipulated. The novelty of this system relies on the combination of a Convolutional Neural Net (CNN), as a form of reducing the search space, several methods to extract point cloud data and a mobile robot to interact with the objects. The framework consists of the following components: The implementation of a CNN to extract a Region of Interest (ROI) from an image corresponding to a door or cabinet. Several vision based techniques to detect handles inside the ROI and its 3D positioning. A complementary plane segmentation method to differentiate door/cabinet from the handle. An algorithm to fuse both approaches robustly and extract essential information from the handle for robotic grasping (i.e. handle point cloud, door plane model, grasping locations, turning orientation, orthogonal vector to door). A mobile robot for grasping the handle. The system assumes no prior knowledge of the environment.
    Original languageEnglish
    Title of host publicationProceedings of 2017 3rd International Conference on Control, Automation and Robotics
    PublisherIEEE
    Publication date2017
    Pages144-9
    ISBN (Print)9781509060863
    DOIs
    Publication statusPublished - 2017
    Event2017 3rd International Conference on Control, Automation and Robotics - SunPlaza Seasons Hotel, Nagoya, Japan
    Duration: 24 Apr 201726 Apr 2017
    Conference number: 3

    Conference

    Conference2017 3rd International Conference on Control, Automation and Robotics
    Number3
    LocationSunPlaza Seasons Hotel
    Country/TerritoryJapan
    CityNagoya
    Period24/04/201726/04/2017

    Keywords

    • Convolutional neural network
    • Image processing
    • Pointcloud processing
    • Mobile robot
    • Door recognition

    Fingerprint

    Dive into the research topics of 'Door and cabinet recognition using convolutional neural nets and real-time method fusion for handle detection and grasping'. Together they form a unique fingerprint.

    Cite this