Huai Yu

Huai Yu (余淮)

Research Associate Professor, Wuhan University

About Me

I am a Research Associate Professor of the Electronic Information School at Wuhan University. Before taking this tenure-track position, I was a Postdoctoral Fellow in the AirLab of Robotics Institute, Carnegie Mellon University (CMU) , working with Prof. Sebastian Scherer. I finished my Ph.D. at Wuhan Univeristy under the supervision of Prof. Wen Yang and Prof. Gui-Song Xia. Now my research is on Computer Vision and Robotics. Particularly I am interested in 2D/3D visual correspondence for registration, calibration and camera localization.

News

Selected Papers [Full Publications]

Conference Papers


Towards Robust Visual-Inertial Odometry with Multiple Non-Overlapping Monocular Cameras

Yao He, Huai Yu*, Wen Yang, Sebastian Scherer (*corresponding author)

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2022

Paper Video

Unified Representation of Geometric Primitives for Graph-SLAM Optimization Using Decomposed Quadrics

Weikun Zhen#, Huai Yu#, Yaoyu Hu, Sebastian Scherer (# equal contribution)

IEEE International Conference on Robotics and Automation (ICRA). 2022

Paper Video

Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences

Huai Yu, Weikun Zhen, Wen Yang, Ji Zhang, Sebastian Scherer

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020.

Paper Presentation

LiDAR Enhanced Structure-from-Motion

Weikun Zhen, Yaoyu Hu, Huai Yu, Sebastian Scherer

IEEE International Conference on Robotics and Automation (ICRA). 2020

Paper Demo

An Intelligent Unmanned Aircraft System for Wilderness Search and Rescue

Huai Yu, Shijie Lin, Jinwang Wang, Kaimin Fu, Wen Yang

International Micro Air Vehicles Conference and Flight Competition (IMAV), 2017

Paper

Journal Papers


Detecting Line Segments in Motion-blurred Images with Events

Huai Yu^#, Hao Li^#, Wen Yang, Lei Yu, Gui-Song Xia

arXiv:2211.07365, 2022.

Homepage Paper Code Data

I2D-Loc: Camera Localization via Image to LiDAR Depth Flow

Kuangyi Chen, Huai Yu*, Wen Yang, Lei Yu, Sebastian Scherer, Gui-Song Xia

ISPRS Journal of Photogrammetry and Remote Sensing, 2022.

Homepage Paper Code Video

Targetless Extrinsic Calibration of Stereo, Thermal, and Laser Sensors in Structured Environments

Taimeng Fu, Huai Yu*, Wen Yang, Yaoyu Hu, Sebastian Scherer

IEEE Transactions on Instrument and Measurement, 2022.

Paper Code Video

ULSD: Unified Line Segment Detection across Pinhole, Fisheye, and Spherical Cameras

Hao Li#, Huai Yu#, Jinwang Wang, Wen Yang, Lei Yu, Sebastian Scherer (# cofirst author)

ISPRS Journal of Photogrammetry and Remote Sensing, 2021. The U. V. Helava Award – Best Paper 2021

Paper Code Presentation

Line-based 2D-3D Registration and Camera Localization in Structured Environments

Paper Video

Huai Yu, Weikun Zhen, Wen Yang, Sebastian Scherer

IEEE Transactions on Instrument and Measurement, 2020.

Analysis of Large Scale UAV Images using A Multi-scale Hierarchical Representation

Paper

Huai Yu, Jinwang Wang, Yu Bai, Wen Yang, Gui-Song Xia

Geo-spatial Information Science, 2018.

Research Experience

2D-3D Registration and Localization - Robotics Institute, Canegie Mellon University, advisor: Prof. Sebastian Scherer (11/2018 - Present)

2D-3D registration for camera pose estimation using 2D-3D line correspondences

  • Efficient 2D/3D line segment feature extraction from imagery and point clouds.
  • Rotation estimation using vanishing points and camera pose estimation.
  • Real-time camera localization within prior LiDAR maps with 2D-3D line correspondences.

Change Detection - Signal Processing Lab, Wuhan University, advisor: Prof. Wen Yang (09/2017 - 10/2018)

Change detection using high resolution remote sensing imagery

  • An interactive object-based change detection using active learning with Gaussian processes.
  • The integration of attribute information and con-textural information using Markov Random Fields.

SLAM and robotic system Signal Processing Lab, Wuhan University, advisor: Prof. Wen Yang (01/2016 - 08/2017)

Vision based navigation and mapping system for ground robots and drones

  • Specific object detection, objected-based automatic navigation.
  • Participate in DJI Developer challenge 2016, ICRA 2017 Robot Challenge, ICRA 2018 AI Challenge.

Image Stitching and OBIA analysis Signal Processing Lab, Wuhan University, advisor: Prof. Wen Yang (10/2014 - 12/2015)

Feature based aerial image stitching and classification algorithm

  • A fast feature extraction and matching algorithm for UAV Images.
  • A Color-Texture-Structure descriptor using binary partition tree for semantic segmentation.

Selected Projects

ICRA2018 DJI RoboMaster AI Challenge (DOTA-AI), 2018
TensorFlow ROS Python C++ OpenCV SqueezeDet

In this project, we designed a multi-functional AI robot system, which can be used to evaluate the localization and navigation, object detection and tracking methods. We developed a robot localization algorithm based on mult-sensor fusion. It won 6th place in the DJI RoboMaster AI Challenge.

Demo

The Intelligent Unmanned Aircraft System for Wilderness Search and Rescue (WiSAR), 2017
C++ ROS YOLO SSD Faster R-CNN Qt

In this project, we collected about 20,000 images to build a UAV perspective person dataset (UAV-PP) and adapted detection algorithms YOLOv2, SSD and Faster R-CNN for person detection and chose the SSD as the detection algorithm because it’s balance on accuracy and speed, the detection accuracy achieved 88.92%.

Demo Poster

ICRA2017 DJI RoboMaster Mobile Manipulation Challenge, 2017
C++ ROS OpenCV

In this project, we designed a robot to carry blocks from the starting point to the working area. It contain four main modules, i.e. mechanical module, global navigation module, local navigation module and the designed controlling logic. It won 6th place in the DJI RoboMaster Mobile Manipulation Challenge.

Demo

2016 DJI Developer Challenge
C++ ROS OpenCV

We developed a UAV system based on DJI M100 and a ground station to search objects (AprilTags) in wild with DJI Onboard and Mobile SDK. The robot can autonomous take-off and land on a moving platform. By using stereo vision and ROS navigation package, we also made it possible for autonomous search targets in the wild. It won 3th place in the 2016 DJI Developer Challenge.

Demo