Short Bio

Anbang Yao is currently a Principal AI Scientist, also a Principal Engineer (known as PE, techncial leader recognized within Intel) at Intel Labs China where he leads the research efforts on developing omni-scale high-performance artificial intelligence systems. He got his Ph.D. degree from Tsinghua University in January 2010. He has over 110 PCT/US patent applications got granted/filed, which are broadly adopted in Intel AI HW Accelerators (Intel® NPU/VPU product line and Intel® Arria® Series FPGAs), HW Core AI IPs/Usages (Intel® Meteor Lake for Laptops, Ultra-low-power Companion Die CVF paired with TGL, MTL and ADL Core Processors, and Intel® Xe GPUs), and SW Development Kits (Intel® Distribution of OpenVINO™ Toolkit and Intel® RealSense™ SDK). As the first/corresponding author, he has published over 45 top-tier research papers in ICLR, NeurIPS, ICML, AAAI, CVPR, ICCV, ECCV, TPAMI and etc. His works, such as INQ (Incremental Network Quantization) for convnet quantization, DNS (Dynamic Network Surgery) for sparse convnets, HyperNet for efficient object detection and OANet (Order-Aware Network) for geometric correspondence learning, are among Most Influential ICLR/NeurIPS/CVPR/ICCV Papers in Google Scholar Metrics 2021/2022/2023/2024. He has been recognized with numerous Awards at Intel, such as Intel Innovator (the first and so far the only winner employee from China), Top-1 Inventor of Intel Labs (had 34 PCT/US patent applications approved in a single year, keeping the highest record so far), CTO recognition of exceptional contributions (31 sparse and low-bit AI inference IPs) to the Intel Core Ultra (code-named Meteor Lake) for laptops, 3 times of annual Intel Labs Gordy Awards (the highest annual research award named after Intel’s co-founder Gordon Earle Moore, 戈登·摩尔奖), and 2 times of annual Intel China Awards. He also led the team and won the Winner of the prestigious EmotiW Challenges (held by ACM ICMI) in 2015/2017, beating out 74/100+ teams across the world. He demonstrated outstanding skills in mentoring interns/team members, and many of them have already grown into top young researchers in the field.

News：

• September 26th, 2024. Our paper ScaleKD, a compelling work that could transfer the scalable property of pre-trained large vision transformer models to smaller target models of any type without need of large-scale pre-training data, is accepted to NeurIPS 2024.
• May 2nd, 2024. Our work KernelWarehouse, which advances dynamic convolution research towards substantially better parameter efficiency and representation power, is accepted to ICML 2024.
• March 28th, 2024. I will be serving as an Area Chair (AC) for NeurIPS 2024.
• February 27th, 2024. Our paper SSD-KD, the first work for super-fast and high-performance data-free knowledge distillation with a new concept of “small scale data inversion”, is accepted to CVPR 2024.
• September 22nd, 2023. Our paper Af-DCD, a new augmentation-free dense contrastive distillation framework for efficient semantic segmentation, is accepted to NeurIPS 2023.
• April 25th, 2023. Our paper Ske2Grid, a progressive representation learning framework conditioned on transforming human skeleton graph into an up-sampled grid representation for skeleton based action recognition, is accepted to ICML 2023.
• February 28th, 2023. Our paper Sparks is accepted to CVPR 2023.
• January 21st, 2023. Our paper NORM, the first knowledge distillation work for N-to-One Rrepresentation Matching, is accepted to ICLR 2023.
• January 11th, 2023. Our work Grid Convolution is accepted to AAAI 2023 as an oral paper.
• October 13th, 2022. I am awarded as a Top (a.k.a. Outstanding) Reviewer from NeurIPS 2022.
• June 1st, 2022. The journal version of our work OANet is published by TPAMI.
• January 21st, 2022. Our work Omni-Dimensional Dynamic Convolution scored with 8/8/8/6 is accepted to ICLR 2022 as a Spotlight paper.
• September 28th, 2021. Our paper for efficient video action recognition is accepted to NeurIPS 2021.
• August 11th, 2021. I will be serving as a Senior Program Committee (SPC, akin to Area Chair to NeurIPS) member for AAAI 2022.
• July 22nd, 2021. Our SNNs (Sub-bit Network Networks), the first work to compress and accelerate binary neural networks, is accepted to ICCV 2021.
• July 25th, 2020. One full-length research paper accepted to ACM MM 2020.
• July 3rd, 2020. Our works DCM (Dense Cross-layer Mutual-distillation) and RS-Nets (Resolution Switchable Networks) together with the other two works accepted to ECCV 2020.
• September 6th, 2019. I am recognized as a Top Reviewer from NeurIPS 2019.
• July 23rd, 2019. Three papers accepted to ICCV 2019.
• February 25th, 2019. Our work DKS (Deeply-supervised Knowledge Synergy) is accepted to CVPR 2019.
• December 20th, 2018. Delivered an invited talk at Tsinghua University.
• December 7th, 2018. Delivered an invited talk “Deep neural network compression and acceleration” at CDNNRIA Workshop in NeurIPS 2018.
• July 5th, 2018. Our work SGC (Spatial Group Convolution) is accepted as a full oral paper to ECCV 2018.
• February 22nd, 2018. Our work ELQ (Explicit Loss-error-aware Quantization) is accepted to CVPR 2018.
• July 17th, 2017. One paper accepted to ICCV 2017.
• March 18th, 2017. Three papers accepted to CVPR 2017.
• February 6th, 2017. Our work INQ (Incremental Network Quantization) is accepted to ICLR 2017.
• August 12th, 2016. Our work DNS (Dynamic Network Surgery) is accepted to NIPS 2016.
• March 1st, 2016. Our work HyperNet is accepted as a spotlight oral paper to CVPR 2016.

Latest Manuscripts

(* Interns or team/project members mentored by me, + Equal contribution, # Corresponding author)

• NOAH: Learning Pairwise Object Category Attentions for Image Classification.
  Chao Li*, Aojun Zhou and Anbang Yao#.
  arXiv preprint, 2024.
  [Manuscript].[Code].
  

Selected Publications

2024

• ScaleKD: Strong Vision Transformers Could Be Excellent Teachers.
  Jiawei Fan*, Chao Li*, Xiaolong Liu*, and Anbang Yao#.
  Conference on Neural Information Processing Systems (NeurIPS), 2024.
  [Paper].[Code].
  
• KernelWarehouse: Rethinking the Design of Dynamic Convolution.
  Chao Li* and Anbang Yao#.
  International Conference on Machine Learning (ICML), 2024.
  [Paper].[Code].
  
• Small Scale Data-Free Knowledge Distillation.
  He Liu*+, Yikai Wang*+, Huaping Liu, Fuchun Sun and Anbang Yao#.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
  [Paper].[Code].
  

2023

• Augmentation-free Dense Contrastive Distillation for Efficient Semantic Segmentation.
  Jiawei Fan*, Chao Li*, Xiaolong Liu*, Meina Song and Anbang Yao#.
  Conference on Neural Information Processing Systems (NeurIPS), 2023.
  [Paper].[Code].
  
• Ske2Grid: Skeleton-to-Grid Representation Learning for Action Recognition.
  Dongqi Cai*, Yangyuxuan Kang*, Anbang Yao# and Yurong Chen.
  International Conference on Machine Learning (ICML), 2023.
  [Paper].[Code].
  
• NORM: Knowledge Distillation via N-to-One Representation Matching.
  Xiaolong Liu*, Lujun Li*, Chao Li* and Anbang Yao#.
  International Conference on Learning Representations (ICLR), 2023.
  [Paper].[Code].
  
• 3D Human Pose Lifting with Grid Convolution.
  Yangyuxuan Kang*, Yuyang Liu*, Anbang Yao#, Shandong Wang and Enhua Wu.
  AAAI Conference on Artificial Intelligence (AAAI), 2023 (Oral).
  [Paper].[Code].
  

• Compacting Binary Neural Networks by Sparse Kernel Selection.
  Yikai Wang*, Wenbing Huang, Yinpeng Dong, Fuchun Sun and Anbang Yao#.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
  [Paper].[Code].
  

2022

• Omni-Dimensional Dynamic Convolution.
  Chao Li*, Aojun Zhou and Anbang Yao#.
  International Conference on Learning Representations (ICLR), 2022 (Spotlight).
  [Paper].[Code].
  

• OANet: Learning Two-View Correspondences and Geometry Using Order-Aware Network.
  Jiahui Zhang*+, Dawei Sun*+, Zixin Luo, Anbang Yao, Hongkai Chen, Lei Zhou, Tianwei Shen, Yurong Chen, Long Quan and Hongen Liao.
  IEEE Trans. on Pattern Analysis and Machine Intelligence, vol 44(6), pages 3110–3122, 2022.
  [Paper]. [Code].
  

2021

• Dynamic Normalization and Relay for Video Action Recognition.
  Dongqi Cai*+, Anbang Yao+# and Yurong Chen.
  Conference on Neural Information Processing Systems (NeurIPS), 2021.
  [Paper]. [Code].
  

• Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks.
  Yikai Wang*, Yi Yang, Fuchun Sun and Anbang Yao#.
  International Conference on Computer Vision (ICCV), 2021.
  [Paper]. [Code].
  

2020

• Knowledge Transfer via Dense Cross-layer Mutual-distillation.
  Anbang Yao+# and Dawei Sun*+.
  European Conference on Computer Vision (ECCV), 2020.
  [Paper]. [Code].
  
• Resolution Switchable Networks for Runtime Efficient Image Classification.
  Yikai Wang*, Fuchun Sun, Duo Li* and Anbang Yao#.
  European Conference on Computer Vision (ECCV), 2020.
  [Paper]. [Code].
  
• PSConv: Squeezing Feature Pyramid into One Compact Poly-Scale Convolutional Layer.
  Duo Li*, Anbang Yao# and Qifeng Chen.
  European Conference on Computer Vision (ECCV), 2020.
  [Paper]. [Code].
  

2019

• Learning Two-View Correspondences and Geometry Using Order-Aware Network.
  Jiahui Zhang*+, Dawei Sun*+, Zixin Luo, Anbang Yao#, Lei Zhou, Tianwei Shen, Yurong Chen, Long Quan and Hongen Liao.
  International Conference on Computer Vision (ICCV), 2019.
  [Paper]. [Code].
  Winner of the Image Matching Workshop Challenge at CVPR 2019
  Among Most Influential ICCV Papers in Google Scholar Metrics 2023
  Among Most Influential ICCV Papers in Google Scholar Metrics 2024
  
• A Closed-form Solution to Universal Style Transfer.
  Ming Lu*, Hao Zhao*, Anbang Yao#, Yurong Chen, Feng Xu and Li Zhang.
  International Conference on Computer Vision (ICCV), 2019.
  [Paper]. [Code].
  
• HBONet: Harmonious Bottleneck on Two Orthogonal Dimensions.
  Duo Li*+, Aojun Zhou*+ and Anbang Yao#.
  International Conference on Computer Vision (ICCV), 2019.
  [Paper]. [Code].
  
• Deeply-supervised Knowledge Synergy.
  Dawei Sun*+, Anbang Yao+#, Aojun Zhou* and Hao Zhao*.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  [Paper]. [Code].
  

2018

• Efficient Semantic Scene Completion Network with Spatial Group Convolution.
  Jiahui Zhang*, Hao Zhao*, Anbang Yao#, Yurong Chen, Li Zhang and Hongen Liao.
  European Conference on Computer Vision (ECCV), 2018 (Oral).
  [Paper]. [Code].
  
• Explicit Loss-Error-Aware Quantization for Low-Bit Deep Neural Networks.
  Aojun Zhou*+, Anbang Yao+#, Kuan Wang* and Yurong Chen.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
  [Paper]. [Code].
  

2017

• Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights.
  Aojun Zhou*+, Anbang Yao+#, Yiwen Guo+, Lin Xu and Yurong Chen.
  International Conference on Learning Representations (ICLR), 2017.
  [Paper]. [Code].
  Among Most Influential ICLR Papers in Google Scholar Metrics 2021
  Among Most Influential ICLR Papers in Google Scholar Metrics 2022
  
• RON: Reverse Connection with Objectness Prior Networks for Object Detection.
  Tao Kong*, Fuchun Sun, Anbang Yao#, Huaping Liu, Ming Lu* and Yurong Chen.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  [Paper]. [Code].
  
• Network Sketching: Exploiting Binary Structure in Deep CNNs.
  Yiwen Guo, Anbang Yao, Hao Zhao* and Yurong Chen.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
  [Paper]. [Code].
  
• Learning Supervised Scoring Ensemble for Emotion Recognition in the Wild.
  Ping Hu, Dongqi Cai, Shandong Wang, Anbang Yao# (project leader, conceived the idea and project) and Yurong Chen.
  ACM International Conference on Multimodal Interaction (ACM ICMI), 2017 (Oral).
  [Paper]. [Code].
  Winner of EmotiW-AFEW 2017, out of 100+ Teams
  

2016

• Dynamic Network Surgery for Efficient DNNs.
  Yiwen Guo*, Anbang Yao# and Yurong Chen.
  Conference on Neural Information Processing Systems (NeurIPS), 2016.
  [Paper]. [Code].
  Among Most Influential NeurIPS Papers in Google Scholar Metrics 2021
  
• HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection.
  Tao Kong*, Anbang Yao#, Yurong Chen and Fuchun Sun.
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (Spotlight).
  [Paper]. [Code].
  Among Most Influential CVPR Papers in Google Scholar Metrics 2021
  
• HoloNet: Towards Robust Emotion Recognition in the Wild.
  Anbang Yao+#, Dongqi Cai+, Ping Hu+, Shandong Wang+, Liang Sha+ and Yurong Chen.
  ACM International Conference on Multimodal Interaction (ACM ICMI), 2016 (Oral).
  [Paper]. [Code].
  1^st Runner-up of EmotiW-AFEW 2016, out of ~100 Teams.
  

2015 and before

• Capturing AU-Aware Facial Features and Their Latent Relations for Emotion Recognition in the Wild.
  Anbang Yao+#, Junchao Shao*+, Ningning Ma*+ and Yurong Chen.
  ACM International Conference on Multimodal Interaction (ACM ICMI), 2015 (Oral).
  [Paper]. [Code].
  Winner of EmotiW-AFEW 2015, out of 75 Teams.
  
• Robust Face Representation Using Hybrid Spatial Feature Interdependence Matrix.
  Anbang Yao# and Shan Yu.
  IEEE Trans. on Image Processing, vol 22(8), pages 3247–3259, 2013.
  [Paper]. [Code].
  
• A Compact Association of Particle Filtering and Kernel Based Object Tracking.
  Anbang Yao#, Xinggang Lin, Guijin Wang and Shan Yu.
  Pattern Recognition, vol 45(7), pages 2584-2597, 2012.
  [Paper]. [Code].
  
• An Incremental Bhattacharyya Dissimilarity Measure for Particle Filtering.
  Anbang Yao#, Guijin Wang, Xinggang Lin and Xiujuan Chai.
  Pattern Recognition, vol 43(4), pages 1244-1256, 2010.
  [Paper]. [Code].
  
• Kernel Based Articulated Object Tracking with Scale Adaptation and Model Update.
  Anbang Yao#, Guijin Wang, Xinggang Lin and Hao Wang.
  IEEE International Conference on Acoustics, Speech, & Signal Processing (ICASSP), 2008.
  [Paper]. [Code].
  

Some Old Manuscripts (Works Done at Intel)

• Explicit Connection Distillation.
  Lujun Li*+, Yikai Wang*+, Anbang Yao+#, Yi Qian, Xiao Zhou and Ke He.
  ICLR 2021 submission.
  [Manuscript].
  
• Weights Having Stable Signs Are Important: Finding Primary Subnetworks and Kernels to Compress Binary Weight Networks.
  Zhaole Sun* and Anbang Yao#.
  ICLR 2021 submission.
  [Manuscript].
  
• SnapQuant: A Probabilistic and Nested Parameterization for Binary Networks.
  Kuan Wang*, Hao Zhao*, Anbang Yao#, Aojun Zhou*, Dawei Sun* and Yurong Chen.
  ICLR 2019 submission.
  [Manuscript].
  

Current and Previous Interns

• Jiawei Fan (Beijing University of Posts and Telecommunications)
• Miao Song (CAS-IA)
• He Liu (Tsinghua University)
• Yangyuxuan Kang (CAS-IS)
• Yikai Wang (Tsinghua University)
• Chao Li (CAS-IA)
• Yuyang Liu (Tsinghua University)
• Zhaole Sun (Tsinghua University)
• Ming Lu (Tsinghua University)
• Hao Zhao (Tsinghua University)
• Duo Li (Tsinghua University)
• Dawei Sun (Tsinghua University)
• Aojun Zhou (CAS-IA)
• Jiahui Zhang (Tsinghua University)
• Kuan Wang (Tsinghua University)
• Tao Kong (Tsinghua University)
• Wenbing Huang (Tsinghua University)
• Yun Ren (Beihang University)
• Yao Cheng (Peking University)
• Peixian Hu (Tsinghua University)
• Ruoyan Wang (Dalian University of Technology)
• Yuhang Wang (CAS-IA)
• Yunlong Bian (Beijing University of Posts and Telecommunications)
• Ningning Ma (Tsinghua University)
• Junchao Shao (Beihang University)
• Yiwen Guo (Tsinghua University)

Awards

• CTO Recognition of exceptional contributions (31 sparse and low-bit AI inference IPs) to the Intel Core Ultra (code-named Meteor Lake) for laptops, 2023.
• Top (a.k.a. Outstanding) Reviewer Award, NeurIPS 2022
• Eureka Award 2022, Top-1 Innovator of Intel Labs (had 10 PCT/US patent applications approved in a single quarter), 1 out of ~800 Research Scientists of Intel Labs
• 6 Intel China Quarterly Awards in 2017~2022, for great technical impacts to Intel China business
• 1 Outstanding Invention Award in 2020, for strong merits to future Intel AI HW designs
• Top Reviewer Award, NeurIPS 2019
• Intel Innovator 2018, 1 out of ~11800 Employees of Intel China, first and only winner employee of Intel China so far
• Intel China Employee of the Year Award 2017
• Top-1 Inventor of Intel Labs 2017 (had 34 PCT/US patent applications approved in a single year, keeping the highest record so far), 1 out of ~800 Research Scientists of Intel Labs
• Intel i360 Design Hero Award 2017, Highest Annual Business Award of Intel IoTG Asian Region
• Intel China Award 2017/2016, Highest Annual Team Award of Intel China
• Gordy Award 2016/2015/2014 (named after Intel’s co-founder Gordon Earle Moore), Highest Annual Research Award of Intel Labs
• Tsinghua Friendship-JiangZhen Scholarship 2009, Highest Scholarship in School of Information Science and Technology
• Tsinghua Friendship-Toshiba Scholarship 2008, First Class
• Tsinghua Friendship-AHaiFa Scholarship 2005, First Class

Academic Service

• Conference (Senior) Program Committee Member/Area Chair or Reviewer: CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, AAAI, BMVC, WACV, ACCV, ICMI, etc.
• Journal Reviewer: IEEE-TPAMI, IJCV, IEEE-TNNLS, IEEE-TIP, IEEE-TSMC, IEEE-TC, etc.