YUANYUAN LIU
Associate Professor School of Information and Engineering China University of Geosciences (Wuhan) No. 68 Jincheng Road,Wuhan, P.R. China Postcode: 430074. Telephone: 86-013349830890 Email: liuyy@cug.edu.cn

Research Area

My research interests fall into the areas of computer vision, emotion computing, image and video understanding, etc. More specifically, I am interested in the following topics:

1. Head pose estimation, facial expression recognition, facial AU detection, and facial feature localization in unconstrained environment
2. Human computer interface including emotion computing, group emotion recognition, and multi-model emotion recognition
3. Image/Video understanding including scene recognition, object detection, and action recognition

RECENT NEWS:

1. Attended the 32nd ACM Multimedia Conference, 28 October - 1 November 2024 • Melbourne, Australia



2. Taking part in Valse 2023, 10-12 June 2023 • WuXi, China



3. Five papers from our group accepted, February 2023 • One accepted by CVPR 2023



4. Presented at ACM Multimedia 2022, 10-14 October 2022 • Lisbon, Portugal



5. Taking part in Valse 2021, 8-10 October 2021 • Hangzhou, China



6. Presentation at ICIP 2021, 19-22 September 2021 • Anchorage, Alaska, USA

Publication

Journal Paper:
	Yu Wang, Yuanyuan Liu, Shunping Zhou, Yuxuan Huang, Chang Tang, Wujie Zhou, Zhe Chen. "Emotion-oriented Cross-modal Prompting and Alignment for Human-centric Emotional Video Captioning." IEEE Transactions on Multimedia.[pdf] [code(github)]
	Fayong Zhang, Kejun Liu, Yuanyuan Liu, Chaofan Wang, Wujie Zhou, Hongyan Zhang, Lizhe Wang. "Multi-target Domain Adaptation Building Instance Extraction of Remote Sensing Imagery with Domain-common Approximation learning." IEEE Transactions on Geoscience and Remote Sensing (2024).[pdf] [doi] [code(github)]
	Guanghao Yin, Yuanyuan Liu, Tengfei Liu, Haoyu Zhang, Fang Fang, Chang Tang, Liangxiao Jiang."Token-disentangling Mutual Transformer for multimodal emotion recognition Engineering." Applications of Artificial Intelligence Volume 133, Part D, July 2024, Page 108348[pdf] [doi] [code(github)]
	Yuanyuan Liu, Ning Zhou, Fayong Zhang, Wenbin Wang, Yu Wang, Kejun Liu, Ziyuan Liu."APSL: Action-positive separation learning for unsupervised temporal action localization."Information Sciences,Volume 630,2023,Pages 206-221.[pdf] [doi] [code(github)]
	Yuanyuan Liu, Wenbin Wang, Chuanxu Feng, Haoyu Zhang, Zhe Chen, Yibing Zhan."Expression snippet transformer for robust video-based facial expression recognition."Pattern Recognition,Volume 138,2023,109368.[pdf] [doi] [code]
	Yu Wang, Shunping Zhou, Yuanyuan Liu, Kunpeng Wang, Fang Fang, Haoyue Qian. ConGNN Context-consistent cross-graph neural network for group emotion recognition in the wild, Information Sciences (2022).[pdf] [doi] [code] [SiteGroEmo Dataset] Note: The data are passcode protected. Please download and send the signed [EULA] to qianying@cug.edu.cn for access request.
	Yuanyuan Liu, Chuanxu Feng, Xiaohui Yuan, Lin Zhou, Wenbin Wang, Jie Qin, Zhongwen Luo. Clip-aware Expressive Feature Learning for Video-based Facial Expression Recognition, Information Sciences (2022).[pdf] [doi] [code]
	Yuanyuan Liu, Wei Dai, Fang Fang, Yongquan Chen, Rui Huang, et al. "Dynamic multi-channel metric network for joint pose-aware and identity-invariant facial expression recognition." Information Sciences 578.(2021).[pdf] [doi]
	Yuanyuan Liu, Wenbin Wang, Fang Fang, Lin Zhou, Chenxing Sun, Ying Zheng, and Zhanlong Chen. "CscGAN: Conditional Scale-Consistent Generation Network for Multi-Level Remote Sensing Image to Map Translation" Remote Sensing 13, no. 10: 1936.[pdf] [doi]
	Yuanyuan Liu, Jiyao Peng, Jing-Hao Xue, Yongquan Chen, Zhang-Hua Fu, "TSingNet: Scale-aware and Context-rich Feature Learning for Traffic Sign Detection and Recognition in the Wild",Neurocomputing, 2021, 447(4). [code(baiducloud password:code)] [code(github)]
	Yuanyuan Liu, Dingyuan Chen, Ailong Ma, Yanfei Zhong, Fang Fang, Kai Xu "A Multi-Scale U-Shaped CNN Building Instance Extraction Framework With Edge Constraint for High Spatial Resolution Remote Sensing Imagery", IEEE Transaction on Geosciences and Remote Sensing (TGRS), 2020, 10.1109/TGRS.2020.3022410.[pdf]
	Yuanyuan Liu, Xiaohui Yuan, Xi Gong, Zhong Xie, Fang Fang, Zhongwen Luo, "Conditional convolution neural network enhanced random forest for facial expression recognition", Pattern Recognition, Volume 84, 2018, Pages 251-261.[pdf][doi]
	Yuanyuan Liu, Xinmei Li, Mulan Zhang, Fang Fang, Zhizhong Zeng. "Visual Focus of Attention and Spontaneous Smile Recognition based on Continuous Head Pose Estimation by Cascaded Multi-task Learning", International Journal of Pattern Recognition and Artificial Intelligence, 2018, accepted.[pdf]
	Yuanyuan Liu, Jingying Chen, Mulan Zhang, Chuan Rao. "Student Engagement Study based on Multi-cue detection and recognition in an Intelligent Learning Environment", Multimedia tools and applications, 2018, 1-27.[pdf]
	Xi Gong, Zhong Xie, Yuanyuan Liu*, Zhuo ZHENG. "Deep Salient Feature based Transfer Convolutional Neural Network for Scene Classification of Remote Sensing Imagery", Remote Sensing 2018, 10(3), 410; [pdf]
	Zhuo Zheng, Fang Fang, Yuanyuan Liu*, Gong Xi, Guo Mingqiang, Luo Zhongwen. "Joint Multi-scale Convolution Neural Network for Scene Classification of High Resolution Remote Sensing Imagery". Acta Geodaetica et Cartographica Sinica, 2018, 47(5): 620-630. (in Chinese)[pdf]
	Yuanyuan Liu, Zhong Xie, Xiaohui Yuan, Jingying Chen, Wu Song. "Multi-level Structured Hybrid Forest for Joint Head Detection and Pose Estimation". Neurocomputing, 266(11), 206-215 2017.[pdf]
	Yuanyuan Liu, Zhong Xie, Shunping Zhou, Zheng Liu, Weiming Wang, Xiuping Liu, Wei Rao. "Conditional Iteration Updated Random Forests for Unconstrained Facial Feature Location", Journal of computer aided design and graphics, Vol.29, No.10, 1881-1890 , 2017. (in Chinese)[pdf]
	Yuanyuan Liu, Jingying Chen, Zhiming Su, et al., "Robust head pose estimation using Dirichlet-tree distribution enhanced random forests", Neurocomputing, 2016, 173: 42-53. [pdf]
	Yuanyuan Liu, Chen Jingying, Yu Kan, et al. "Head pose estimation based on tree-structure cascaded random forests in unconstrained environment", Journal of Electron and Information Technology, 2015, 37(3): 543-551. (in Chinese)[pdf]
	Kan Yu, Yuanyuan Liu, J Yin, et al. "A novel angle-tuned thin film filter with low angle sensitivity", Optics & Laser Technology, 2015, 68:141-145.[pdf]
	Yuanyuan Liu, Jingying Chen, Cunjie Shan, Zhiming Su, Pei Cai. "A Hierarchical Regression Approach for Unconstrained Face Analysis". International Journal of Pattern Recognition and Artificial Intelligence, 2015, Vol. 29, No. [pdf]
Conference Paper:
	Yuanyuan Liu, Yuxuan Huang, Shuyang Liu, Yibing Zhan, Zijing Chen, Zhe Chen. "Open-Set Video-based Facial Expression Recognition with Human Expression-sensitive Prompting", ACM International Conference on Multimedia (MM ’24). [pdf][code ] [supp]
	Yuanyuan Liu, Wenbin Wang, Yibing Zhan, Shaoze Feng, Kejun Liu, Zhe Chen. "Pose-disentangled Contrastive Learning for Self-supervised Facial Representation." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023. [pdf][code ]
	Yuanyuan Liu, Wei Dai, Chuanxu Feng, Wenbin Wang, Guanghao Yin, Jiabei Zeng, Shiguang Shan. "MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wild", ACM International Conference on Multimedia (MM ’22 Oral). [pdf][MAFW Database URL ][supp]
	Yuanyuan Liu, Ziyang Liu, Fang Fang, ZHanghua Fu, Zhanlong Chen, “Hierarchical Domain-Consistent Network for Cross-Domain Object Detection”, IEEE International Conference on Image Processing(ICIP),2021. [pdf]
	Yuanyuan Liu, Jiabei Zeng, Shiguang Shan, Zuo Zheng, "Multi-Channel Pose-Aware Convolution Neural Networks for Multi-View Facial Expression Recognition", proceeding of 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG), 2018: 458-464. [pdf]
	Yuanyuan Liu, Zhong Xie, Xi Gong, Fang Fang. "Deep Transfer Feature Based Convolutional Neural Forests for Head Pose Estimation", Pacific-Rim Symposium on Image and Video Technology (PRSIVT), Springer, Cham, 2017: 5-16. [pdf]
	Lu Wang, Fang Fang, Xiaohui Yuan, Yuanyuan Liu, Zhongwen Luo, "Urban function zoning using geotagged photos and open street map", IEEE Geoscience and Remote Sensing Symposium (IGRSS), 2017: 815-818. [pdf]
	Huiming Lv, Fang Fang, Yishi Zhao, Yuanyuan Liu, Zhongwen Luo,"A Performance Evaluation Model for Taxi Cruising Path Recommendation System",Pacific-Asia Conference on Knowledge Discovery and Data Mining (PACKDD) , 2017, 156-167.[pdf]
	Yuanyuan Liu, Zhong Xie, Jingying Chen. "An Intelligent Learning System for Supporting Interactive Learning through Student Engagement Study", 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), 2016: 498-503.[pdf]

Research Project (PI)

1. Jan.2021~Dec.2024, “Research on Video Emotion Detection and Recognition Method under Unconstrained Conditions”, Sponsored by National Science Foundation (No. 62076227), PI
2. Sep.2020~Dec.2023, “Key technologies and applications of video-based intelligent emotional computing”, Sponsored by Wuhan Basic Frontier Project of Science and Technology , PI
3. Sep.2019~Dec.2020, “Intelligent rapid recognition technology of typical targets based on few-shot learning”, Sponsored by Aviation Science and Industry Joint Fund Project, PI
4. Jan.2016~Dec.2019, “Research on spontaneous expression recognition based on deep enhanced random forests under multi-noises”, Sponsored by National Science Foundation (No. 61602429), PI
5. Jan.2016~Dec.2018, “Research on spontaneous facial expression recognition under multi pose and occlusion conditions”, Supported by China Postdoctoral Science Foundation. (No. 2016M592406), PI
6. Jan.2016~Jun.2018, “Research on human behavior recognition, tracking and prediction in infrared videos”, Development Projects, Sponsored by the Fundamental Research Funds for the Central Universities, China University of Geosciences (Wuhan) (No. 26420160055), PI

PROFESSIONAL ACTIVITIES:

Paper reviewer

Social work

Team Member

Feng Shaoze	Huang Yuxuan	Wei Lin	Liu Kejun	Liu Shuyang	Wang Ke
Liu Yunjiao	Yuan Yuchen	Qian Ying	Xu Lei	Zhou QiYin	Peng Jiyao（guaduated）
Dai Wei（guaduated）	Wang Yu（guaduated）	Liu Ziyang（guaduated）	Wang Kunpeng（guaduated）	Feng Chuanxu（guaduated）	Wang Wenbin（guaduated）
Zhang Haoyu（guaduated）	Wang Chaofan（guaduated）	Zhou Ning（guaduated）	Yin Guanghao（guaduated）	Li Kanglin（guaduated）	Zhao Yaowu（guaduated）

WEBSITE VISITING STATISTICS