Guoying Zhao

Emotion AI

Prof. Guoying ZHAO

Guoying Zhao

PhD

Professor
Affective Computing

190 peer reviewed publications in international journals. The publications have been cited 8842 times, of which the most cited publication accounts for 1967 citations. The author has a h-index of 42.00. (http://scholar.google.fi/citations?user=hzywrFMAAAAJ)

Biography

Guoying Zhao is currently a Professor with the Center for Machine Vision and Signal Analysis, University of Oulu, Finland, where she has been a senior researcher since 2005 and an Associate Professor since 2014. In 2011, she was selected to the highly competitive Academy Research Fellow position. Her students and researchers are frequent recipients of very prestigious and competitive fellowships, such as the Nokia Scholarship, Infotech position, Tauno Tönning Research funding and Jorma Ollila grant.  Her research has been reported by Finnish TV programs, newspapers and MIT Technology Review.

Research interests

  • Image and video description
  • Affective computing
  • Machine learning
  • Emotional artificial intelligence

2017.12 - present, Full Professor (Tenured), Center for Machine Vision and Signal Analysis, University of Oulu

2014.01 – 2017.11, Associate Professor (Tenure track), University of Oulu

2011.09 - 2017.01, Academy research fellow of the Academy of Finland

Scientific merits

  • PI for Spearhead projects “Towards Reading Micro-Expressions in the Real World” (2018.09-2022.08), University of Oulu
  • PI for Academy ICT 2023 project: Separable Modality Learning (2018.01-2019.12)
  • PI for Tekes funded project: Quantifying Human Experience for Increased Intelligence Within Work Teams and in the Customer Interface (2018.01-2019.12).
  • PI for Academy Key Project: Cardiac beat to beat variability analysis from remote videos for health service (CAVA) (2016.10-2018.09).
  • PI for Tekes Fidipro Fellow project: Facial Behaviour Analysis "in-the-wild" (2016.01-2019.03).
  • PI for four-year Academy project funding (2014.09.01-2018.08.31) from Academy of Finland for researching “Computer Vision for Continuous Emotional State Analysis (CV4Emo)”
  • PI for Infrastructure funding “Test databases and computing devices for machine vision research” (2014.01-2015.06).
  • PI for five-year Academy fellow position funding (2011.09.01-2017.01.31) from Academy of Finland for researching Computer vision methods for analyzing human communicative behavior
  • PI for three-year postdoctoral position funding (2008.01.01-2011.05.31) from Academy of Finland for researching Video-based event analysis and person identification
  • Co- PI for three-year project funding (201601-201812) from Hongkong Research Grants Council for researching Face anti-spoofing to combat mask attacks: A remote photoplethysmography approach
  • Co-PI for “Big data-based health service system with the computer-aided screening for common retinal fundus related diseases” (201709-201912), Hunan provincial key research and development program
  • PI for Senior Research Fellow Start-up Package from University of Oulu for year 2011-2015
  • IEEE Senior Member
  • Finland’s most publishing researcher on AI in 2015-16 (Digibarometri 2017 report).
  • Nokia Foundation Visiting Professor Award, 2016
  • NVIDIA hardware grant, 2015
  • Honor of outstanding doctoral dissertation "Video-based Gait Recognition" of Institute of Computing Technology, Chinese Academy of Sciences, 2005
  • Honor of outstanding master thesis “The Generation Technology and Application of Stereoscopic Dynamic Images” of North China University of Technology, 2002.
  • Award of most outstanding organizer of graduate union activity of North China University of Technology, 2002.
  • PI for Academy project (2018.09-2022.08) “Micro-gesture analysis with machine learning for hidden emotion understanding (MiGA)"

Professional and community activities

  • Area Chairs: for International Conference on Automatic Face and Gesture Recognition 2017; IEEE Winter Conference on Applications of Computer Vision 2017.
  • Co-publicity chair of Conference on Automatic Face and Gesture Recognition (FG 2018).
  • Editorial Board Member: Pattern Recognition (JUFO 3, 2016.08-); IEEE Transactions on Circuits and Systems for Video Technology (JUFO 2, 2018.01-2019.12); Image and Vision Computing Journal (JUFO 2, 2015.09-); Journal of Electronic Imaging (JUFO 1, 2017).
  • Pre-examiner and opponent of doctoral dissertations: 10 PhD theses for students from China, Finland, Sweden, France, UK, Singapore and Malaysia.
  • Guest editor for may special issues with PAMI, Trans. on Affective Computing, CVIU, IVC, etc.
  • Co-chair of many international workshops in ICCV, CVPR, ECCV etc.
  • Board member of Scientific Board of Chinese Association of Science and Technology in Finland (CASTF)
  • Scientific Advisors: Finnish Business Angels Network FiBAN; Webuust Oy
  • Advisory panel: for international workshop on “Facial Micro-Expression Grand Challenge (MEGC): Methods and Datasets” with FG 2018, co-organized by Moi Hoon Yap, Sujing Wang, John See, Xiaopeng Hong, Stefanos Zafeiriou.
  • FG 2018 tutorial: Guoying Zhao and Matti Pietikäinen: Reading Hidden Emotions From Micro-Expression Analysis. Xi’an, China.
  • SCIA 2013 tutorial: Matti Pietikäinen and Guoying Zhao: Image and video analysis with local binary pattern variants, June 17, Helsinki, Finland.
  • ICCV 2009 tutorial: Matti Pietikäinen and Guoying Zhao, Local texture descriptors in computer vision, 27th, Sep. 2009, Kyoto, Japan.
  • 18th ICPR 2006 Tutorials: Matti Pietikäinen, Guoying Zhao & Abdenour Hadid (University of Oulu, Finland), Local Binary Pattern Approach to Computer Vision. Aug. 20-24, 2006, Hongkong
  • Keynote talk “Towards reading hidden emotions: micro-expression analysis and heart rate estimation” in SIG 27 Conference, Nov. 29, 2016
  • Keynote talk “Facial Expression and Micro-Expression Analysis: Progress and Challenges” in ACCV workshop on Computer Vision for Affective Computing (CV4AC), Nov. 1, 2014
  • Lecturer for 521285S Affective Computing (5 ECTS), University of Oulu, 2014 – present.
  • Lecturer for 521493S Computer Graphics (7 ECTS/4 CU), University of Oulu, 2010 - present.
  • Co-organizer of Finnish DENIS summer school on Affective Computing (2016).
  • Keynote talk in International symposium on frontier technologies and medical imaging analysis, June 28, 2018, Central South University.
  • Keynote talk in First Workshop on Large-scale Emotion Recognition and Analysis in conjunction with FG2018, May 19, 2018.
  • Keynote talk in Facial Micro-Expression Grand Challenge (MEGC): Methods and Datasets in conjunction with FG2018, May 15, 2018

Research groups

  • Professor and board member, Center for Machine Vision and Signal Analysis

Selected publications

  • Li, Xiaobai; Hong, Xiaopeng; Moilanen, Antti; Huang, Xiaohua; Pfister, Tomas; Zhao, Guoying; Pietikäinen, Matti (2018) Towards Reading Hidden Emotions : A Comparative Study of Spontaneous Micro-expression Spotting and Recognition Methods. - IEEE Transactions on Affective Computing Early, Early . [Original] [Self-archived]
  • Qi, Xianbiao; Zhao, Guoying; Li, Chun-Guang; Guo, Jun; Pietikäinen, Matti (2017) HEp-2 Cell Classification via Combining Multiresolution Co-Occurrence Texture and Large Region Shape Information. - IEEE Journal of Biomedical and Health Informatics 21 (2), 429-440 . [Original]
  • Liu, Xin; Yao, Jiawen; Hong, Xiaopeng; Huang, Xiaohua; Zhou, Ziheng; Qi, Chun; Zhao, Guoying (2018) Background Subtraction using Spatio-Temporal Group Sparsity Recovery. - IEEE Transactions on Circuits ansd Systems for Video Technology pp (99), 1-1 . [Original]
  • Huang, Xiaohua; Wang, Su-jing; Liu, Xin; Zhao, Guoying; Feng, Xiaoyi; Pietikäinen, Matti (2018) Discriminative spatiotemporal local binary pattern with revisited integral projection for spontaneous facial micro-expression recognition. - IEEE Transactions on Affective Computing early access, early access . [Original]
  • Liu, Qing; Hong, Xiaopeng; Zou, Beiji; Chen, Jie; Chen, Zailiang; Zhao, Guoying (2017) Hierarchical Contour Closure-Based Holistic Salient Object Detection. - IEEE transactions on image processing 26 (9), 4537-4552 . [Original]
  • Chen, Jie; Patel, Vishal M.; Liu, Li; Kellokumpu, Vili; Zhao, Guoying; Pietikäinen, Matti; Chellappa, Rama (2017) Robust local features for remote face recognition. - Image and Vision Computing 64, 34-46 . [Original]
  • Ke, Wei; Chen, Jia; Jiao, Jianbin; Zhao, Guoying; Ye, Qixiang (2017) SRN: Side-output Residual Network for Object Symmetry Detection in the Wild. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, Hawaii 21-26 July 2017. Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 302-310. [Original]
  • Zong, Yuan; Huang, Xiaohua; Zheng, Wenming; Cui, Zhen; Zhao, Guoying (2017) Learning a target sample re-generator for cross/database micro/expression recognition. (Artikkeli tieteellisessä konferenssijulkaisussa). - MM '17 Proceedings of the 2017 ACM on Multimedia Conference : Mountain View, California, USA - October 23 - 27, 2017. Ei sarjaa/No series. 872-890. [Original] [Self-archived]
  • Tran, Thuong-Khanh; Hong, Xiaopeng; Zhao, Guoying (2017) Sliding window based micro-expression spotting : a benchmark. (Artikkeli tieteellisessä konferenssijulkaisussa). - Advanced concepts for intelligent vision systems : 18th International Conference, ACIVS 2017, Antwerp, Belgium, September 18-21, 2017, Proceedings. Blanc-Talon, Jacques; Penne, Rudi; Philips, Wilfried; Popescu, Dan; Scheunders, Paul. Lecture Notes in Computer Science 10617. Cham. 542-553. [Original] [Self-archived]
  • Guo, Yimo; Zhao, Guoying; Pietikäinen, Matti (2016) Dynamic Facial Expression Recognition With Atlas Construction and Sparse Representation. - IEEE transactions on image processing 25 (5), 1977-1992 . [Original]
  • Qi, Xianbiao; Zhao, Guoying; Chen, Jie; Pietikäinen, Matti (2016) Exploring illumination robust descriptors for human epithelial type 2 cell classification. - Pattern Recognition 60 (December), 420-429 . [Original]
  • Hong, Xiaopeng; Zhao, Guoying; Zafeiriou, Stefanos; Pantic, Maja; Pietikäinen, Matti (2016) Capturing correlations of local features for image representation. - Neurocomputing 184 (SI), 99-106 . [Original]
  • Qi, Xianbiao; Zhao, Guoying; Chen, Jie; Pietikäinen, Matti (2016) HEp-2 cell classification: The role of Gaussian Scale Space Theory as a pre-processing approach. - Pattern Recognition Letters 82, 1, 36-43 . [Original]
  • Huang, Xiaohua; Zhao, Guoying; Hong, Xiaopeng; Zheng, Wenming; Pietikäinen, Matti (2016) Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns. - Neurocomputing 175, 564-578 . [Original]
  • Qi, Xianbio; Zhao, Guoying; Shen, L; Li, Q.; Pietikäinen, Matti (2016) LOAD: Local orientation adaptive descriptor for texture and material classification. - Neurocomputing 184, 28-35 . [Original]
  • Huang, Xiaohua; Kortelainen, Jukka; Zhao, Guoying; Li, Xiaobai; Moilanen, Antti; Seppänen, Tapio; Pietikäinen, Matti (2016) Multi-modal emotion analysis from facial expressions and electroencephalogram. - Computer vision and image understanding 147, 114-124 . [Original]
  • Qi, Xianbio; Li, Chun-Huang; Zhao, Guoying; Hong, Xiaopeng; Pietikäinen, Matti (2016) Dynamic texture and scene classification by transferring deep image features. - Neurocomputing 171, 1230-1241 . [Original]
  • Liu, Qing; Zou, Beiji; Chen, Jie; Ke, Wei; Yue, Kejun; Chen, Zailiang; Zhao, Guoying (2017) A location-to-segmentation strategy for automatic exudate segmentation in colour retinal fundus images. - Computerized medical imaging and graphics : the international journal on imaging and image-computing in all medical specialties 55, 78-86 . [Original]
  • Wang, Hanjie; Chai, Xiujuan; Hong, Xiaopeng; Zhao, Guoying; Chen, Xilin (2016) Isolated Sign Language Recognition with Grassmann Covariance Matrices. - Acm transactions on accessible computing 8 (4), 14 . [Original]
  • Liu, Yong-Jin; Zhang, Jin-Kai; Yan, Wen-Jing; Wang, Su-Jing; Zhao, Guoying; Fu, Xiaolan (2016) A main directional mean optical flow feature for spontaneous micro-expression recognition. - IEEE Transactions on Affective Computing 7 (4), 299-310 . [Original]
  • Xia, Zhaoqiang; Feng, Xiaoyi; Peng, Jinye; Peng, Xianlin; Zhao, Guoying (2016) Spontaneous micro-expression spotting via geometric deformation modeling. - Computer vision and image understanding 147, 87-94 . [Original]
  • Wang, S.­J.; Yan, W.­J.; Sun, T.; Zhao, G.; Fu, X. (2016) Sparse tensor canonical correlation analysis for micro-expression recognition. - Neurocomputing 214 (-), 218-232 . [Original]
  • Chen, Jie; Lei, Zhen; Liu, Li; Zhao, Guoying; Pietikäinen, Matti (2016) RoLoD: Robust local descriptors for computer vision. - Neurocomputing 184, 1-2 . [Original]
  • Zafeiriou, Stefanos; Zhao, Guoying; Pietikäinen, Matti; Chellappa, Rama; Kotsia, Irene; Cohn, Jeffrey (2016) Editorial of special issue on spontaneous facial behaviour analysis. - Computer vision and image understanding 147, 50-51 . [Original]
  • Liu, Siqi; Yuen, Pong C.; Zhang, Shengping; Zhao, Guoying (2016) 3D Mask Face Anti-spoofing with Remote Photoplethysmography. (Artikkeli tieteellisessä konferenssijulkaisussa). - Computer Vision – ECCV 2016 : 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII. Leibe, B.; Matas, J.; Sebe, N.; Welling, M. Lecture Notes in Computer Science 9911. 85-100. [Original]
  • Wang, Su-Jing; Yan, Wen-Jing; Li, Xiaobai; Zhao, Guoying; Zhou, Chun-Guang; Fu, Xiaolan; Yang, Minghao; Tao, Jianhua (2015) Micro-Expression Recognition Using Color Spaces. - IEEE transactions on image processing 24 (12), 6034-6047 . [Original]
  • Qi, Xianbio; Shen, Linlin; Zhao, Guoying; Li, Qingquan; Pietikäinen, Matti (2015) Globally rotation invariant multi-scale co-occurrence local binary pattern. - Image and Vision Computing 43, 16-26 . [Original]
  • Huang, Xiaohua; Dhall, Abhinav; Zhao, Guoying; Goecke, Roland; Pietikäinen, Matti (2015) Riesz-based volume local binary pattern and a novel group expression model for group happiness intensity analysis. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the British Machine Vision Conference 2015 (BMVC). 7-10 September, Swansea UK. Xianghua Xie, Mark W. Jones, Gary K.L. Tam. Ei sarjaa/No series, BMVA Press. 34.1-34.13. [Original]
  • Zhou, Ziheng; Hong, Xiaopeng; Zhao, Guoying; Pietikäinen, Matti (2014) A compact representation of visual speech data using latent variables. - IEEE transactions on pattern analysis and machine intelligence 36 (1), 181-187
  • Hong, Xiaopeng; Zhao, Guoying; Pietikäinen, Matti; Chen, Xilin (2014) Combining LBP difference and feature correlation for texture description. - IEEE transactions on image processing 23 (6), 2557-2568
  • Yan, Wen-Jing; Li, Xiaobai; Wang, Su-Jing; Zhao, Guoying; Liu, Yong-Jin; Chen, Yu-Hsin; Fu, Xiaolan (2014) CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation. - PLoS One 9 (1), e86041 . [Original]
  • Liu, Li; Long, Yunli; Fieguth, Paul W.; Lao, Songyang; Zhao, Guoying (2014) BRINT: Binary Rotation Invariant and Noise Tolerant Texture Classification. - IEEE transactions on image processing 23 (7), 3071-3084
  • Lizarraga-Morales, Rocio A.; Guo, Yimo; Zhao, Guoying; Pietikäinen, Matti; Sanchez-Yanez, Raul E. (2014) Local spatiotemporal features for dynamic texture synthesis. - Eurasip journal on image and video processing 2014, 17 . [Original]
  • Li, Xiobai; Chen, Jie; Zhao, Guoying; Pietikäinen, Matti (2014) Remote heart rate measurement from face videos under realistic situations. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Ei sarjaa/No series. IEEE. 4265-4271
  • Goncalves, Jorge; Pandab, Pratyush; Ferreira, Denzil; Ghahramani, Mohammad; Zhao, Guoying; Kostakos, Vassilis (2014) Projective testing of diurnal collective emotion. (Artikkeli tieteellisessä konferenssijulkaisussa). - UbiComp '14 Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. Ei sarjaa/No series. New York, ACM. 487-497
  • Qiuhai, He; Xiaopeng, Hong; Guoying, Zhao; Xinyuan, Huang (2014) An immersive fire training system using kinect. (Artikkeli tieteellisessä konferenssijulkaisussa). - UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. Ei sarjaa/No series. 231-234
  • Chen, Jie; Zhao, Guoying; Salo, Mikko; Rahtu, Esa; Pietikäinen, Matti (2013) Automatic dynamic texture segmentation using local descriptors and optical flow. - IEEE transactions on image processing 22 (1), 326-339, 1
  • Guo, Yimo; Zhao, Guoying; Zhou, Ziheng; Pietikäinen, Matti (2013) Video texture synthesis with multi-frame LBP-TOP and diffeomorphic growth model. - IEEE transactions on image processing 22 (10), 3879-3891
  • Pietikäinen, Matti; Turk, Matthew; Wang, Liang; Zhao, Guoying; Cheng, Li (2013) Special section on machine learning in motion analysis: new advances. - Image and Vision Computing 31 (6-7), 419-420
  • Zhao, Guoying; Pietikäinen, Matti (2013) Visual speaker identification with spatiotemporal directional features. (Artikkeli tieteellisessä konferenssijulkaisussa). - Image Analysis and Recognition: 10th International Conference, ICIAR 2013, Póvoa do Varzim, Portugal, June 26-28, 2013. Proceedings. Kamel, Mohamed; Campilho, Aurelio. Lecture Notes in Computer Science 7950, Springer. 1-10
  • Huang, Xiaohua; Zhao, Guoying; Pietikäinen,Matti (2013) Emotion recognition from facial images with arbitrary views.. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings British Machine Vision Conference 2013. Burghardt, Tilo; Mayol-Cuevas, Walterio; Mirmehdi, Majid, BMWA Press. 1-11
  • Chen, Jie; Kellokumpu, Vili; Zhao, Guoying; Pieitkäinen, Matti (2013) RLBP: Robust Local Binary Pattern. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings British Machine Vision Conference 2013. Burghardt, Tilo; Mayol-Cuevas, Walterio; Mirmehdi, Majid. Ei sarjaa/No series, BMWA Press. 1-10
  • Zhai, Yan; Zhao, Guoying; Alatalo, Toni; Heikkilä, Janne; Ojala, Timo; Huang, Xinyuan (2013) Gesture Interaction for wall-sized touchscreen display. (Artikkeli tieteellisessä konferenssijulkaisussa). - UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. ACM. New York. 175-178
  • Bayramoglu, Neslihan; Zhao, Guoying; Pietikäinen, Matti (2013) CS-3DLBP and geometry based person independent 3D facial action unit detection. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2013 International Conference on Biometrics (ICB). Fierrez, Julian; Kumar, Ajay; Vatsa, Mayank; Veldhuis, Raymond; Ortega-Garcia,Javier. Los Alamitos, California, IEEE. 1-6
  • Zhao, GY; Ahonen, T; Matas, J; Pietikainen, M. (2012) Rotation Invariant Image and Video Description with Local Binary Pattern Features. - IEEE transactions on image processing 21 (4), 1465-1477
  • Zhao G; Li X; Pietikäinen M; Huang X; Pfister T (2012) Computer vision research for expression and micro-expression recognition. - International Journal of Psychology 47 (Supplement 1), 145-145
  • Guo Y; Zhao G; Pietikäinen M (2012) Discriminative features for texture description. - Pattern Recognition 45, 3834-3843 . [Original]
  • Zhou Z; Zhao G; Guo Y; Pietikäinen M (2012) An image-based visual speech animation system. - IEEE Transactions on Circuits ansd Systems for Video Technology 22 (10), 1420-1432
  • Huang X; Zhao G; Pietikäinen M; Zheng W (2012) Spatiotemporal local monogenic binary patterns for facial expression recognition. - IEEE signal processing letters 19 (5), 243-246 . [Original]
  • Xiaohua Huang; Guoying Zhao; Wenming Zheng; Matti Pietikainen (2012) Towards a dynamic expression recognition system under facial occlusion. - Pattern Recognition Letters 16 (33), 2181-2191
  • Guo Yimo; Zhao Guoying; Pietikäinen Matti (2012) Dynamic facial expression recognition using longitudinal facial expression atlases. (Artikkeli tieteellisessä konferenssijulkaisussa). - Computer Vision – ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7-13, 2012, Proceedings, Part II. Andrew Fitzgibbon; Svetlana Lazebnik; Pietro Perona; Yoichi Sato; Cordelia Schmid. Lecture Notes in Computer Science 7573. 631-644. [Original]
  • Hong Xiaopeng; Zhao Guoying; Pietikäinen Matti; Chen Xilin (2012) Combining local and global correlation for texture description. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012). November 11-15, 2012. Tsukuba, Japan. Hideo Saito; Yoshimitsu Aoki. 2756-2759
  • Jie Chen; Guoying Zhao; Matti Pietikäinen (2012) Unsupervised Dynamic Texture Segmentation Using Local Descriptors in Volumes. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the 21st International Conference on Pattern Recognition (ICPR 2012). November 11-15, 2012. Tsukuba, Japan. Hideo Saito; Yoshimitsu Aoki. 3622-3625
  • Guoying Zhao, Xiaohua Huang, Matti Taini, Stan Z. Li & Matti Pietikäinen (2011) Facial expression recognition from near-infrared videos. - Image and Vision Computing 29 (9), 607-619
  • Kellokumpu, Vili-Petteri; Zhao, Guoying; Pietikäinen Matti (2011) Recognition of human actions using texture descriptors. - Machine Vision and Applications 22 (5), 767-780 . [Original]
  • Zhou Z, Zhao G & Pietikäinen M (2011) Towards a practical lipreading system. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2011). IEEE. 137-144. [Original]
  • Pfister T, Li X, Zhao G & Pietikäinen M (2011) Recognising spontaneous facial micro-expressions. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2011 IEEE International Conference on Computer Vision (ICCV). IEEE. 1449-1456
  • Guo Y, Zhao G & Pietikäinen M (2011) Texture classification using a linear configuration model based descriptor. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the British Machine Vision Conference 2011. Jesse Hoey, Stephen McKenna and Emanuele Trucco. 1-10, 119. [Original]
  • Chen J, Shan S, He C, Zhao G, Pietikäinen M, Chen X & Gao W (2010) WLD: A robust local image descriptor. - IEEE transactions on pattern analysis and machine intelligence 32 (9), 1705-1720 . [Original]
  • Zhao G, Huang X, Gizatdinova Y & Pietikäinen M (2010) Combining dynamic texture and structural features for speaker identification. (Artikkeli tieteellisessä konferenssijulkaisussa). - ACM Multimedia 2010 Workshop on Multimedia in Forensics, Security and Intelligence. ACM. 93-98. [Original]
  • Zhou Z, Zhao G & Pietikäinen M (2010) Synthesizing a talking mouth. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing. ICVGIP, ACM. 216-223. [Original]
  • Yimo Guo, Guoying Zhao, Matti Pietikäinen, Zhengguang Xu (2011) Descriptor Learning Based on Fisher Separation Criterion for Texture Classification. (Artikkeli tieteellisessä konferenssijulkaisussa). - Computer Vision – ACCV 2010 : 10th Asian Conference on Computer Vision, Queenstown, New Zealand, November 8-12, 2010, Revised Selected Papers, Part III. Ron Kimmel; Reinhard Klette; Akihiro Sugimoto. Lecture Notes in Computer Science 6494. Berlin, Springer. 185-198. [Original]
  • Huang X, Zhao G, Pietikäinen M & Zheng W (2010) Dynamic facial expression recognition using boosted component-based spatiotemporal features and multi-classifier fusion. Advanced Concepts for Intelligent Vision Systems. Blanc-Talon J, Bonde D, Philips W & Scheunders P. - Lecture Notes in Computer Science 6475, Springer. 312-322. [Original]
  • Liao S, Zhao G, Kellokumpu V, Pietikäinen M & Li SZ (2010) Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. IEEE Conference on Computer Vision and Pattern Recognition. IEEE. 1301-1306. [Original]
  • Zhou Z, Zhao G & Pietikäinen M (2010) Lipreading: A graph embedding approach. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. 20th International Conference on Pattern Recognition. IEEE. 523-526. [Original]
  • Zhao Guoying, Barnard Mark, Pietikäinen Matti (2009) Lipreading with local spatiotemporal descriptors. - IEEE Transactions on Multimedia 11 (7), 1254-1265 . [Original]
  • Zhao Guoying, Pietikäinen Matti (2009) Boosted multi-resolution spatiotemporal descriptors for facial expression recognition. - Pattern Recognition Letters 30 (12), 1117-1127 . [Original]
  • Zhou, Ziheng; Zhao, Guoying; Hong, Xiaopeng; Pietikäinen, Matti (2014) A review of recent advances in visual speech decoding. - Image and Vision Computing 32 (9), 590-605
  • Chen Jie, Zhao Guoying & Pietikäinen Matti (2009) An improved local descriptor and threshold learning for unsupervised dynamic texture segmentation. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. 2nd IEEE International Workshop on Machine Learning for Vision-based Motion Analysis (MLVMA09), Kyoto, Japan. Matti Pietikäinen, Liang Wang, Li Cheng, Guoying Zhao. IEEE Proceedings Library of Congress: 2009903045. Kioto. 460-467
  • Guo Y, Zhao G, Chen J, Pietikäinen M & Xu Z (2009) Dynamic texture synthesis using a spatial temporal descriptor. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. IEEE International Conference on Image Processing (ICIP 2009), Cairo, Egypt. Ahmed Tewfik, Yassin Hasan (eds.). 2277-2280
  • Kellokumpu Vili-Petteri, Zhao Guoying, Pietikäinen Matti (2009) Dynamic texture based gait recognition.. (Artikkeli tieteellisessä konferenssijulkaisussa). - Advances in Biometrics, ICB 2009 Proceedings, Lecture Notes in Computer Science 5558. Tistarelli Massimo, Nixon Mark S, Springer Berlin / Heidelberg. 1000-1009. [Original]
  • Chen Jie, Yi Dong, Yang Jimei, Zhao Guoying, Li Stan Z & Pietikäinen Matti (2009) Learning mappings for face synthesis from near-infrared to visual light images. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009). IEEE Computer Society. IEEE Proceedings. Miami, IEEE. 156-163. [Original]
  • Kellokumpu, Vili; Zhao, Guoying & Pietikäinen, Matti (2008) Human activity recognition using a dynamic texture based method. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proc. The British Machine Vision Conference (BMVC 2008), Leeds, UK. Eds. N. R. AlpeshKumar & J. A. Helder. Portugali, INTICC. 1-10
  • Zhao, Guoying & Pietikäinen, Matti (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. - IEEE transactions on pattern analysis and machine intelligence 29 (6), 915-928
  • Zhao, Guoying; Cui, L. & Li, H. (2007) Gait recognition using fractal scale. - Pattern analysis & applications 10, 235-246
  • Zhao, Guoying; Cui, L.; Li, H. & Pietikäinen, Matti (2006) Gait recognition using fractal scale and wavelet moments. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the 18th international conference on pattern recognition, 20-24 August 2006, Hong Kong. 1-4
  • Zhao, Guoying & Pietikäinen, Matti (2006) Local binary pattern descriptions for dynamic texture recognition. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the 18th international conference on pattern recognition, 20-24 August 2006, Hong Kong, IEEE. 1-4
  • Zhao, Guoying; Li, C. & Li, H. (2005) Combining wavelet velocity moments and reflective symmetry for gait recognition. (Artikkeli tieteellisessä konferenssijulkaisussa). - Advances in biometric person authentication, international workshop on biometric recognition systems, IWBRS 2005, Beijing, China, October 2005. Proceedings. Eds. S. Z. Li et al. Lecture Notes in Computer Science 3781. Berlin, Springer. 205-212
  • Dimitrios, Kollias; Nicolaou, Mihalis A.; Kotsia, Irene; Zhao, Guoying; Zafeiriou, Stefanos (2017) Recognition of affect in the wild using deep neural networks. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Honolulu, Hawaii 21-26 July 2017. IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops. 1972-1979. [Original]
  • Zafeiriou, Stefanos; Kollias, Dimitrios; Nicolaou, Mihalis A.; Papaioannou, Athanasios; Zhao, Guoying; Kotsia, Irene (2017) Aff-Wild : Valence and Arousal ‘in-the-wild’ Challenge. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops : CVPRW 2017. O’Conner, Lisa. IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops E6270. 1980-1987. [Original]
  • Devangini, Patel; Xiaopeng, Hong; Guoying, Zhao (2016) Selective deep features for micro-expression recognition. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2016 Proceedings of 23rd Internaltional conference on Pattern Recognition (ICPR 2016). Ei sarjaa/No series. 2258-2263. [Original]
  • Li, Xiaobai; Komulainen, Jukka; Zhao, Guoying; Yuen, Pong-chi; Pietikäinen, Matti (2017) Generalized face anti-spoofing by detection pulse from face videos. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2016 Proceedings of 23rd International conference on Pattern Recognition (ICPR 2016). Ei sarjaa/No series. 4244-4249. [Original]
  • Zhou, Jing; Hong, Xiaopeng; Su, Fei; Zhao, Guoying (2016) Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1535-1543. [Original]
  • Zafeiriou, Stefanos; Papaioannou, Athanasios; Kotsia, Irene; Nicolaou, Mihalis; Zhao, Guoying. (2016) Facial Affect "in-the-wild": A survey and a new database. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops. 1487-1498. [Original]
  • Liu, Siqi; Yang, Baoyao; Yuen, Pong C.; Zhao, Guoying. (2016) A 3D Mask Face Anti-spoofing Database with Real World Variations. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops. 1551-1557. [Original]
  • Chen, Jie; Qi, Xianbiao; Tervonen, Osmo; Silven, Olli; Zhao, Guoying; Pietikäinen, Matti (2016) Thorax Disease Diagnosis Using Deep Convolutional Neural Network. (Artikkeli tieteellisessä konferenssijulkaisussa). - 2016 IEEE 38th Annual International Conference of the Engineering in Medicine and Biology Society (EMBC). Conference proceedings : IEEE Engineering in Medicine and Biology Annual Conference. 2287-2290. [Original]
  • Hong, Xiaopeng; Xu, Yingyue; Zhao, Guoying (2017) LBP-TOP: a Tensor Unfolding Revisit. (Artikkeli tieteellisessä konferenssijulkaisussa). - Computer Vision – ACCV 2016 Workshops : ACCV 2016 International Workshops, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part I. Chen, Chu-Song; Lu, Jiwen; Ma, Kai-Kuang. Lecture Notes in Computer Science 10116. Cham, Switzerland. 513-527. [Original]
  • Kellokumpu, Vili; Särkiniemi, Markus; Zhao, Guoying (2017) Affective Gait Recognition and Baseline Evaluation from Real World Samples. (Artikkeli tieteellisessä konferenssijulkaisussa). - Computer Vision – ACCV 2016 Workshops : ACCV 2016 International Workshops, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part I. Chen, Chu-Song;Lu, Jiwen; Ma, Kai-Kuang. Lecture Notes in Computer Science 10116. Cham, Switzerland. 567-575. [Original]
  • Saitoh, Takeshi; Zhou, Ziheng; Zhao, Guoying; Pietikainen, Matti (2017) Concatenated Frame Image based CNN for Visual Speech Recognition. (Artikkeli tieteellisessä konferenssijulkaisussa). - Computer Vision – ACCV 2016 Workshops : ACCV 2016 International Workshops, Taipei, Taiwan, November 20-24, 2016, Revised Selected Papers, Part II. Chen, Chu-Song; Lu, Jiwen; Ma, Kai-Kuang. Lecture Notes in Computer Science 10117. Cham, Switzerland. 277-289. [Original]
  • Liu, Qing; Zou, Beiji; Chen, Jie; Chen, Zailiang; Zhu, Chengzhang; Yue, Kejuan; Zhao, Guoying (2016) Retinal vessel segmentation from simple to difficult. (Artikkeli tieteellisessä konferenssijulkaisussa). - Proceedings of the Ophthalmic Medical Image Analysis Third International Workshop (OMIA 2016) Held in Conjunction with MICCAI 2016. Xinjian Chen; Mona K. Garvin; Jiang Liu; Emanuele Trucco; Yanwu Xu. Iowa research online, University of Iowa. 57-64. [Original]

Thesis supervisions

Yimo Guo (Doctoral Dissertation): Image and video analysis by local descriptors and deformable image registration. Jun. 2013
  • In the first part of this work, two image description methods are presented to provide discriminative representations for image classification. In the second part, based on static image description and deformable image registration, video analysis is studied for the applications of dynamic texture description, synthesis and recognition.

Xiaohua Huang (Doctoral Dissertation): Methods for facial expression recognition with applications in challenging situations. Dec. 2014
  • In recent years, facial expression recognition has become a useful scheme for computers
    to affectively understand the emotional state of human beings. This thesis contributes to the research
    and development of facial expression recognition systems from the above two aspects.

Xiaobai Li (Doctoral Dissertation): Reading subtle information from human faces. Sep. 2017
  • Face plays an important role in our social interactions as it conveys rich sources of
    information. The thesis concerns using computer vision methodologies to
    analyse two kinds of subtle facial information that can hardly be perceived by naked eyes: the
    micro-expression, and the heart rate.

Haoyu Chen: Master thesis (2016-2017): A Preliminary Study of Micro-Gesture: Dataset Collection and Analysis with Multi-Modal Dynamic Networks
  • A preliminary exploration of Micro-Gesture is made in this thesis. By collecting recorded sequences of body gestures in a spontaneous state during games, a micro-gesture dataset is built through Kinect V2. Implementations of two sets of neural network architectures are achieved for micro-gestures segmentation and recognition task.

Niloufar Zebarjadi: Master thesis (2015-2016): Static and Dynamic Approaches for Pain Detection and Pain Intensity Estimating Using Facial Expressions
  • In this thesis, a new dataset of facial expressions of patients with lower back pains is collected and annotated. Both static features: well-known LBP, and Dense SIFT, and dynamic features: LBP-TOP and 3D-SIFT, are extracted. Experiments of pain detection and pain intensity estimation are carried out and the results are compared and analyzed.

Yingyue Xu: Master thesis (2014-2015): A Task-driven Eye Tracking Dataset For Visual Attention Analysis
  • In this thesis, we design and establish a new task-driven eye tracking dataset of 47 subjects. Moreover, we provide baseline results by evaluating popular saliency models. Furthermore, we hold discussions about the influence of tasks and image semantics on human visual behavior and provide suggestions for the scanpath estimation research in future.

Jiawei Zhang: Master thesis (2016-2018): An Expandable System for Collection, Detection and Recognition of Human Body Gesture
  • We setup a data collecting system with Kinect camera to append five more gesture categories with complementary samples in the same format to ChaLearn Looking at People dataset. A deep learning approach is developped to detect and classify the samples with Deep Belief Network (DBN) and the Viterbi algorithm with only the skeleton data as input.

Research visits

  • Visit to Prof. Jeffrey Cohn’s group in University of Pittsburgh and Carnegie Mellon University (CMU), USA
    11.6.2016 to 25.6.2016

  • Visit to Prof. Dimitris N. Metaxas’ group in Rutgers, The State University of New Jersey, USA,
    3.3.2016 to 9.8.2016

  • Visit to Prof. Maja Pantic’s IBUG group in Imperial College of London, UK
    12.7.2013 to 28.9.2013

  • Visit to Prof. Mark Nixon’s ISIS group in Southampton University, UK
    11.7.2011 to 22.7.2011

  • Visit to Prof. Stan Z. Li’s group in Institute of Automation, Chinese Academy of Sciences
    6.4.2009 to 19.4.2009

Projects

Towards Reading Micro-expressions in the Real World

Strategic research project of the University of OuluFocus institute: Infotech Oulu