Representative Publications

1. Automatic Image/Video Analysis:

  • B. Zhang, H. Luo, J. Fan, ``Statistical modeling for automatic image indexing and retrieval", Neurocomputing, vol. 207, pp. 105-119, 2016.
  • J. Fan, David K.Y. Yau, Ahmed K. Elmagarmid, Walid G. Aref, ``Automatic image segmentation by integrating color edge detection and seeded region growing", IEEE Trans. on Image Processing, vol.10, no.10, Oct., pp.1454-1466, 2001. Source Code
  • Z. Li, J. Fan, ``Stochastic Contour Approach for Automatic Image Segmentation", Journal of Electronic Imaging, vol.18, no.04, 2009.
  • Z. Li, H. Luo, J. Fan, ``Incorporating Camera Metadata for Attended Region Detection and Consumer Photo Classification", ACM Multimedia (MM'09), Beijing, 2009. A long version is also published on Multimedia Tools and Applications, 2010. journal version

    • 2. Large-Scale Image/Video Indexing and Access Control

  • J. Yu, B. Zhang, Z. Kuang, D. Lin, J. Fan, ``iPrivacy: Image privacy protection by identifying sensitive objects via deep multi-task learning", IEEE Transactions on Information Forensics and Security, vol. 13, no.2, 2017.
  • J. Fan , H. Luo, A.K. Elmagarmid, ``Concept-Oriented Indexing of Video Database towards More Effective Retrieval and Browsing", IEEE Trans. on Image Processing, vol.13, no.7, pp.974-992, 2004. Video
  • J. Fan , X. Zhu, A.K. Elmagarmid, W.G. Aref, L. Wu, ``ClassView: Hierarchical Video Shot Classification, Indexing, and Accessing", IEEE Trans. on Multimedia, vol.6, no.1, pp.70-86, 2004.
  • E. Bertino, J. Fan, E. Ferrari, M.-S. Hacid, A.K. Elmagarmid, Xingquan Zhu, ``A Hierarchical Access Control Model for Video Database Systems", ACM Trans. on Information Systems, vol.21, no.2, pp.155-191, 2003.

    • 3. Large-Scale Image/Video Cleansing and Exploration

  • N. Zhou, J. Fan, ``Automatic image-text alignment for large-scale web image indexing and retrieval", Pattern Recognition, vol.48, no.1, pp.205-219, 2015.
  • J. Peng, Y. Shen, J. Fan, ``Cross-modal social image clustering and tag cleansing", J. Visual Communication and Image Representation, vol. 24, no.7, pp.895-910, 2013.
  • C. Yang, J. Shen, J. Peng, J. Fan, ``Image collection summarization via dictionary learning for sparse representation", Pattern Recognition, vol. 46, no.3, pp.948-961, 2013. The short version was presented at IEEE CVPR 2012.
  • J. Fan, Y. Shen, C. Yang, N. Zhou, ``Harvesting Large-Scale Weakly-Tagged Image Databases from the Web", IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'10), 2010.
  • Y. Shen, J. Fan, ``Leveraging Loosely-Tagged Images and Inter-Object Correlations for Tag Recommendation", ACM Multimedia, 2010.
  • H. Luo, J. Fan, Y. Zhou, ``Multimedia news exploration and retrieval by integrating keywords, relations and visual features", Multimedia Tools and Applications, vol.51, pp.625–648, 2011.
  • J. Fan, H. Luo, Y. Shen, C. Yang, ``Integrating Visual and Semantic Contexts for Topic Network Generation and Word Sense Disambiguation", ACM Conf. on Image and Video Retrieval (CIVR'09), 2009.
  • Y. Gao, J. Peng, H. Luo, D. Keim, J. Fan, ``An Interactive Approach for Filtering out Junk Images from Keyword-Based Google Search Results", IEEE Trans. on Circuits and Systems for Video Technology, vol. 19, no.10, 2009. Some preliminary results are also presented at MMM'08. Online demo is available at Junk Images filtering demo 
  • J. Fan, D.A. Keim, Y. Gao, H. Luo, Z. Li, ``JustClick: Personalized Image Recommendation via Exploratory Search from Large-Scale Flickr Images", IEEE Trans. on Circuits and Systems for Video Technology, vol. 19, no.2, pp.273-288, 2009. Video
  • H. Luo, J. Fan, S. Satoh, J. Yang, W. Ribarsky, ``Integrating Multi-Modal Content Analysis and Hyperbolic Visualization for Large-Scale News Videos Retrieval and Exploration", Signal Processing: Image Communication, special issue on Semantic Analysis for Interactive Multimedia Services, vol.23, no.8, pp.538-553, 2008. Some preliminary results are also presented at IEEE VAST'07 and IEEE VAST'06. Video .

    4. Statistical Learning for Image/Video Classification

  • J. Fan, T. Zhao, Z. Kuang, Y. Zheng, J. Zhang, J. Yu, J. Peng, ``HD-MTL: Hierarchical Deep Multi-Task Learning for Large-Scale Visual Recognition", IEEE Trans. Image Processing, vol. 25, no.3, 2017.
  • Y. Zheng, J. Fan, J. Zhang, X. Gao, ``Hierarchical learning of multi-task sparse metrics for large-scale image classification", Pattern Recognition, vol. 67, pp.97-109, 2017.
  • J. Fan, J. Peng, L. Gao, N. Zhou, ``Hierarchical Learning of Discriminative Tree Classifiers for Large-Scale Plant Species Identification", IEEE Trans. Image Processing, vol.24, vol.11, pp. 4172-4184, 2015.
  • N. Zhou, J. Fan, ``Jointly Learning Visually Correlated Dictionaries for Large-Scale Visual Recognition Applications", IEEE Trans. Pattern Anal. Mach. Intell. , vol.36, no., pp.715-730, 2014. The short version was presented at IEEE CVPR 2012.
  • H. Lei, K. Mei, N. Zheng, P. Dong, N. Zhou, J. Fan ``Learning group-based dictionaries for discriminative image representation", Pattern Recognition, vol. 47, no.2, pp.899-913, 2014.
  • J. Fan, X. He, N. Zhou, J. Peng, R. Jain, ``Quantitative Characterization of Semantic Gaps for Learning Complexity Estimation and Inference Model Selection", IEEE Transactions on Multimedia, vol. 14, no.5, pp.1414-1428, 2012.
  • J. Fan, Y. Shen, C. Yang, N. Zhou, ``Structured Max-Margin Learning for Inter-Related Classifier Training and Multi-Label Image Annotation", IEEE Trans. on Image Processing, 2011.
  • J. Fan, Y. Gao, H. Luo, ``Integrating Concept Ontology and Multi-Task Learning to Achieve More Effective Classifier Training for Multi-Level Image Annotation", IEEE Trans. on Image Processing, vol. 17, no.3, pp.407-426, 2008.
  • J. Fan, Y. Gao, H. Luo, R. Jain, ``Mining Multi-Level Image Semantics via Hierarchical Classification", IEEE Trans. on Multimedia, special issue on Multimedia Data Mining, vol. 10, no.1, pp.167-187, 2008. Some preliminary results are also presented at MIR'06, Video
  • J. Fan, Y. Gao, H. Luo, ``Hierarchical classification for automatic image annotation", ACM SIGIR, Amsterdam, pp.111-118, 2007. Presentation Slides
  • B. Li, M. Chi, J. Fan, X. Xue, ``Support Cluster Machine", International Conference on Machine Learning (ICML'07), June 20-24, 2007, Oregon, USA.
  • J. Fan, H. Luo, Y. Gao, R. Jain, ``Incorporating Concept Ontology for Hierarchical Video Classification, Annotation and Visualization", IEEE Trans. on Multimedia, special issue on Semantic Image and Video Indexing in Broad Domains, vol. 9, no.5, pp. 939-957, 2007. Some preliminary results are also presented at ACM Multimedia'06.
  • Y. Gao, J. Fan, H. Luo, X. Xue, R. Jain, ``Automatic Image Annotation by Incorporating Feature Hierarchy and Boosting to Scale up SVM Classifiers", ACM Multimedia, Santa Barbara, CA, 2006. Presentation Slides , Video
  • J. Fan, Y. Gao, H. Luo, ``Multi-level annotation of natural scenes using dominant image components and semantic image concepts", ACM Multimedia, New York, Oct.10-15, 2004 ( Best Paper Runner-ups), Presentation Slides, Video. An extended journal version for this work: J. Fan , Y. Gao, H. Luo, G. Xu, ``Statistical modeling and conceptualization of natural images", Pattern Recognition, vol.38, no.6, pp.865-885, 2005.

    • If we know what we were doing, it wouldn't be research, would it? ---Albert Einstein(1879-1955)---