A Unified Optimization Based Learning Method for Image Retrieval * (2009)
Hanghang Tong, Jingrui He, Mingjing Li, Wei-ying Ma, Changshui Zhang, Hong-jiang Zhang
In this paper, an optimization based learning method is proposed for image retrieval from graph model point of view. Firstly, image retrieval is formulated as a regularized optimization problem,...
EFFICIENT VIDEO MOSAICING BASED ON MOTION ANALYSIS (2008)
Tao Mei, Xian-sheng Hua, He-qin Zhou, Shipeng Li, Hong-jiang Zhang
Presenting more comprehensive information than key frame and any subset of frames, mosaic has attracted a growing attention in recent years as a useful element for a variety of vision tasks. In this...
Multi-level anchorperson detection using multimodal association (2008)
Dong-jun Lan, Yu-fei Ma, Hong-jiang Zhang
In contemporary TV news programs, multi-level anchorpersons are often used which indicate the inherent hierarchical structure of news program. However, these diverse anchorperson patterns make the...
Universal Background Models for Real-Time Speaker Change Detection (2008)
Ting-yao Wu, Hong-jiang Zhang, P. R. China
This paper addresses the problem of real-time speaker change detection in TV news broadcast, in which no prior knowledge on speakers is assumed. To enhance the effect of the reliable frames in a...
FEATURE SELECTION ON COMBINATIONS FOR EFFICIENT LEARNING FROM IMAGES (2008)
Rong Xiao, Lei Zhang, Hong-jiang Zhang
Due to the high computation complexity and intra-class variance in the area of image pattern recognition, feature extraction for image pattern recognition has been the focus of interest for quite...
Generalized Manifold-Ranking-Based Image Retrieval (2008)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
Abstract—In this paper, we propose a general transductive learning framework named generalized manifold-ranking-based image retrieval (gMRBIR) for image retrieval. Comparing with an existing...
Human Gait Recognition With Matrix Representation (2008)
Dong Xu, Shuicheng Yan, Dacheng Tao, Lei Zhang, Xuelong Li, ...
the IEEE does not in any way imply IEEE endorsement of any of Birkbeck’s products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this...
Dong Xu, Shuicheng Yan, Dacheng Tao, Stephen Lin, Hong-jiang Zhang
Abstract—Dimensionality reduction algorithms, which aim to select a small set of efficient and discriminant features, have attracted great attention for human gait recognition and content-based...
c ○ World Scientific Publishing Company RECENT ADVANCES IN CONTENT-BASED VIDEO ANALYSIS (2008)
Chong-wah Ngo, Ting-chuen Pong, Hong-jiang Zhang
In this paper, we present major issues in video parsing, abstraction, retrieval and semantic analysis. We discuss the success, the difficulties and the expectations in these areas. In addition, we...
Chong-wah Ngo, Ting-chuen Pong, Hong-jiang Zhang, C. W. Ngo
In this paper, we present a new framework to automatically group similar shots into one scene, where a scene is generally referred to as a group of shots taken place in the same site. Two major...
Photo time-stamp detection and recognition (2008)
Xiangrong Chen, Hong-jiang Zhang
This paper addresses the problem of photo time-stamp detection and recognition, which is to determine the time a photo was taken. Since the time-stamp is exposed together with the scene, the main...
SYMMETRY FEATURE IN CONTENT-BASED IMAGE RETRIEVAL * (2008)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Changshui Zhang
In this paper, we first apply the theory of wallpaper groups to natural images and extract a novel feature to depict the symmetry property of natural images. The original proposed algorithm takes...
An Online Learning Framework for Sports Video View Classification (2008)
Jun Wu, Xian-sheng Hua, Jian-min Li, Bo Zhang, Hong-jiang Zhang
Abstract. Sports videos have special characteristics such as well-defined video structure, specialized sports syntax, and some canonical view types. In this paper, we proposed an online learning...
Manifold-Ranking Based Keyword Propagation for Image Retrieval * (2008)
Hanghang Tong, Jingrui He, Mingjing Li, Wei-ying Ma, Hong-jiang Zhang, Changshui Zhang
In this paper, a novel keyword propagation method is proposed for image retrieval based on a recently developed manifold-ranking algorithm. In contrast to existing methods which train a binary
Li-qun Chen, Xing Xie, Xin Fan, Wei-ying Ma, Hong-jiang Zhang, He-qin Zhou
Part of this work was originally presented at the 9th International
TIME-CONSTRAINT BOOST FOR TV COMMERCIALS DETECTION (2008)
Tie-yan Liu, Tao Qin, Hong-jiang Zhang
Commercials detection is very important for TV broadcast analysis. However, independent classification of video shots is very difficult because a considerable portion of individual commercial shots...
Manuscript for Pattern Recognition Letters (2008)
As a new pattern classification method, Nearest Feature Line (NFL) provides an effective way to tackle the sort of pattern recognition problems where only limited data are available for training. In...
Gui-rong Xue, Hua-jun Zeng, Zheng Chen, Wei-ying Ma, Hong-jiang Zhang, Chao-jun Lu
Current search engines generally employ link analysis techniques to web-page re-ranking. However, the same techniques are problematic in small webs, such as websites or intranet webs, because the...
Relevance Feedback for Keyword and Visual Featurebased Image Retrieval * (2008)
Feng Jing, Mingjing Li, Hong-jiang Zhang, Bo Zhang
Abstract. In this paper, a relevance feedback scheme for both keyword and visual feature-based image retrieval is proposed. For each keyword, a statistical model is trained offline based on visual...
Maximizing Information Throughput for Multimedia Browsing on Small Displays. Procs (2008)
Xing Xie, Wei-ying Ma, Hong-jiang Zhang
As a great many of new devices with diverse capabilities are making a population boom, their limited display sizes become the major obstacle that has undermined the usefulness of these devices for...
Section-Based Filtering and Its Application to (2008)
Xie Xing, Liu Wenyin, Hong-jiang Zhang, Yudong Yang
Abstract: Demands for automatic filtering of restrictive contents on the WWW are growing continuously as the accessibility of the web is rapidly expanding. Most information filtering technologies aim...
Repeating Pattern Discovery from Acoustic Musical Signals (2008)
Muyuan Wang, Lie Lu, Hong-jiang Zhang
Music pieces are typically repetitive. The automatic extraction of repeating patterns is useful for music summary, indexing and retrieval. In this paper, an effective approach of repeating pattern...
Jingrui He, Mingjing Li, Zhiwei Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
Abstract. To improve the precision of top-ranked images returned by a web image search engine, we propose in this paper a novel pseudo relevance feedback method named iterative probabilistic...
2 Content-based Query Clustering 5 (2008)
W. Wu, Ji-rong Wen, Hong-jiang Zhang
2.2 Similarity Based on Word-Level String Matching........... 6
Application in Video Summarization 1 ABSTRACT Author(s): (2008)
Yu-fei Ma, Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
Due to the information redundancy of video, automatically extracting essential video content is one of key techniques for accessing and managing video library. In this paper, we present a generic...
Hanghang Tong, Hanghang Tong, Spiros Papadimitriou, Philip S. Yu, Christos Faloutsos Fast, Hanghang Tong, ...
Zhang. Manifold-Ranking Based Keyword Propagation for Image Retrieval. EURASIP
An Efficient Memorization Scheme for Relevance Feedback in Image Retrieval (2007)
Lei Zhang, Fang Qian, Mingjing Li, Hong-Jiang Zhang
We propose a novel approach to memorizing content relevance information accumulated in relevance feedback sessions (historical relevance feedback) in image retrieval. It is based on the idea that by...
Feature Article Applications of Video-Content Analysis and Retrieval Managing (2007)
Nevenka Dimitrova, Hong-jiang Zhang, Behzad Shahraray, Ibrahim Sezan, Thomas Huang, Avideh Zakhor
multimedia data requires more than collecting the data into storage archives and delivering it via networks to homes or offices. We survey technologies and applications for video-content analysis and...
Maximizing Information Throughput for Multimedia Browsing on Small Displays. Procs (2007)
Xing Xie, Wei-ying Ma, Hong-jiang Zhang
As a great many of new devices with diverse capabilities are making a population boom, their limited display sizes become the major obstacle that has undermined the usefulness of these devices for...
Graph embedding and extension: A general framework for dimensionality reduction (2007)
Shuicheng Yan, Dong Xu, Benyu Zhang, Hong-jiang Zhang, Qiang Yang, Senior Member, ...
Abstract—Over the past few decades, a large family of algorithms—supervised or unsupervised; stemming from statistics or geometry theory—has been designed to provide different solutions to the...
Concurrent multiple instance learning for image categorization (2007)
Guo-jun Qi, Xian-sheng Hua, Yong Rui, Tao Mei, Jinhui Tang, Hong-jiang Zhang
We propose a new multiple instance learning (MIL) algorithm to learn image categories. Unlike existing MIL algorithms, in which the individual instances in a bag are assumed to be independent with...
Human gait recognition with matrix representation (2006)
Xu, Dong, Yan, Shuicheng, Tao, Dacheng, Zhang, Lei, Li, Xuelong, Zhang, Hong-Jiang
Human gait is an important biometric feature. It can be perceived from a great distance and has recently attracted greater attention in video-surveillance-related applications, such as closed-circuit...
Human gait recognition with matrix representation (2006)
Xu, Dong, Yan, Shuicheng, Tao, Dacheng, Zhang, Lei, Li, Xuelong, Zhang, Hong-Jiang
Human gait is an important biometric feature. It can be perceived from a great distance and has recently attracted greater attention in video-surveillance-related applications, such as closed-circuit...
Human gait recognition with matrix representation (2006)
Xu, Dong, Yan, Shuicheng, Tao, Dacheng, Zhang, Lei, Li, Xuelong, Zhang, Hong-Jiang
Human gait is an important biometric feature. It can be perceived from a great distance and has recently attracted greater attention in video-surveillance-related applications, such as closed-circuit...
Human gait recognition with matrix representation (2006)
Xu, Dong, Yan, Shuicheng, Tao, Dacheng, Zhang, Lei, Li, Xuelong, Zhang, Hong-Jiang
Human gait is an important biometric feature. It can be perceived from a great distance and has recently attracted greater attention in video-surveillance-related applications, such as closed-circuit...
Human gait recognition with matrix representation (2006)
Dong Xu, Shuicheng Yan, Dacheng Tao, Lei Zhang, Xuelong Li, Hong-jiang Zhang
Abstract—Human gait is an important biometric feature. It can be perceived from a great distance and has recently attracted greater attention in video-surveillance-related applications, such as...
Scalable Search-Based Image Annotation of Personal Images (2006)
Changhu Wang, Feng Jing, Lei Zhang, Hong-jiang Zhang
With the prevalence of digital cameras, more and more people have considerable digital images on their personal devices. As a result, there are increasing needs to effectively search these personal...
Manifold-Ranking-Based Keyword Propagation for Image Retrieval (2006)
Hanghang Tong, Jingrui He, Mingjing Li, Wei-Ying Ma, Hong-Jiang Zhang, Changshui Zhang
A novel keyword propagation method is proposed for image retrieval based on a recently developed manifold-ranking algorithm. In contrast to existing methods which train a binary classifier for each...
A memory learning framework for effective image retrieval (2005)
Junwei Han, King N. Ngan, Mingjing Li, Hong-jiang Zhang
Abstract—Most current content-based image retrieval systems are still incapable of providing users with their desired results. The major difficulty lies in the gap between low-level image features...
Video summarization and scene detection by graph modeling (2005)
Chong-wah Ngo, Yu-fei Ma, Hong-jiang Zhang
Abstract—In this paper, we propose a unified approach for video summarization based on the analysis of video structures and video highlights. Two major components in our approach are scene modeling...
Learning no-reference quality metric by examples (2005)
Hanghang Tong, Mingjing Li, Hong-jiang Zhang, Changshui Zhang, Jingrui He, Wei-ying Ma
In this paper, a novel learning based method is proposed for No-Reference image quality assessment. Instead of examining the exact prior knowledge for the given type of distortion and finding a...
Face recognition using laplacianfaces (2005)
Xiaofei He, Shuicheng Yan, Yuxiao Hu, Partha Niyogi, Hong-jiang Zhang
Abstract—We propose an appearance-based face recognition method called the Laplacianface approach. By using Locality Preserving Projections (LPP), the face images are mapped into a face subspace...
Face recognition using laplacianfaces (2005)
Xiaofei He, Shuicheng Yan, Yuxiao Hu, Partha Niyogi, Hong-jiang Zhang
Abstract—We propose an appearance-based face recognition method called the Laplacianface approach. By using Locality Preserving Projections (LPP), the face images are mapped into a face subspace...
Discriminant analysis with tensor representation (2005)
Shuicheng Yan, Dong Xu, Qiang Yang, Lei Zhang, Xiaoou Tang, Hong-jiang Zhang
In this paper, we present a novel approach to solving the supervised dimensionality reduction problem by encoding an image object as a general tensor of 2nd or higher order. First, we propose a...
Neighborhood preserving embedding (2005)
Xiaofei He, Deng Cai, Shuicheng Yan, Hong-jiang Zhang
Recently there has been a lot of interest in geometrically motivated approaches to data analysis in high dimensional spaces. We consider the case where data is drawn from sampling a probability...
Efficient Video Mosaicing Based On Motion Analysis (2005)
Tao Mei, Xian-sheng Hua, He-qin Zhou, Shipeng Li, Hong-jiang Zhang
Presenting more comprehensive information than key frame and any subset of frames, mosaic has attracted a growing attention in recent years as a useful element for a variety of vision tasks. In this...
Concurrent subspaces analysis (2005)
Dong Xu, Shuicheng Yan, Lei Zhang, Hong-jiang Zhang, Zhengkai Liu, Heung-yeung Shum
A representative subspace is significant for image analysis, while the corresponding techniques often suffer from the curse of dimensionality dilemma. In this paper, we propose a new algorithm,...
A probabilistic semantic model for image annotation and multi-modal image retrieval (2005)
Ruofei Zhang, Zhongfei (mark Zhang, Mingjing Li, Hong-jiang Zhang
This paper addresses automatic image annotation problem and its application to multi-modal image retrieval. The contribution of our work is three-fold. (1) We propose a probabilistic semantic model...
Sports video mining with mosaic (2005)
Tao Mei, Yu-fei Ma, He-qin Zhou, Wei-ying Ma, Hong-jiang Zhang
Video is an information-intensive media with much redundancy. Therefore, it is desirable to be able to mine structure or semantics of video data for efficient browsing, summarization and highlight...
Graph Embedding: A General Framework for Dimensionality Reduction (2005)
Shuicheng Yan, Dong Xu, Benyu Zhang, Hong-jiang Zhang
In the last decades, a large family of algorithms ─ supervised or unsupervised; stemming from statistic or geometry theory─have been proposed to provide different solutions to the problem of...
Face recognition using laplacianfaces (2005)
Xiaofei He, Shuicheng Yan, Yuxiao Hu, Partha Niyogi, Hong-jiang Zhang
We propose an appearance based face recognition method called the Laplacianface approach. By using Locality Preserving Projections (LPP), the face images are mapped into a face subspace for analysis....
Discriminant analysis with tensor representation (2005)
Shuicheng Yan, Dong Xu, Qiang Yang, Lei Zhang, Xiaoou Tang, Hong-jiang Zhang
In this paper, we present a novel approach to solving the supervised dimensionality reduction problem by encoding an image object as a general tensor of 2nd or higher order. First, we propose a...
Manifold-ranking based image retrieval (2004)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
In this paper, we propose a novel transductive learning framework named manifold-ranking based image retrieval (MRBIR). Given a query image, MRBIR first makes use of a manifold ranking algorithm to...
Automatic peak number detection in image symmetry analysis”, submitted to PCM’2004 (2004)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
Abstract. In repeated pattern analysis, peak number detection in autocorrelation is of key importance, which subsequently determines the correctness of the constructed lattice. Previous work...
C.: W-Boost and Its Application to Web Image Classification (2004)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Changshui Zhang
When training data is not sufficient, boosting algorithms tend to overfit as more weak learners are combined to form a strong classifier. In this paper, we propose a new variant of RealBoost, called...
Learning an image manifold for retrieval (2004)
Xiaofei He, Wei-ying Ma, Hong-jiang Zhang
We consider the problem of learning a mapping function from low-level feature space to high-level semantic space. Under the assumption that the data lie on a submanifold embedded in a high...
An automatic performance evaluation protocol for video text detection algorithms (2004)
Xian-sheng Hua, Liu Wenyin, Senior Member, Hong-jiang Zhang
Abstract—Text presented in videos provides important supplemental information for video indexing and retrieval. Many efforts have been made for text detection in videos. However, there is still a...
Audio Textures: Theory and Applications (2004)
Lie Lu, Liu Wenyin, Senior Member, Hong-Jiang Zhang
In this paper, we introduce a new audio medium, called audio texture, as a means of synthesizing long audio stream according to a given short example audio clip. The example clip is first analyzed to...
An Attention-Based Decision Fusion Scheme for Multimedia Information Retrieval (2004)
Xian-Sheng Hua, Hong-Jiang Zhang
In this paper, we proposed a novel decision fusion scheme based on the psychological observations on human beings' visual and aural attention characteristics, which combines a set of decisions...
P-Karaoke: Personalized Karaoke System (2004)
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
In this demonstration, a personalized Karaoke system, P-Karaoke, is proposed. In the P-Karaoke system, personal home videos and photographs, which are automatically selected from users’ multimedia...
Optimization-based automated home video editing system (2004)
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
Abstract—In this paper, we present an optimization-based system that automates home video editing (AVE). This system automatically selects suitable or desirable highlight segments from a set of raw...
Learning an image manifold for retrieval (2004)
Xiaofei He, Wei-ying Ma, Hong-jiang Zhang
We consider the problem of learning a mapping function from low-level feature space to high-level semantic space. Under the assumption that the data lie on a submanifold embedded in a high...
An automatic performance evaluation protocol for video text detection algorithms (2004)
Xian-sheng Hua, Liu Wenyin, Hong-jiang Zhang
Abstract—Text presented in the videos provides important supplemental information for video indexing and retrieval. Many efforts have been made for text detection in videos. However, there is still...
Robust Video Signature Based on Ordinal Measure (2004)
Xian-sheng Hua, Xian Chen, Hong-jiang Zhang
In this paper we proposed a video signature based on ordinal measure of resampled video frames, which is robust to changing compression formats, compression ratios, frame sizes and frame rates. To...
Automatically Converting Photographic Series into Video (2004)
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
In this paper, we proposed a novel way to browse a series of photographs, which can be regarded as a system exploring the new medium between photograph and video. The scheme exploits the rich content...
Manifold-ranking based image retrieval (2004)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
In this paper, we propose a novel transductive learning framework named manifold-ranking based image retrieval (MRBIR). Given a query image, MRBIR first makes use of a manifold ranking algorithm to...
Classification of digital photos taken by photographers or home users (2004)
Hanghang Tong, Mingjing Li, Hong-jiang Zhang, Jingrui He, Changshui Zhang
Abstract. In this paper, we address a specific image classification task, i.e. to group images according to whether they were taken by photographers or home users. Firstly, a set of low-level...
Mean version space: a new active learning method for content-based image retrieval (2004)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
In content-based image retrieval, relevance feedback has been introduced to narrow the gap between low-level image feature and high-level semantic concept. Furthermore, to speed up the convergence to...
Xiaofei He, Deng Cai, Ji-rong Wen, Wei-ying Ma, Hong-jiang Zhang
Due to the rapid growth of the number of digital images on the Web, there is an increasing demand for effective and efficient method for organizing and retrieving the images available. This paper...
Classification of digital photos taken by photographers or home users (2004)
Hanghang Tong, Mingjing Li, Hong-jiang Zhang, Jingrui He, Changshui Zhang
Abstract. In this paper, we address a specific image classification task, i.e. to group images according to whether they were taken by photographers or home users. Firstly, a set of low-level...
Robust Multipose Face Detection in Images (2004)
Rong Xiao, Ming-jing Li, Hong-jiang Zhang
Automatic human face detection from images in surveillance and biometric applications is a challenging task due to the variances in image background, view, illumination, articulation, and facial...
Noreference quality assessment for JPEG2000 compressed images (2004)
Hanghang Tong, Mingjing Li, Hong-jiang Zhang, Changshui Zhang
No-Reference quality assessment is a relatively new topic and has been attracting more and more attention in recent years. Due to the limited understanding of the human vision system, most of the...
Automatic peak number detection in image symmetry analysis”, submitted to PCM’2004 (2004)
Jingrui He, Mingjing Li, Hong-jiang Zhang, Hanghang Tong, Changshui Zhang
Abstract. In repeated pattern analysis, peak number detection in autocorrelation is of key importance, which subsequently determines the correctness of the constructed lattice. Previous work...
An automatic performance evaluation protocol for video text detection algorithms (2004)
Xian-sheng Hua, Liu Wenyin, Hong-jiang Zhang
Abstract—Text presented in the videos provides important supplemental information for video indexing and retrieval. Many efforts have been made for text detection in videos. However, there is still...
An attention-based decision fusion scheme for multimedia information retrieval (2004)
Xian-sheng Hua, Hong-jiang Zhang
Abstract. In this paper, we proposed a novel decision fusion scheme based on the psychological observations on human beings ’ visual and aural attention characteristics, which combines a set of...
Dominant feature vectors based audio similarity measure (2004)
Jing Gu, Lie Lu, Rui Cai, Hong-jiang Zhang, Jian Yang
Abstract. This paper presents an approach to extracting dominant feature vectors from an individual audio clip and then proposes a new similarity measure based on the dominant feature vectors....
ImageSeer: Clustering and Searching WWW Images (2004)
Xiaofei He, Deng Cai, Ji-rong Wen, Wei-ying Ma, Hong-jiang Zhang
Due to the rapid growth of the number of digital images on the Web, there is an increasing demand for effective and efficient method for organizing and retrieving the images available. This paper...
Automatic Music Video Generation Based on Temporal Pattern Analysis (2004)
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
Music video (MV) is a short film meant to present a visual representation of a popular music song. In this paper, we present a system that automatically generates MV-like videos from personal home...
Detecting Web Page Structure for Adaptive Viewing on Small Form Factor Devices (2003)
Chen, Yu, Ma, Wei-Ying, Zhang, Hong-Jiang
Mobile devices have already been widely used to access the Web. However, because most available web pages are designed for desktop PC in mind, it is inconvenient to browse these large web pages on a...
Motion Pattern-Based Video Classification and Retrieval (2003)
Today′s content-based video retrieval technologies are still far from human′s requirements. A fundamental reason is the lack of content representation that is able to bridge...
A Multi-paradigm Querying Approach for a Generic Multimedia Database Management System (2003)
Ji-rong Wen, Qing Li, Wei-ying Ma, Hong-jiang Zhang
To truly meet the requirements of multimedia database (MMDB) management, an integrated framework for modeling, managing and retrieving various kinds of media data in a uniform way is necessary....
Learning a locality preserving subspace for visual recognition (2003)
Xiaofei He, Shuicheng Yan, Yuxiao Hu, Hong-jiang Zhang
Previous works have demonstrated that the face recognition performance can be improved significantly in low dimensional linear subspaces. Conventionally, principal component analysis (PCA) and linear...
Automatic Video Summarization by Graph Modeling (2003)
Chong-wah Ngo, Yu-fei Ma, Hong-jiang Zhang
We propose a unified approach for summarization based on the analysis of video structures and video highlights. Our approach emphasizes both the content balance and perceptual quality of a summary....
Automated Home Video Editing (2003)
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
In this paper, we present a system that automates home video editing. This system automatically extracts a set of highlight segments from a set of raw home videos and aligns them with user supplied...
Relevance feedback in content-based image search (2003)
Hong-jiang Zhang, Zheng Chen, Wen-yin Liu, Mingjing Li
Abstract: Content-based image retrieval (CBIR) is a research area dedicated to address the retrieve and search multimedia documents for digital libraries. Relevance feedback is a powerful technique...
Learning a Semantic Space From User’s Relevance Feedback for Image Retrieval (2003)
Xiaofei He, Oliver King, Wei-ying Ma, Mingjing Li, Hong-jiang Zhang, Senior Member
Abstract—As current methods for content-based retrieval are incapable of capturing the semantics of images, we experiment with using spectral methods to infer a semantic space from user’s...
Unsupervised Image Segmentation Using Local Homogeneity Analysis (2003)
Feng Jing, Mingjing Li, Hong-jiang Zhang, Bo Zhang
In this paper, a novel method is presented for unsupervised image segmentation based on local homogeneity analysis. First, a criterion for homogeneity of a certain pattern is proposed. Applying the...
Learning in region-based image retrieval (2003)
Feng Jing, Mingjing Li, Lei Zhang, Hong-jiang Zhang, Bo Zhang
Abstract. In this paper, several effective learning algorithms using global image representations are adjusted and introduced to region-based image retrieval (RBIR). First, the query point movement...
Visual attention based image browsing on mobile devices (2003)
Xin Fan, Xing Xie, Wei-ying Ma, Hong-jiang Zhang, He-qin Zhou
Images have become more and more common in mobile communications. People now can easily take and exchange pictures on the move using their mobile devices and digital cameras. However, a crucial...
Enabling Multimedia Adaptation Services in Content Delivery Networks. IMMCN’03 (2003)
Wei-ying Ma, Xing Xie, Chun Yuan, Yu Chen, Zheng Zhang, Hong-jiang Zhang
Content delivery networks (CDNs) provide a large number of caches and storage devices at the edge of network to push content closer to the user. To cope with the growing diversity and heterogeneity...
A Multi-paradigm Querying Approach for a Generic Multimedia Database Management System (2003)
Ji-rong Wen, Qing Li, Wei-ying Ma, Hong-jiang Zhang
To truly meet the requirements of multimedia database (MMDB) management, an integrated framework for modeling, managing and retrieving various kinds of media data in a uniform way is necessary....
Motion analysis and segmentation through spatio-temporal slices processing (2003)
Chong-wah Ngo, Ting-chuen Pong, Hong-jiang Zhang
This paper presents new approaches in characterizing and segmenting the content of video. These approaches are developed based upon the pattern analysis of spatio-temporal slices. While tradi-tional...
Multimedia Systems (2002) 057 Multimedia Systems (2003)
Tianming Liu, Wei Qi, Hong-jiang Zhang, Feihu Qi
This paper proposes a systematic rate controller (SRC) for content-aware streaming of MPEG-4 FGS video over the Internet. An active layer dropping technique is proposed to provide both coarse-grain...
A User Attention Model for Video Summarization (2003)
Yu-Fei Ma, Lie Lu, Hong-Jiang Zhang, Mingjing Li
Automatic generation of video summarization is one of the key techniques in video management and browsing. In this paper, we present a generic framework of video summarization based on the modeling...
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
To exploit rich content embedded in a single photograph, a system named Photo2Video was developed to automatically convert a photographic series into a video by simulating camera motions, set to...
AVE - Automated Home Video Editing (2003)
Xian-sheng Hua, Lie Lu, Hong-jiang Zhang
In this paper, we present a system that automates home video editing. This system automatically extracts a set of highlight segments from a set of raw home videos and aligns them with user supplied...
Relevance feedback in content-based image search (2003)
Hong-jiang Zhang, Zheng Chen, Wen-yin Liu, Mingjing Li
Abstract: Content-based image retrieval (CBIR) is a research area dedicated to address the retrieve and search multimedia documents for digital libraries. Relevance feedback is a powerful technique...
Learning in region-based image retrieval (2003)
Feng Jing, Mingjing Li, Lei Zhang, Hong-jiang Zhang, Bo Zhang
Abstract. In this paper, several effective learning algorithms using global image representations are adjusted and introduced to region-based image retrieval (RBIR). First, the query point movement...
Color Texture Moments for Content-Based Image Retrieval (2003)
Hui Yu, Mingjing Li, Hong-Jiang Zhang, Jufu Feng
In this paper, we adopt local Fourier transform as a texture representation scheme and derive eight characteristic maps for describing different aspects of co-occurrence relations of image pixels in...
Image adaptation based on attention model for small-form factor devices (2003)
Li-qun Chen, Xing Xie, Wei-ying Ma, Hong-jiang Zhang, He-qin Zhou
Image adaptation, one of the essential problems in adaptive content delivery for universal access, has been actively explored for some time. Most existing approaches have focused on generic...
Speech Segmentation without Speech Recognition (2003)
Dong Wang, Lie Lu, Hong-jiang Zhang
In this paper, we presented a semantic speech segmentation approach, in particular sentence segmentation, without speech recognition. In order to get phoneme level information without word...
Automatic browsing of large pictures on mobile devices (2003)
Hao Liu, Xing Xie, Wei-ying Ma, Hong-jiang Zhang
Pictures have become increasingly common and popular in mobile communications. However, due to the limitation of mobile devices, there is a need to develop new technologies to facilitate the browsing...
Motion analysis and segmentation through spatio-temporal slices processing (2003)
Chong-wah Ngo, Ting-chuen Pong, Hong-jiang Zhang, Senior Member
Abstract—This paper presents new approaches in characterizing and segmenting the content of video. These approaches are developed based upon the pattern analysis of spatio-temporal slices. While...
Motion Pattern-Based Video Classification and Retrieval (2003)
Today′s content-based video retrieval technologies are still far from human′s requirements. A fundamental reason is the lack of content representation that is able to bridge...
Motion Pattern-Based Video Classification and Retrieval (2003)
Today′s content-based video retrieval technologies are still far from human′s requirements. A fundamental reason is the lack of content representation that is able to bridge the gap between...
Learning similarity measure for natural image retrieval with relevance feedback (2002)
Guo-dong Guo, Anil K. Jain, Wei-ying Ma, Hong-jiang Zhang, Senior Member
Abstract—A new scheme of learning similarity measure is proposed for content-based image retrieval (CBIR). It learns a boundary that separates the images in the database into two clusters. Images...
On clustering and retrieval of video shots through temporal slices analysis (2002)
Chong-wah Ngo, Ting-chuen Pong, Hong-jiang Zhang, Senior Member
Abstract—Based on the analysis of temporal slices, we propose novel approaches for clustering and retrieval of video shots. Temporal slices are a set of two–dimensional (2-D) images extracted...
Statistical correlation analysis in image retrieval (2002)
Mingjing Li, Zheng Chen, Hong-jiang Zhang
A statistical correlation model for image retrieval is proposed. This model captures the semantic relationships among images in a database from simple statistics of userprovided relevance feedback...
A Concentric Model for Community Mining in Graph Structures (2002)
Wei-Jun Zhou, Wen-jun Zhou, Ji-rong Wen, Ji-rong Wen, Wei-ying Ma, Wei-ying Ma, ...
Discovering communities from a graph structure such as the Web has become an interesting research problem recently. In this paper, comparing with the state-of-the-art authority detecting and graph...
Content Analysis for Audio Classification and Segmentation (2002)
Lie Lu, Hong-Jiang Zhang, Senior Member, Hao Jiang
In this paper, we present our study of audio content analysis for classification and segmentation, in which an audio stream is segmented according to audio type or speaker identity. We propose a...
Performance Evaluation Protocol for Video Scene Detection Algorithms (2002)
Xian-Sheng Hua, Dong Zhang, Mingjing Li, Hong-Jiang Zhang
In this paper, we address the problem of performance evaluation (PE) of video scene detection algorithms. An objective and comprehensive protocol for performance evaluation and comparison of...
MSR-Asia at TREC-11 Video Track (2002)
Xian-Sheng Hua, Pei Yin, Huajian Wang, Junfeng Chen, Mingjing Li, ...
The Media Computing Group of Microsoft Research Asia participated in all the three tasks of Video tracks of TREC-11, including automatic Shot Boundary Determination, Semantic Feature Extraction and...
Efficient Video Text Recognition Using Multiple Frame Integration (2002)
Xian-Sheng Hua, Pei Yin, Hong-Jiang Zhang
Text superimposed on the video frames provides supplemental but important information for video indexing and retrieval. Many efforts have been made for videotext detection and recognition (Video...
Gaussian Mixture Model for Relevance Feedback in Image Retrieval (2002)
Fang Qian, Mingjing Li, Lei Zhang, Hong-Jiang Zhang, Bo Zhang
Relevance Feedback (RF) has become a powerful technique in content-based image retrieval. Most RF methods assume that positive images follow the single Gaussian distribution, which is not sufficient...
Ji-rong Wen, Jian-yun Nie, Hong-jiang Zhang
This paper describes a new query clustering method that makes use of user logs which allow us to identify the documents the users have selected for a query. The similarity between two queries may be...
Clustering User Queries of a Search Engine (2001)
Wen, Ji-Rong, Nie, Jian-Yun, Zhang, Hong-Jiang
In order to increase retrieval precision, some new search engines provide manually verified answers to Frequently Asked Queries (FAQs). An underlying task is the identification of FAQs. This paper...
Boosting for content-based audio classification and retrieval: An Evaluation (2001)
Guodong Guo, Hong-jiang Zhang, Stan Z. Li
In this paper, we evaluate a recently proposed algorithm in machine learning called AdaBoost for content-based audio classification and retrieval. AdaBoost is a kind of large margin classifiers and...
Pairwise Face Recognition (2001)
Guo-dong Guo, Hong-jiang Zhang, Stan Z. Li
We develop a pairwise classification framework for face recognition, in which a � class face recognition problem is divided into a set of � � � two class problems. Such a problem...
A Statistical Correlation Model for Image Retrieval (2001)
Mingjing Li, Zheng Chen, Liu Wenyin, Hong-jiang Zhang
A bigram correlation model for image retrieval is proposed, which captures the semantic relationships among images in a database from simple statistics of users ’ relevance feedback information. It...
Image classification for content-based indexing (2001)
Aditya Vailaya, Associate Member, Anil K. Jain, Hong-jiang Zhang, Senior Member
Abstract—Grouping images into (semantically) meaningful categories using low-level visual features is a challenging and important problem in content-based image retrieval. Using binary Bayesian...
Automatic location of text in video frames (2001)
Xian-sheng Hua, Xiang-rong Chen, Liu Wenyin, Hong-jiang Zhang
A new automatic text location approach for videos is proposed. First of all, the corner points of the selected video frames are detected. After deleting some isolate corners, we merge the remaining...
Automatic location of text in video frames (2001)
Xian-sheng Hua, Xiang-rong Chen, Liu Wenyin, Hong-jiang Zhang
A new automatic text location approach for videos is proposed. First of all, the corner points of the selected video frames are detected. After deleting some isolate corners, we merge the remaining...
Automatic Performance Evaluation for Video Text Detection (2001)
Xian-sheng Hua, Liu Wenyin, Hong-jiang Zhang
In this paper, we propose an objective, comprehensive and difficulty-independent performance evaluation protocol for video text detection algorithms. The protocol includes a positive set and a...
Video content representation for shot retrieval and scene extraction (2001)
Tong Lin, Hong-jiang Zhang, Qing-yun Shi
In this paper, we present a novel scheme on video content representation by exploring the spatiotemporal information. A pseudo-object-based shot representation containing more semantics is proposed...
Integrating Color and Spatial Features for Content-based Video Retrieval (2001)
Tong Lin, Chong-wah Ngo, Hong-jiang Zhang, Qing-yun Shi
In this paper, we present a novel scheme for content-based video retrieval by exploring the spatio-temporal information. A shot with significant content changes can be segmented into several subshots...
Pairwise Face Recognition (2001)
Guo-dong Guo, Hong-jiang Zhang, Stan Z. Li
We develop a pairwise classification framework for face recognition, in which a � class face recognition problem is divided into a set of � � � two class problems. Such a problem...
Recent advances in content based video analysis (2001)
Tchong-wah Ngo, Hong-jiang Zhang, Tting-chuen Pong
In this paper, we present major issues in video parsing, abstraction, re-trieval and semantic analysis. We discuss the success, the difficulties and the expectations in these areas. In addition, we...
Automatic Location of Text in Video Frames (2001)
Xian-Sheng Hua, Xiang-rong Chen, Liu Wenyin, Hong-Jiang Zhang
A new automatic text location approach for videos is proposed. First of all, the corner points of the selected video frames are detected. After deleting some isolate corners, we merge the remaining...
Image Classification for Content-Based Indexing (2001)
Aditya Vailaya, Associate Member, Anil K. Jain, Hong-Jiang Zhang, Senior Member
Grouping images into (semantically) meaningful categories using low-level visual features is a challenging and important problem in content-based image retrieval. Using binary Bayesian classifiers,...
A video text detection and recognition system (2001)
Jie Xi, Xian-sheng Hua, Xiang-rong Chen, Liu Wenyin, Hong-jiang Zhang
In this paper, we propose a new system for text information extraction from news videos. First of all, a method that integrates text detecting and text tracking is developed to locate text areas in...
MSR-Asia at TREC-10 Video Track: Shot Boundary Detection (2001)
Yu-fei Ma, Jia Sheng, Yuan Chen, Hong-jiang Zhang
The video track is added into TREC-10, composed of two tasks, automatic shot boundary detection and video retrieval. In this year, we (MSR-Asia) participated in the video track, focusing on shot...
A video text detection and recognition system (2001)
Jie Xi, Xian-sheng Hua, Xiang-rong Chen, Liu Wenyin, Hong-jiang Zhang
In this paper, we propose a new system for text information extraction from news videos. First of all, a method that integrates text detecting and text tracking is developed to locate text areas in...
Video content representation for shot retrieval and scene extraction (2001)
Tong Lin, Hong-jiang Zhang, Qing-yun Shi
In this paper, we present a novel scheme on video content representation by exploring the spatiotemporal information. A pseudo-object-based shot representation containing more semantics is proposed...
Qiang Yang, Hai-feng Wang, Ji-rong Wen, Gao Zhang, Ye Lu, Hong-jiang Zhang
Abstract. As more information becomes available on the World Wide Web, it has become an acute problem to provide effective search tools for information access. Previous generations of search engines...
WhatNext: A Prediction System for Web Requests using N-gram Sequence Models (2000)
Zhong Su, Qiang Yang, Ye Lu, Hong-Jiang Zhang, Va S Canada
As an increasing number of users access information on the web, there is a great opportunity to learn from the server logs to learn about the users' probable actions in the future. In this...
Towards A Next-Generation Search Engine (2000)
Qiang Yang, Hai-Feng Wang, Ji-rong Wen, Gao Zhang, Ye Lu, Kai-Fu Lee, ...
. As more information becomes available on the World Wide Web, it has become an acute problem to provide effective search tools for information access. Previous generations of search engines are...
Integrating visual, audio and text analysis for news video (2000)
Wei Qi, Lie Gu, Hao Jiang, Xiang-rong Chen, Hong-jiang Zhang
In this paper, we present a system developed for content-based broadcasted news video browsing for home users. There are three main factors that distinguish our work from other similar ones. First,...
Xing Xie, Hao Liu, Wei-ying Ma, Senior Member, Hong-jiang Zhang
Abstract—Pictures have become increasingly common and popular in mobile communications. However, due to the limitation of mobile devices, there is a need to develop new technologies to facilitate...