admin

Abstract

Map images have been published around the world. The management of map data, however, has been an open issue for several research fields, This paper explores an approach for classifying diverse map images by their themes using map content features. Specifically, we present a novel strategy for preprocessing text data that are positioned inside the map images, which are extracted using OCR. The activation of the textual feature-based model is joint with the visual features in an early fusion manner. Finally, we train a classifier model which predicts the belonging class of the input map. We have made our dataset available here to facilitate this new task.

Download

Reference

If you use our dataset, please refer to the following paper.

T. Sawada and M. Katsurai, “A Deep Multimodal Approach for Map Image Classification,” in 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 4457–4461, 2020.

Abstract

Emojis have been frequently used to express users’ sentiments, emotions, and feelings in text-based communication. We presented a simple and efficient method for automatically constructing an emoji sentiment lexicon with arbitrary sentiment categories. The proposed method extracts sentiment words from WordNet-Affect and calculates the co-occurrence frequency between the sentiment words and each emoji. Based on the ratio of the number of occurrences of each emoji among the sentiment categories, each emoji is assigned a multidimensional vector whose elements indicate the strength of the corresponding sentiment. In experiments conducted on a collection of tweets, we showed a high correlation between the conventional lexicon and our lexicon for three sentiment categories. We also showed the results for a new lexicon constructed with additional sentiment categories.

Download

Reference

If you use our lexicons, please refer to the following paper.

M. Kimura and M. Katsurai, “Automatic Construction of an Emoji Sentiment Lexicon,” Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2017, pp. 1033–1036, 2017.

Abstract

We propose a novel approach that exploits latent correlations among multiple views: visual and textual views, and a sentiment view constructed using SentiWordNet. In the proposed method, we find a latent embedding space in which correlations among the three views are maximized. The projected features in the latent space are used to train a sentiment classifier, which considers the complementary information from different views.

Dataset description

To evaluate the performance of image sentiment classification, we collected a set of images from Flickr and Instagram, and then prepared their sentiment labels via crowdsourcing. For each image, three workers were asked to provide a sentiment score. They could choose on a discrete five-point scale labeled with “highly positive,” “positive,” “neutral,” “negative,” and “highly negative.” The datasets with sentiment labels (the number of users for each sentiment polarity) are available. that we divided the whole dataset into three batches for download.

Download

Flickr dataset

Instagram dataset

Reference

If you use our dataset, please refer to the following paper.

M. Katsurai and S. Satoh, “Image Sentiment Analysis Using Latent CorrelationsAmong Visual, Textual, and Sentiment Views,” in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2837–2841, 2016.