On detecting urgency in short crisis messages using minimal supervision and transfer learning
- 8 July 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in Social Network Analysis and Mining
- Vol. 10 (1), 1-12
- https://doi.org/10.1007/s13278-020-00670-7
Abstract
Humanitarian disasters have been on the rise in recent years due to the effects of climate change and socio-political situations such as the refugee crisis. Technology can be used to best mobilize resources such as food and water in the event of a natural disaster, by semi-automatically flagging tweets and short messages as indicating an urgent need. The problem is challenging not just because of the sparseness of data in the immediate aftermath of a disaster, but because of the varying characteristics of disasters in developing countries (making it difficult to train just one system) and the noise and quirks in social media. In this paper, we present a robust, low-supervision social media urgency system that adapts to arbitrary crises by leveraging both labeled and unlabeled data in an ensemble setting. The system is also able to adapt to new crises where an unlabeled background corpus may not be available yet by utilizing a simple and effective transfer learning methodology. Experimentally, our transfer learning and low-supervision approaches are found to outperform viable baselines with high significance on myriad disaster datasets.Keywords
Funding Information
- Defense Advanced Research Projects Agency (LORELEI)
This publication has 36 references indexed in Scilit:
- Socializing in emergencies—A review of the use of social media in emergency situationsInternational Journal of Information Management, 2015
- Getting the Query Right: User Interface Design of Analysis Platforms for Crisis ResearchPublished by Springer Science and Business Media LLC ,2015
- Success & Scale in a Data-Producing OrganizationPublished by Association for Computing Machinery (ACM) ,2015
- Think Local, Retweet GlobalPublished by Association for Computing Machinery (ACM) ,2015
- Earthquake emergency management by social sensingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2014
- #Earthquake: Twitter as a Distributed Sensor SystemTransactions in GIS, 2012
- Detection and Extracting of Emergency Knowledge from Twitter StreamsLecture Notes in Computer Science, 2012
- Analysis and Improvement of Minimally Supervised Machine Learning for Relation ExtractionLecture Notes in Computer Science, 2010
- Opinion Mining and Sentiment AnalysisFoundations and Trends® in Information Retrieval, 2008
- A survey of named entity recognition and classificationPublished by John Benjamins Publishing Company ,2007