Folder
ROOT
_ScienceBase Catalog
__Community for Data Integration (CDI)
___CDI Projects Fiscal Year 2014
____Characterization of Earthquake Damage and Effects Using Social Media Data
An established workflow for using the Kibana visual data analysis tools to, in near real time, to determine earthquake significance as well as impacts and effects, as illustrated in 2 figures below as the tool and the workflow. This open source service currently has no free mechanism to secure the data in order to preserve data integrity, so it remains internal. The Kibana Interactive Visualization and Data Analysis Tool shows the event detection, the use of key words that provide indications of shaking intensity, and location. The Kibana Interactive Visualization and Data Analysis Tool Workflow depicts how the tool can be used to drill down into the data to the level of the event relevant photos, which support...
Earthquake Significance Summary Reports are automatically derived for tweet based event detections at five and ten minutes after events occur. The reports give rapid indications of public interest in the event, for use internally and by collaborators. The information supports derivation of an event interest factor which is used to configure alerts from the system.
As a proof of concept, with coordination with FEMA, a GIS service feed for detected events was implemented. An example heatmap produced from ArcGIS service shows the intensity of where reporting tweets orginated.
This integrated dataset provides validation of the system, and analysis demonstrates the system performance as described in figures 5, 6 and 7. The analysis of this dataset was shared publically at scientific conferences including American Geophysical Union (AGU) in December 2014 ( https://agu.confex.com/agu/fm14/meetingapp.cgi#Paper/13007) and Association of Computing Machinery (ACM) Special Interest Group Knowledge Discovery and Data Mining (SIGKDD) Learning about Emergencies from Social Informaion (LESI) workshop in August 2014 ( https://sites.google.com/site/kddlesi2014/program/papers). The figures show the following: Tweet Based Event Detection Delay - The histogram was derived from the integrated social...
The enhancements to the Social Media Earthquake Acquisition and Distribution Application (TED ) system include derivation and distribution of earthquake significance summary reports and archival of tweet based event detections. The most recent code is available on the USGS stash git repository and efforts are still underway to migrate to publically accessible git repository.
The Social Media Earthquake Detection Application (Tedect) was updated to send tweet based event detections into TED and performance improved. The most recent code is on the USGS stash git repository. An older reviewed version is publically available at https://github.com/mguy-usgs/tedect.
