Conference paper · 2015
Statistical Modeling and Visualizing Open Big Data Using a Terrorism Case Study
2015 3rd International Conference on Future Internet of Things and Cloud (FiCloud), Rome, Italy, pp. 489–496, IEEE · Published
Summary
What question does this paper answer?
How could qualitative big data be collected and analyzed, using readily available statistical software, to identify hidden factor relationships that support strategic decision making?
What did the study find?
Applying simple correspondence analysis in SPSS 21 to an open meta big dataset of 125,087 global terrorism records (133 fields, 16,636,571 data points, 1970–2013), the authors related nine terrorist attack methods to 13 world regions. The first two dimensions captured 94.5% of total inertia (0.687 and 0.258), justifying a two-dimensional symmetric plot, while the overall association between attack type and region was low (0.21).
Why does it matter?
The study shows that qualitative big data can be analyzed with desktop statistical software to reveal hidden relationships that business managers could use when selecting marketing partners and supply chain providers or deciding to scale down operations in risky areas. The authors aim to generalize the methodology rather than the specific results, and call for more empirical big data analytics papers and a methodology guidebook for practitioners and researchers.
Key findings
- The study analyzed a global terrorism open meta big dataset of 125,087 records with 133 fields (16,636,571 data points) covering 209 countries grouped into 13 regions from 1970 to 2013.
- The terrorism big data study coded attack method into nine nominal types: assassinations, armed assaults, bombing/explosions, hijacking, barricading, kidnapping, infrastructure, unarmed assaults and unknown/mixed.
- Correspondence analysis of attack method by region found that the first dimension captured 0.687 and the second 0.258 of total inertia, together 94.5% (0.945).
- The third correspondence analysis dimension added only 3.4% (0.034) of inertia, which the authors used to justify a two-dimensional symmetric plot of terrorist attack type by region.
- The estimated overall association (correlation) between terrorist attack type and geographic region in the global terrorism big data was 0.21, described as low.
- The study identified armed assault, bombs and assassinations as the most lethal terrorist attack methods of concern to organizations.
- The authors argue that correspondence analysis is preferable to cluster analysis or chi-square tests for nominal big data because it estimates the strength and direction of associations among factors without losing attribute detail.
Source: Vajjhala et al. (2015), 2015 3rd International Conference on Future Internet of Things and Cloud (FiCloud), Rome, Italy, pp. 489–496, IEEE. DOI: 10.1109/FiCloud.2015.15
Study at a glance
| Research question | How can qualitative big data be collected and analyzed to identify factor relationships that support strategic decision making? |
|---|---|
| Design | Positivist, exploratory empirical case study using descriptive non-parametric statistics |
| Data | Global terrorism open meta big dataset: 125,087 records, 133 fields, 16,636,571 data points, 209 countries in 13 regions, 1970–2013 |
| Methods | Simple correspondence analysis (symmetrical normalization, Euclidean distance) in SPSS version 21 of attack method by region |
| Main result | Two dimensions explained 94.5% of inertia (0.687 + 0.258); overall attack-type–region association was 0.21 (low) |
| Implication | Correspondence analysis with common software can turn qualitative big data into visual relationship maps for decision makers |
| Citation | Vajjhala et al. (2015) · DOI 10.1109/FiCloud.2015.15 |
Abstract
This study addressed the literature gap, identified by other researchers, that there are too few examples of applied empirical open big data analytics. Using correspondence analysis as a big data analytical technique, this study demonstrates how qualitative big data type could be analyzed to identify hidden factor relationships that may assist strategic decision making. We use a 64MB open meta big dataset developed by summarizing terrorist activity as keyword frequencies collected from trillions of public news articles published during a 43 year period from 1970-2013 and readily available statistical software, SPSS, to visually summarize the findings on a global terrorism big dataset. The approach in this paper might facilitate the research and development of open big data, big data analytics against global terrorism.
Abstract as published in 2015 3rd International Conference on Future Internet of Things and Cloud (FiCloud), Rome, Italy.
Keywords: open big data analytics; correspondence analysis; global terrorism open meta big dataset; statistical modeling; data mining; data warehouse
Key terms
- Correspondence analysis
- A multivariate exploratory technique that estimates the interdependence (inertia) between categorical variables in a contingency table and plots them as distances in a low-dimensional map.
- Open big data
- Very large datasets made publicly available, here a meta dataset summarizing terrorist activity as keyword frequencies from public news articles.
- Inertia
- In correspondence analysis, the measure of association between row and column factors, whose proportion accounted for by each dimension indicates how much of the relationship a plot captures.
How to cite
Vajjhala, N. R., Strang, K. D., & Sun, Z. (2015). Statistical Modeling and Visualizing Open Big Data Using a Terrorism Case Study. In 2015 3rd International Conference on Future Internet of Things and Cloud (FiCloud), Rome, Italy (pp. 489–496). IEEE. https://doi.org/10.1109/FiCloud.2015.15
BibTeX
@inproceedings{vajjhala2015open,
title = {Statistical Modeling and Visualizing Open Big Data Using a Terrorism Case Study},
author = {Vajjhala, Narasimha Rao and Strang, Kenneth David and Sun, Zhaohao},
booktitle = {2015 3rd International Conference on Future Internet of Things and Cloud (FiCloud), Rome, Italy},
pages = {489--496},
year = {2015},
publisher = {IEEE},
doi = {10.1109/FiCloud.2015.15},
url = {https://doi.org/10.1109/FiCloud.2015.15}
}Related research