• Journal of Internet Computing and Services
    ISSN 2287 - 1136 (Online) / ISSN 1598 - 0170 (Print)
    https://jics.or.kr/

A Design and Development of Big Data Indexing and Search System using Lucene


DongMin Kim, JinWoo Choi, ChongWoo Woo, Journal of Internet Computing and Services, Vol. 15, No. 6, pp. 107-116, Dec. 2014
10.7472/jksii.2014.15.6.107, Full Text:
Keywords: Big data, Big data Platform, Data Indexing, Data Searching

Abstract

Recently, increased use of the internet resulted in generation of large and diverse types of data due to increased use of social media, expansion of a convergence of among industries, use of the various smart device. We are facing difficulties to manage and analyze the data using previous data processing techniques since the volume of the data is huge, form of the data varies and evolves rapidly. In other words, we need to study a new approach to solve such problems. Many approaches are being studied on this issue, and we are describing an effective design and development to build indexing engine of big data platform. Our goal is to build a system that could effectively manage for huge data set which exceeds previous data processing range, and that could reduce data analysis time. We used large SNMP log data for an experiment, and tried to reduce data analysis time through the fast indexing and searching approach. Also, we expect our approach could help analyzing the user data through visualization of the analyzed data expression.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[APA Style]
Kim, D., Choi, J., & Woo, C. (2014). A Design and Development of Big Data Indexing and Search System using Lucene. Journal of Internet Computing and Services, 15(6), 107-116. DOI: 10.7472/jksii.2014.15.6.107.

[IEEE Style]
D. Kim, J. Choi, C. Woo, "A Design and Development of Big Data Indexing and Search System using Lucene," Journal of Internet Computing and Services, vol. 15, no. 6, pp. 107-116, 2014. DOI: 10.7472/jksii.2014.15.6.107.

[ACM Style]
DongMin Kim, JinWoo Choi, and ChongWoo Woo. 2014. A Design and Development of Big Data Indexing and Search System using Lucene. Journal of Internet Computing and Services, 15, 6, (2014), 107-116. DOI: 10.7472/jksii.2014.15.6.107.