Machine Learning Techniques for the News Classification

1Bibhuprasad Sahu, 2Archana Panda
1Dept.of MCA, Gandhi institute for technology, Bhubaneswar, Odisha, India
2Dept.of MCA, Gandhi institute for technology, Bhubaneswar, Odisha, India

Abstract : Data mining proceeds with large amount of data. Data mining has popularly treated as synonym of knowledge discovery in database, although some researchers view data mining as an essential step of knowledge discovery. Online news classification is vast area of data mining. As large numbers of articles are published it is time consuming task to select the interesting one. There have been a lot of work for the outer classification but there has been a very less amount of work for inner classification of news. The paper here deals with the existed studies surveyed on the news classification using various machine learning methods.
Keywords : Data  Mining,  Machine  Learning,  News  Classification, Classifiers
I. Introduction
Data mining is process of discovering interesting knowledge such as patterns, associations, changes, anomalies and significant structures, from large amounts of data stored in database, data warehouse, or other information repositories. Data to the wide availability of huge amount of data in electronic form, and imminent need for turning such data into useful information and knowledge for broad application including market analysis ,business management and decision support, data mining has attracted a great deal of attention in information industry in recent year. Data mining is also treated as Knowledge discovery process which consists of iterative sequence of steps as- Data cleaning, Data integration, Data selection, Data mining, Pattern evaluation, Knowledge presentation. The construction of a data warehouse, which involves data cleaning and data integration, can be viewed as an important pre-processing step for data mining. However, a data warehouse is not a requirement for data mining. A data warehouse is a repository of information collected from multiple sources, stored under a unified schema, and which usually resides at a single site. Data mining uses the data warehouse as the source of information for knowledge data discovery (KDD) systems. Data warehouse is a subject-oriented, integrated, time-variant, and non-volatile collection of data in support of management's decision making process.
Mostly the information store in the form of text like e mails, web pages, newspaper article, market research reports, complaint letter from customer and internally generated reports. As for as online newspapers provide news under various categories like national, international, politics, finance, sports, entertainment etc. text classification is also an important part of text mining. Text classification based on expert knowledge how to classify the document under the given set of categories. Data mining classification start with training set of document that is already label with class. Advances in technology triggered a research boom in applications of textual analysis in social sciences with sentiment analysis being particularly popular. Sentiment analysis extracts text’s attitude by identifying words that are correlated with a variable of interest, such as stock return and aggregates it in a single number called text sentiment. The literature interprets text sentiment in three ways: psychological sentiment, pure soft information and omitted quantitative information. The World Wide Web is a prominent, intuitive and tremendous medium to get data today. The well-known web crawler Google as of late reported that its files traverse a surprising eight billion records. The aggregate incorporates a couple of billion Web pages, couple of countless pictures and photographs and around one billion of newsgroup messages. Google says that acquiring a comparative file by hand would take a human searcher 15180 years, expecting somebody could be found to file one archive each moment, for twenty-four hours for each day. In a couple short years, the Web has turned into our most convincing mechanical achievement. It is the world's biggest library and phone system. It is worldwide, and in the meantime flawlessly nearby. For organizations working together on the Web, it is the quickest developing venture and additionally the world's biggest money enlist, an improvement that will just quicken as we find better approaches to mine quality from the enormous substance put there by both people and establishments. What's more, the late prologue to the Web applications, stages and situations, which encourage intuitive data sharing, interoperability and cooperation, all things considered known by Web 2.0 and the Social Web, has made data distributed on the Web no more the area of a little number of tip top researchers. With long range informal communication sites, for example, Facebook1 and MySpace and also free client distributed situations, for example, the client Blogs, nearly anybody today who has something to say can distribute it on the Web, including extra and significant data resources for this glorious overall information store. Web is exceptionally ingenious spot with contrasted with assessment data. Makes client's point of view; individuals can post their own particular substance on different online networking sites.
Building the smart Web is acknowledged utilizing a moderately new Artificial Intelligence procedure, Web Mining, which can be characterized as the utilization of data mining systems to web information. The significant issue with Web Usage Mining is the way of the information they manage. With the development of web, Web Data has gotten to be enormous in nature and a great deal of exchanges is occurring in seconds.
There are various machine learning methods that are used for the classification of data. Machine learning is closely related to (and often overlaps with) computational statistics, which also focuses on prediction-making through the use of computers. It has strong ties to mathematical optimization, which delivers methods, theory and application domains to the field. Machine learning is sometimes conflated with data mining. In the terminology of machine learning, classification is considered an instance of supervised learning, i.e. learning where a training set of correctly identified observations is available.
The paper is summarized as follows: Section I consists of Introduction, Section II involves the Literature Survey, Section III is composed of Classification Approaches and Section IV comprises of the Conclusion.
II. Literature Survey
The existing studies surveyed provide the overview of data warehousing and OLAP technologies, with an emphasis on their new requirements. It describe back end tools for extracting, cleaning and loading data into a data warehouse ,multidimensional data models typical of OLAP, front end client tools for querying and data analysis, server extensions for efficient query processing and tools for metadata management and for managing the warehouse [26]. Thorsten Joachims introduces support vector machines for text categorization. It provides both theoretical and empirical evidence that SVMs are very well suited for text categorization [30]. Susain Dumais compares the effectiveness of five different automatic learning algorithms for text categorization in terms of learning speed, real time classification speed, and classification accuracy. It also examines training set size, and alternative document representations [27]. Chee Hong experimented an automated approach to classify online news using the SVM (Support Vector Machine) classification method. SVM has been shown to give good classification results when ample training documents are given [2]. Hyeran Byun presented a brief introduction on SVMs and several applications of SVMs in pattern recognition problems. SVMs have been successfully applied to a number of applications ranging from face detection and recognition, object detection and recognition, handwritten character and digit recognition, speaker and speech recognition, information and image retrieval, prediction and etc. because they have yielded excellent generalization performance on many statistical problems without any prior knowledge and when the dimension of input space is very high [10]. Daniel I Morariu investigated three approaches to build an efficient meta-classifier. In order to increase the classification accuracy. In this select 8 different SVM classifiers. For each of the classified we modified the kernel, the degree of the kernel and the input data representation [6]. Xindong wu presents the top 10 data mining algorithms. C4.5, k-Means, SVM, Apriori, EM, PageRank, AdaBoost, kNN, Naive Bayes, and CART. These top 10 algorithms are among the most influential data mining algorithms in the research community [41]. Shri Zhong compared generative models based on the multivariate Bernoulli and multinomial distributions have been widely used for text classification. Recently, the spherical k-means algorithm, which has desirable properties for text clustering, has been shown to be a special case of a generative model based on a mixture of von Mises-Fisher (vMF) distributions [25]. David B Bracewell presented algorithms for category classification and topic discovery and classification of news articles. The news domain presents challenges that other domains do not. Dealing with online news demands online classification, topic discovery and classification with sparse training data [7]. In [4] building up on the meta-classifier presented, based on 8 SVM components, they add to these a new Bayes type classifier which leads to a significant improvement of the upper limit that the meta- classifier can reach.
Krishanalal developed the intelligent News Classifier and experimented with online news from web for the category Sports, Finance and Politics. The novel approach combining two powerful algorithms, Hidden Markov Model and Support Vector Machine, in the online news classification domain provides extremely good result compared to existing methodologies. By the introduction of several preprocessing techniques and the application of filters they reduced the noise to a great extent, which in turn improved the classification accuracy [12]. S.P.Deshpande represents overview of data mining system and some of its application. Information play important role in every sphere of human life. It is very important to gather data from different data sources, store and maintain the data. Generate the information. , generate knowledge and disseminate data, information and knowledge to every stakeholder. Due to vast use of computers and electronics devices and tremendous growth in computing power and storage capacity, there is explosive growth in data collection. The storing of the data in data warehouse enables entire enterprise to access a reliable current database [18]. Mita K. Dalal worked on text classification and feature extraction phases. Text classification can be automated successfully using machine learning techniques, however pre-processing and feature selection steps play a crucial role in the size and quality of training input given to the classifier, which in turn affects the classifier accuracy [17].Yiming Yang reported a controlled study with statistical significance tests on five text categorization methods: the Support Vector Machines (SVM), a k-Nearest Neighbor (kNN) classifier, a neural network (NNet) approach, the Linear Least- squares Fit (LLSF) mapping and a Naive Bayes (NB) classifier. They focus on the robustness of these methods in dealing with a skewed category distribution, and their performance as function of the training-set category frequency [35]. Rama Bharath Kumar developed stock market prediction tool. Stock market prediction is an attractive research problem to be investigated. News contents are one of the most important factors that have influence on market. Considering the news impact in analyzing the stock market behavior, leads to more precise predictions and as a result more profitable trades. So far various prototypes have been developed which consider the impact of news in stock market prediction. In this paper, the main components of such forecasting systems have been introduced.
The main objective is to predict the Classify the Financial News based on the contents of relevant news articles which can be accomplished by building a prediction model which is able to classify the news as either rise or drop [21]. Vandana Korde focused on the existing literature and explored the documents representation and an analysis of feature selection methods and classification algorithms. The growing use of the textual data needs text mining, machine learning and natural language processing techniques and methodologies to organize and extract pattern and knowledge from the documents. It was verified from the study that information Gain and Chi square statistics are the most commonly used and well performed methods for feature selection, however many other feature selection methods are proposed. Different algorithms perform differently depending on data collection. However, to the certain extent SVM with term weighted VSM representation scheme performs well in many text classification tasks [32]. Michael Scharkow introduced the conceptual foundations of machine learning approaches to text classification and discusses their application in social science research. They then evaluate their potential in an experimental study in which German online news was coded with established thematic categories [16]. Liang-Chih Yu proposed a contextual entropy model to expand a set of seed words by discovering similar emotion words and their corresponding intensities from online stock market news articles. This was accomplished by calculating the similarity between the seed words and candidate words from their contextual distributions using an entropy measure. Once the seed words have been expanded, both the seed words and expanded words are used to classify the sentiment of the news articles [14].
Yang Hui Rao proposed an efficient algorithm and three pruning strategies to automatically build a word-level emotional dictionary for social emotion detection. In the dictionary, each word is associated with the distribution on a series of human emotions.
In addition, a method based on topic modeling is proposed to construct a topic-level dictionary, where each topic is correlated with social emotions [34]. S.Lauren combined simple moving average and news classification to predict stock trend more responsively. They use machine learning using artificial neural network to combine the two aspects [22]. L.Cui proposed a hierarchy method based on LDA and SVM. They first introduce the significance of news classification. Then, the concepts of topic model and SVM are introduced. They also did algorithm parameter adjusting [13].Z.Li juan introduces the characteristics of Vietnamese news, on which the trigger words are selected; next, determine the event type based on the title, keywords and trigger words; finally, achieve the classification of Vietnamese news events through the event template and combining with the maximum entropy model [38]. W.Weng explored a combination of softmax regression model and the structured data of stocks to develop a structure-based classification model for stock news, which weights the probability output by the softmax regression model and the structured data to get the final probability values, and finally classifies the news by the classification selection algorithm [33]. Dadgar proposed an approach to classify news texts. This approach was comprised of three different steps: 1) text preprocessing, 2) feature extraction based on TF-IDF, and 3) classification based on SVM. They trained the approach through the SVM classifier which was selected because it could support data with high dimensions [23].Ivana Clairine proposed hierarchical multilevel classification, which is used to decide the class and subclass of every single news using problem transformation approach [43]. Jinyan Li compares the performance of different filters and classification algorithms for the task of sentiment analysis [11]. Toon De Pessemier investigates whether users utilize a mobile news service in different contextual situations and whether the context has an influence on their consumption behavior. Furthermore, the importance of context for the recommendation process is investigated by comparing the user satisfaction with recommendations based on an explicit static profile, content-based recommendations using the actual user behavior but ignoring the context, and context aware content-based recommendations incorporating user behavior as well as context
[31].Yongsung Kim proposed a platform called TNIE that utilizes 
Twitter in the NIE environment. TNIE consists of three main components: PNE, NV, and SCLT. TNIE demonstrated many advantages compared to traditional NIE: (1) it provided an automatic classification of the latest news based on the topics, (2) it provided a hierarchical visualization for the classified news content, and (3) it provided an easy tool for creating collaboration groups and generating a report based on the collaboration [36]. Yu-Chen Wi constructed an Aggregate News Sentiment Index ANSI with the incorporation of public news relating to each of the individually listed firms. They propose appropriate hypotheses to facilitate our investigation of the relationships between the ANSI, market returns, trading value, turnover ratio and Taiwan volatility index [37]. Sreenath G Anavatti presented a new paradigm of web news mining using an evolving algorithm, namely the eT2Class. In the work, the efficacy of the eT2Class has been demonstrated and has been proven to be very effective in comparison to state-of-the art algorithms [3]. In the previous research work the manual system were into action as the people were used to extract the news manually. If talk about sports then there is no classification of e- sports into its type like cricket, hockey, football etc. Same way news about e-entertainment there is no classification about type of e-entertainment like Hollywood,  Bollywood can be possible.
III. Classification Approaches
An algorithm that implements classification, especially in a concrete implementation, is known as a classifier. There are various types of classification algorithms that are widely used for the classification of the data that includes- Linear classifiers, SVM(Support Vector Machine), Quadratic classifier, Kernel estimation, Boosting (meta-data), Decision trees, Neural Networks, Learning vector quantization. Classifier performance depends greatly on the characteristics of the data to be classified. There is no single classifier that works best on all given problems. Various empirical tests have been performed to compare classifier performance and to find the characteristics of data that determine classifier performance. In the existing studies SVM classifier approach is implemented to support the data with high dimensions. A controlled study with statistical significance is reported which involves SVM, KNN classifiers and other approaches. But the SVM classifier has limited speed and size, both in training and testing. Discrete data presents another problem. The most serious problem with SVMs is the high algorithmic complexity and extensive memory requirements of the required quadratic programming in large-scale tasks. In case of KNN classifier distance based learning is not clear which type of distance is to use and which attribute is used to produce better results. Computation cost for KNN classifier is high because we need to compute distance of each query instance to training samples. To overcome the limitations of existing studies ANN algorithm can be used as it is requiring less formal statistical training, ability to implicitly detect complex nonlinear relationships between dependent and independent variables, ability to detect all possible interactions between predictor variables, and the availability of multiple training algorithms. Furthermore, while neural networks are excellent and crunching large amounts of data, this advantage lessens relative to the size of a data sample. Neural networks have the ability to learn (in a limited sense), making them the closest model available to a human operator.
IV. Conclusion
As data mining is widely used in all the fields to store the records and also for online transactions. It has a tremendous use in online news classification. Various approaches are used for the news classification that provides interesting results. There have been a lot of work for the outer classification but there has been a very less amount of work for inner classification of news. Inner classification of news is required to obtain the information quickly. There is need to modify the current evaluation techniques of the classification of the online news and to make the inner classification so that a better efficient model can be generated to reduce the burden of the manual system of data entry of the online news classification.
References
[1]	Bing Liu,“Sentiment Analysis and Opinion Mining” Human Language Technologies, pp. 1-167, 2012. 
[2]	Chee-Hong Chan Aixin Sun Ee-Peng Lim, “Automated Online News Classification with Personalization,” 4th International Conference on Asian Digital Libraries (ICADL2001), Bangalore, pp. 320-329, 2001. 
[3]	Choiru Za’in, Mahardhika Pratama, Edwin Lughofer, Sreenatha G. Anavatti, “Evolving type-2 web news mining”, Published in: Applied Soft Computing, Vol. 54, pp. 200–220, May 2017. 
[4]	D. Morariu, R. Cre¸tulescu, L. Vin¸tan, “Improving a SVM Meta-classifier for Text Documents by using Naïve-Bayes,” Int. J. of Computers, Communications & Control, Vol. 3, pp. 351-361, 2010. 
[5]	D. Rahmawati, M. L. Khodra,“Automatic multilabel classification for Indonesian news articles,” 2nd International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA), Chonburi, Thailand, pp. 1-6, 2015. 
[6]	Daniel I. Morariu, Lucian N. Vintan, Volker Tresp, “Meta-Classification using SVM Classifiers for Text Documents”, World Academy of Science, Engineering and Technology 21, pp. 15-20, 2006. 
[7]	David B. Bracewell, Jiajun Yan, Fuji Ren, Shingo Kuroiwa, “Category Classification and Topic Discovery of Japanese and English News Articles”, In Electronic Notes in Theoretical Computer Science, Vol. 225, pp. 51-65, 2009.
[8]	E. Kiliç, M. R. Tavus, Z. Karhan, “Classification of breaking news taken from the online news sites,” In Signal Processing and Communications Applications Conference (SIU), Malatya, Turkey, pp. 363-366, 2015. 
[9]	[Online] Available: http://www.web-datamining.net/usage/ 
[10]	Hyeran Byun, Seong Whan Lee,“Application of support vector machine for pattern recognition: A survey,” In Lecture Notes in Computer Science (LNCS), Vol. 2388, pp. 213-236, Springer Verlag Berlin Heidelberg, 2002. 
[11]	Jinyan Li, Simon Fong, Yan Zhuang, Richard Khoury, “Hierarchical classification in text mining for sentiment analysis of online news”, In Soft Computing, Issue 9, Vol. 20, pp. 3411–3420, 2016. 
[12]	Krishnalal G, S Babu Rengarajan, K G Srinivasagan,“A new text mining approach based on HMM -SVM for web news classification”, International Journal of Computer Applications, Vol. 1, Issue 19, pp. 98-104, 2010. 
[13]	L. Cui, F. Meng, Y. Shi, M. Li, A. Liu,“A Hierarchy Method Based on LDA and SVM for News Classification,” 2014 IEEE International Conference on Data Mining Workshop, ICDM Workshops 2014, Shenzhen, China, pp. 60-64, 2014. 
[14]	Liang-Chih Yu, Jheng-Long Wu, Pei-Chann Chang, Hsuan-Shou Chu,“Using a contextual entropy model to expand emotion words and their intensity for the sentiment classification of stock market news”. In Knowledge-Based Systems, Vol. 41, pp. 89–97, 2013. 
[15]	M. Hu, B. Liu.,“Mining opinion features in customer reviews”, In the 19th National Conference on Artificial Intelligence, Vol. 4, Issue 4, San Jose, California, pp. 755– 760, 2004. 
[16]	Michael Scharkow,“Thematic content analysis using supervised machine learning: An empirical evaluation using German online news”, In Quality & Quantity, Vol. 47, Issue 2, pp. 761–773, 2013. 
[17]	Mita K. Dalal, Mukesh A.Zaveri,“Automatic text classification: A technical review,” In International Journal of Computer Applications, Vol. 28, Issue 2, pp. 37-40, 2011. 
[18]	Mr. S.P Deshpande, Dr. V.M Thakre,"Data mining system and Applications: A review,” In International Journal of Distributed and Parallel System (IJDPS), Issue 1, Vol. 1, pp. 32-44, 2010. 
[19]	N. Jindal, B. Liu,“Identifying comparative sentences in text documents,” In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, Seattle, Washington, USA, pp. 244–251, 2006. 
[20]	NileshM. Shelke; ShriniwasDeshpande; Vilas Thakre, “Survey of Techniques for Opinion Mining,” Published in: International Journal of Computer Applications, Vol. 57, Issue 13, 2012. 
[21]	Rama Bharath Kumar, Bangari Shravan Kumar, Chandragiri Shiva Sai Prasad,“Financial news classification using SVM,” International Journal of Scientific and Research Publications, Vol. 2, Issue 3, pp. 1-6, 2012. 
[22]	S. Lauren, S. D. Harlili,"Stock trend prediction using simple moving average supported by news classification," International Conference of Advanced Informatics: Concept, Theory and Application (ICAICTA), Bandung, pp. 135-139, 2014. 
[23]	S. M. H. Dadgar, M. S. Araghi, M. M. Farahani,"A novel text mining approach based on TF-IDF and Support Vector Machine for news classification," 2nd IEEE International Conference on Engineering and Technology (ICETECH), Coimbatore, pp. 112-116, 2016. 
[24]	S. R. Das, M. Y. Chen,“Yahoo! For Amazon: sentiment extraction from small talk on the Web,” Management Science, Issue 9, Vol. 53, pp. 1375–1388, 2007. 
[25]	Shri Zhong, Joydeep Ghosh,“A Comparative study of generative models for document clustering,” The university of texas at Austin, TX 78712-1084, Vol. 4, Issue 1, 2008. 
[26]	Surajit Chandhuri, Umeshwar Dyal,“ An overview of data warehousing and OLAP technology,” Published in ACM Sigmod record, Vol. 26, Issue 1, pp. 65-74, USA, 1997.
[27]	Susan Dumais, John Platt, David Heckerman,“ Inductive learning algorithm and representation for text categorization”, In Conference of information and knowledge management (CIKM), pp. 148-155, 1998. 
[28]	Srivastava J., Cooley R., Deshpande M, Tan P.N. “Discovery and Applications of Usage Patterns from Web Data”, Appeared in SIGKDD Explorations, Vol. 1, Issue 2, 2000. 
[29]	T. Wilson, P. Hoffmann, S. Somasundaran, J. Kesseler, J. Wiebe, Y. Choi, C. Cardie, E. Riloff, S. Patwardhan, “Opinionfinder: a system for subjectivity analysis", In Proceedings HLT-Demo ‘05 Proceedings of HLT/EMNLP on Interactive Demonstrations, Canada, pp. 34–35, 2005. 
[30]	Thorsten Joachims,“Text Categorization With Support Vector Machines: Learning with many relevant features,” Published in: European Conference on Machine Learning (ECML 1998), Lecture notes in Computer Science Book series Springer Publications, Vol. 1398, pp. 137-139, 1998. 
[31]	Toon De Pessemier, Cédric Courtois, Kris Vanhecke, Kristin Van Damme, Luc Martens, Lieven De Marez,"A user-centric evaluation of context-aware recommendations for a mobile news service", In Multimedia Tools and Applications, Vol. 75, Issue 6, pp. 3323–3351, 2016. 
[32]	Vandana Korde, C Namrata Mahender,“Text classification and classifier a survey,” In International Journal of Artificial Intelligence & Applications (IJAIA), Vol. 3, Issue 2, 2012. 
[33]	W. Weng, Y. Liu, S. Wang, K. Lei,"A multiclass classification model for stock news based on structured data", 6th International Conference on Information Science and Technology (ICIST), Dalian, China, pp. 72-78, 2016. 
[34]	Yang hui Rao, Jingsheng Lei, Liu Wenyin, Qing Li, Mingliang Chen,"Building emotional dictionary for sentiment analysis of online news", In World Wide Web, Vol. 17, Issue 4, pp. 723–742, 2014. 
[35]	Yiming Yang, Xin Liu,"A re-examination of text categorization methods,” Caenegie Mellon University Pittsburg, PA 15213- 3702, USA, Vol. 18, Issue 2, 2012.
[36]	Yongsung Kim, Eenjun Hwang, Seungmin Rho,"Twitter news-in-education platform for social, collaborative, flipped learning", In The Journal of Supercomputing, Springer Publications, pp. 1–19, 2016. 
[37]	Yu-Chen Wei, Yang-Cheng Lu, Jen-Nan Chen, Yen-Ju Hsu,"Informativeness of the market news sentiment in the Taiwan stock market", In The North American Journal of Economics and Finance, Vol. 39, pp. 158–181, 2017. 
[38]	Z. Li-Juan, Z. Feng, P. Qing-qing, Y. Xin, Y. Zheng-tao, “A classification method of Vietnamese news events based on maximum entropy model,” 34th Chinese Control Conference (CCC), Hangzhou, China, pp. 3981-3986, 2015. 
[39]	Z. Yan,“EXPRS: An extended pagerank method for product feature extraction from online consumer reviews”, In: Information & Management, Issue 7, Vol. 52, pp. 850-858, 2015. 
[40]	Zhongwu Zhai, Bing Liu, HuaXu, Peifa Jia,“Clustering Product Features for Opinion Mining” In Proceedings of the fourth ACM International Conference on Web search and data mining, China, pp. 347-354, 2011. 
[41]	Xindong Wu, Vipin Kumar, J Ross Quinlan, Joydeep Ghosh, Qiang Yang, Hiroshi Motoda, Geoffrey J. McLachlan, Angus Ng, Bing Liu, Philip S. Yu, Zhi-Hua Zhou, Michael Steinbach, David J. Hand, Dan Steinberg,"Top 10 Algorithms in datamining”, Journal of Knowledge and Information Systems, Vol. 4, Issue 1, pp. 1-37, 2008. 
[42]	Seyyed Mohammad Hossein Dadgar, Mohammad Shirzad Araghi, Morteza Mastery Farahani,“A novel text mining approach based on TF-IDF and Support Vector Machine for news classification”, IEEE conference on Emerging and Technology, pp. 112-116, 2016, 
[43]	Ivana Clairine Irsan, Masayu Leylia Khodra, “Hierarchical Multilabel Classification for Indonesian News Articles",  International Conference on Advanced Informatics: Concepts, Theory and Application (ICAICTA2016), 2016.