Article Preview
Top1. Introduction
The recent technological advances in web and storage have led to an explosion of data. Nowadays, internet can be viewed as a colossal database, mainly constituted by unstructured data, such as natural language text, scripts, pictures, movies, audio, etc. As a result, the information retrieval has become more complex and harder.
Web mining is the application of data mining techniques to extract knowledge from Web data, i.e. Web Content, Web Structure and Web Usage data (Lin, & Chu, 2005).
- 1.
Web usage mining is the application of data mining techniques to discover interesting usage patterns from Web data, in order to understand and better serve the needs of Web-based applications.
- 2.
Web structure mining is the process of discovering structure information from the Web.
- 3.
Web content mining is the process of extracting useful information from the contents of Web documents. Content data corresponds to the collection of facts a Web page was designed to convey to the users. It may consist of text, images, audio, video, or structured records such as lists and tables. Application of text mining to Web content has been the most widely researched. Issues addressed in text mining are, topic discovery, extracting association patterns, clustering of web documents and classification of Web Pages. Research activities on this topic have drawn heavily on techniques developed in other disciplines such as Information Retrieval (IR) and Natural Language Processing (NLP) (Lin, & Chu, 2005).
In the latest years, web mining was a major scientific research topic, and web page classification, also known as web page categorization was its main application. We want to perform a special kind of classification, which is by aimed nation such as Algerian, Nigerian, Turkish, Chinese, American, Russian, Canadian, etc.
The remainder of this paper is organized as follows: Section 2, will discuss the problematic and motivations. Section 3, will present the state-of-the-art. Section 4, will introduce our proposed approach and Section 5 will present experimentations.
Top2. Problematic And Objective
The Indexed Web contains at least 4.84 billion pages (Kunder, 01 February 2016). The aim of the researchers is to help find the targeted nation of a web page based on its content. The problem is a complex one given the following constraints:
- •
A web page content can be written in different languages such as Arabic, French, Chinese, English, Turkish, Russian, etc.
- •
Different countries may use the same language. For example, Arabic countries (Algeria, Tunisia, Egyptian, etc.) use Arabic language.
- •
A web page content can be generic.
- •
A single country can use multiple languages such as Switzerland.
- •
A web page can have a generic tld ('.com', '.org', '.net', etc.).
- •
Web site can be hosted anywhere in the world, and created by a foreign person from the aimed nation.
The main motivation of this work is that it will allow:
- •
Conceiving focused crawler to index web pages by aimed nation.
- •
Increasing the efficiency of search engines when performing better research about a specific nation.
- •
Building database of web pages indexed by nation for dedicated research.
- •
Broadcasting focused advertisement by country.
- •
Performing different specific studies by country.
- •
Filtering particular nation web pages.
- •
Etc.