RESOURCES
Lexicons
Arabic WordNet ontology
Description: This improved version is an extension of the original Arabic Wordnet (http://globalwordnet.org/arabic-wordnet/awn-browser/), it was enriched by new verbs, nouns including the broken plurals that is a specific form for Arabic words.
Characters lexicon
Description: An LMF conformant XML-based file containing all Arabic characters (letters, vowels and punctuations). Each character described with a description, different displays (isolated, at the beginning, middle and the end of a word), a codification (Unicode, others could be added later), and two transliterations (Buckwalter and wiki). The lexicon is composed of 42 characters: the 28 known letters, 5 hamza forms, 9 special letters, 9 vowels and 3 punctuation marks.
Clitics (Enclitics)
Description: A XML-based file containing all Arabic enclitics and consisting of 14 atomic enclitics, which generates about 73 enclitics when applying their association rules.
Clitics (Proclitics)
Description: A XML-based file containing all Arabic proclitics and consisting of 12 atomic proclitics, which generates about 94 proclitics when applying their association rules.
Stop-words
Description: An XML-based file containing Arabic Stop-words respecting nouns, particle and verbs. This lexicon is composed by 27796 stop-words.
MORALEX-Morphology
Description: MORALEX is a lexicon of morphemes that includes 402 Moroccan Arabic affixes and clitics that were manually created and linguistically checked. Indeed, MORALEX is composed of 24 atomic affixes, 43 atomic clitics and 335 compound morphemes. The main advantage of this resource is its rich morphological information such as POS, form, and person, etc. It can be used in different contexts particularly in morphological tasks.
Triliteral roots
Description: This xml file is a lexicon containing all 21952 (28x28x28) Arabic triliteral combinations (roots). the file is split into three parts as follow: the first part contains the phonetic constraints that must be taken into account in the formation of Arabic roots (for more details see all_phonetic_rules.xml in http://arabic.emi.ac.ma/alelm/?q=Resources). the second part contains the lexicons that were used to create this lexicon (see in lexicons tag). the third part contains the roots.
Phonetic rules phonology
Description: this xml file describes the Arabic phonetic constraints (rules) resulting from the analysis of the lexicons(Taj Alarous, Al ain, Lisan Al arab, Alwassit and elke moassir ). These rules are to be applied to Arabic roots and are classified into a number of categories. Each category has a certain type of constraints as follow: The first category defines that the root must not consist of three identical letters. The second category defines that the root must not start with two repeating letters. The third category lists the letters that must not occur in the same root, regardless of their order. The fourth category lists the letters that may not be used together in a certain order in a root.
Addressed Arabic phonetic rules
Description: this xml file describes the Arabic phonetic constraints are to be applied on Arabic root. The first rule category lists the letters that may not occur in the same root, regardless of their order. The second category lists the letters that may not be used together in a root word with a specific order. The third and fourth categories show that each contiguous letters must not be redundant
Broken plural list
Description: An LMF conformant XML-based file containing a comprehensive Arabic broken plural list. The file contains 12,249 singular words with their corresponding BPs.
CALEM (Comprehensive Arabic LEMmas)
Description: Comprehensive Arabic LEMmas is a lexicon covering a large list of Arabic lemmas and their corresponding inflected word forms (stems) with details (POS + Root). Each lexical entry represents a lemma followed by all its possible stems and each stem is enriched by its morphological features especially the root and the POS.
It is composed of 164,845 lemmas representing 7,200,918 stems, detailed as follow:
757 Arabic particles
2,464,631 verbal stems
4,735,587 nominal stems
The lexicon is provided as an LMF conformant XML-based file in UTF8 encoding, which represents about 1,22 Gb of data.
It is composed of 164,845 lemmas representing 7,200,918 stems, detailed as follow:
757 Arabic particles
2,464,631 verbal stems
4,735,587 nominal stems
The lexicon is provided as an LMF conformant XML-based file in UTF8 encoding, which represents about 1,22 Gb of data.
MORV (Moroccan Morphological vocabulary)
Description: The Moroccan Morphological vocabulary is a lexicon containing more than 4.6 M entries describing a given Moroccan Arabic word with fourteen (14) morphological and semantic features: the word orthographic form, the segmentation (prefix and suffix), part-of-speech (POS), gender, number, tense and transitivity (for verbs), its origin, dialectal lemma, Arabic lemma, the root, voice, state, and affirmative/negative form. This vocabulary is provided as an xml file and represents more than 900 Mb of data.
Patterns lexicon
Description: This lexicon is composed of verbal and nominal patterns. Nominal patterns vary according to the categories to which they belong. These categories can be reduced to derivative, non derivative names and Massader.
Dictionaries
"Al wassit" Arabic dictionary
Description: An LMF conformant XML-based file containing the electronic version of al wassit dictionary. An Arabic monolingual dictionary accomplished by the Academy of the Arabic Language in Cairo. Al wassit dictionary is constitued by: 6900 roots, 61101 lexical entries (18199 verbs, 42731 nouns and 171 particles), 8821 examples (5231 verbs, and 3590 nouns) and 119140 meanings.
Contemporary
Description: An LMF conformant XML-based file containing the electronic version of al logha al arabia al moassira (Contemporary Arabic) dictionary. An Arabic monolingual dictionary accomplished by Ahmed Mukhtar Abdul Hamid Omar (deceased: 1424) with the help of a working group. The Contemporary dictionary material is composed by 5778 roots, 32300 lexical entries (10475 verbs, 21457 nouns and 368 particles), 29118 entries example and 43384 additional examples, 63019 meanings and 17883 contextual expressions.
MADED
Description: Moroccan Arabic Dialect Electronic Dictionary (MADED) is an electronic lexicon containing almost 11.500 entries. They are written in Arabic script wherein each Moroccan Arabic dialect (MA) lemma is provided with its corresponding Moden Standard Arabic (MSA) equivalent. In addition, MADED entries are annotated with useful metadata such as part-of-speech (POS), root and origin (Arabic, French, ...). This dictionary is provided as an xml file and represents about 1 Mb of data
Corpora
CLEF-TREC Q/A
Description: List of 2264 questions + answers of CLEF and TREC, translated to Arabic
Stemming evaluation NAFIS Gold Standard
Description: Normalized Arabic Fragments for Inestimable Stemming (NAFIS) is an Arabic stemming gold standard corpus composed by a collection of texts, selected to be representative of Arabic stemming tasks and manually annotated.
LID language Identification
Description: This resource is a corpus containing 34k Moroccan Colloquial Arabic sentences collected from different sources. The sentences are written in Arabic letters. This resource can be useful in some NLP applications such as Language Identification.
Spell checking
Description: The file represents a text corpus in the context of Arabic spell checking, where a group of persons edited different files, and all of the committed spelling errors by these persons have been recorded. A comprehensive representation these persons' profile has been considered: male, female, old-aged, middle-aged, young-aged, high and low computer usage users, etc. Through this work, we aim to help researchers and those interested in Arabic NLP by providing them with an Arabic spell check corpus ready and open to exploitation and interpretation. This study also enabled the inventory of most spelling mistakes made by editors of Arabic texts. This file contains the following sections (tags): people - documents they printed - types of possible errors - errors they made. Each section (tag) contains some data that explains its details and its content, which helps researchers extracting research-oriented results. The people section contains basic information about each person and its relationship of using the computer, while the documents section clarifies all sentences in each document with the numbering of each sentence to be used in the errors section that was committed. We are also adding the "type of errors" section in which we list all the possible errors with their description in the Arabic language and give an illustrative example.
Arabic ACL corpus
Description: This corpus constitutes all sentences representing the Arabic Controlled Language (ACL). It contains 551 sentences taken from four textbooks and websites dedicated to teach Arabic language to kids such as: a) First grade book, Republic of Sudan (كتاب الصف الاول جمهورية السودان), b) Al Jazeera Educational Site (موقع الجزيرة التعليمي), c) Bella Preparatory School Girls Forum (منتدى مدرسة بيلا الاعدادية بنات), and d) Albahr website (موقع انا البحر). These sentences are respecting 52 ACL rules. The average number of sentences for each rule is 10.6. All sentences in the corpus were analyzed by Farasa syntactic parser to confirm they are correctly analyzed. The validity of the parsing was done manually by linguist experts. The structure of this corpus is made of a header and a body. The header consists of a set of metadata that describe the corpus, such as the corpus name, the authors, the sources and further meta data. While the header is made of metadata, the body contains rules. Each rule has a code, a structure and all sentences respecting that rule. For each sentence, we store an id, the vowelledand unvowelled text as well as the result of parsing using Farasa.
Quranic stemming evaluation
Description: This is a reduced version of the Quranic corpus developed by Kais Dukes et al. (http://corpus.quran.com/). It contacins 18352 words with their stems, roots and lemmas. We created this reduced version to serve as stemming evaluation corpus:
Morphological evaluation
Description: An annotated corpus dedicated to the benchmark and evaluation of Arabic morphological analyzers. It consists of 100 words with all their possible analysis. The corpus contains several morphological information such as stem, pattern, root, lemma, etc...
Arabic Keywords Extraction Corpus
Description: Arabic Keywords Extraction Corpus (AKEC) is a corpus for the evaluation of keywords detection systems. It is composed of 2448 news articles, totaling approximately 4M tokens, sourced from a news website. Articles in the corpus span four distinct domains: Art, Economy, Politics, and Sport. The dataset was manually annotated with its corresponding keywords, indicated by a binary tag (1 for keyword, 0 otherwise).
