Corpex - Corpora Explorer

Corpex let you swiftly browse through all the words of Wikipedia.It displays the context of characters and words within the text of different language versions of Wikipedia.

Settings

At first choose the desired language version of Wikipedia. Then you can type the first letters of a word and Corpex shows the first results. At the moment Corpex can handle only lowercase letters.

Corpex is also available as a restful webservice, simply call http://km.aifb.kit.edu/sites/corpex/corpex.php?lang=XX&q=Y with XX being the Wikipedia language code (see below) and Y being the starting letter sequence. You will get back a JSON result with the same data that you see on the page.
The bigrams statistics are available through http://km.aifb.kit.edu/sites/corpex/corpex.php?lang=XX&q=Y with XX being two "+"-separated words representing the bigram in question, e.g. "star+wars".

Results

When you start typing, the system shows you three statistics in six graphs. These are from left to right in the first row

1. the ten most frequent words that start with the typed sequence of letters (as a barcharts and a piechart),
2. the most frequent letter following the already typed sequence of letters (again, as a barchart and a piechart), and
3. both charts in the second row show the most frequend second word of all two-word-terms that start with the typed sequence as first word.

In any case three dots (...) mean "other word/letter", the dollar sign ($) means "end of the word/end of sentence".

Uses

In the current version of the tool Corpex particularly interesting for researchers which analyze Corpora or do similar things. Perspectively, the results get more practical use, if you can involve the temporal course in the observations. For example, to investigate whether a language version tends to a certain recent political orientation. That can be done with identifying the frequency of characteristic words, phrases or expressions over time.

Corpex is still very much under development. The currently extracted data is still very noisy, and we are currently working on better extraction and filtering approaches. The source code is fully open source, and all the data is also freely available. Feedback, and especially suggestions for cooperation, is welcome.

Supported languages

Corpex as well as the extracted n-grams are currently available in the following languages:

Code	Country	1-grams	2-grams
bg	Bulgarian	bg_1-grams.csv.zip	bg_2-grams.csv.zip
bs	Bosnian	bs_1-grams.csv.zip	bs_2-grams.csv.zip
cs	Czech	cs_1-grams.csv.zip	cs_2-grams.csv.zip
de	German	de_1-grams.csv.zip	de_2-grams.csv.zip
en	English	en_1-grams.csv.zip	en_2-grams.csv.zip
es	Spanish	es_1-grams.csv.zip	es_2-grams.csv.zip
fr	French	fr_1-grams.csv.zip	fr_2-grams.csv.zip
hr	Croatian	hr_1-grams.csv.zip	hr_2-grams.csv.zip
hu	Hungarian	hu_1-grams.csv.zip	hu_2-grams.csv.zip
it	Italian	it_1-grams.csv.zip	it_2-grams.csv.zip
ro	Romanian	ro_1-grams.csv.zip	ro_2-grams.csv.zip
sh	Serbo-Croatian	sh_1-grams.csv.zip	sh_2-grams.csv.zip
sq	Albanian	sq_1-grams.csv.zip	sq_2-grams.csv.zip
sr	Serbian	sr_1-grams.csv.zip	sr_2-grams.csv.zip
sv	Swedish	sv_1-grams.csv.zip	sv_2-grams.csv.zip
simple	Simple English	simple_1-grams.csv.zip	simple_2-grams.csv.zip
brown	Brown Corpus

More languages are being prepared.