Browsing by Subject "Tokenisation"

Now showing items 1-2 of 2

    • Outomatiese Afrikaanse tekseenheididentifisering 

      Puttkammer, Martin Johannes (North-West University, 2006)
      An important core technology in the development of human language technology applications is an automatic morphological analyser. Such a morphological analyser consists of various modules, one of which is a tokeniser. At ...

    • Tswana finite state tokenisation 

      Pretorius, Laurette; Viljoen, Biffie; Berg, Ansu; Pretorius, Rigardt (Springer, 2015)
      Tswana, a Bantu language in the Sotho group, is characterised by an agglutinative morphology and a disjunctive orthography, which mainly affects the verb category. In particular, verbal prefixes are usually written ...