Article

Finite-State Technology

Lauri Karttunen

in The Oxford Handbook of Computational Linguistics

Published in print January 2005 | ISBN: 9780199276349
Published online September 2012 | | DOI: http://dx.doi.org/10.1093/oxfordhb/9780199276349.013.0018

Series: Oxford Handbooks in Linguistics

 Finite-State Technology

More Like This

Show all results sharing these subjects:

  • Linguistics
  • Computational Linguistics

GO

Show Summary Details

Preview

The article introduces the basic concepts of finite-state language processing: regular languages and relations, finite-state automata, and regular expressions. Many basic steps in language processing, ranging from tokenization, to phonological and morphological analysis, disambiguation, spelling correction, and shallow parsing, can be performed efficiently by means of finite-state transducers. The article discusses examples of finite-state languages and relations. Finite-state networks can represent only a subset of all possible languages and relations; that is, only some languages are finite-state languages. Furthermore, this article introduces two types of complex regular expressions that have many linguistic applications, restriction and replacement. Finally, the article discusses the properties of finite-state automata. The three important properties of networks are: that they are epsilon free, deterministic, and minimal. If a network encodes a regular language and if it is epsilon free, deterministic, and minimal, the network is guaranteed to be the best encoding for that language.

Keywords: finite-state languages; transducers; networks; linguistic applications; restriction; replacement; finite-state automata

Article.  6776 words. 

Subjects: Linguistics ; Computational Linguistics

Full text: subscription required

How to subscribe Recommend to my Librarian

Buy this work at Oxford University Press »

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.