Text Segmentation

In all modem TTS systems we make extensive use of a lexicon. The issue of lexicons is in fact quite complicated, and we discuss this in full in Chapter 8 when we start to talk about pronunciation in detail. For our current purpose, its main use is that it lists the words that are known to the system, and that it defines their written form. A word may have more than one written form (labour and labor) and two words may share the same written form polish etc. It is by using a lexicon as a place to define what is a possible word and what its written forms may be, that we can use the decoding model we are adopting in this book. 

Now that we know what we are looking for (underlying words) we can turn our attention to the problem of how to extract these from text. While in principle this could be achieved in a single process, it is common in TTS to perform this in a number of steps. In this section 

---

Jain, A., and S. Bhattacharjee. 1992. Text segmentation using gabor filters for automatic document processing. Machine Vision Applications 5 169-184. 

---