Tryag File Manager
Home
-
Turbo Force
Current Path :
/
home
/
cluster1
/
data
/
bu01
/
1121861
/
html
/
TMAT
/
tmat
/
Upload File :
New :
File
Dir
//home/cluster1/data/bu01/1121861/html/TMAT/tmat/tokenizer.pyc
mò Ø¡öFc @ sY d k l Z l Z d e f d „ ƒ YZ d e f d „ ƒ YZ d e f d „ ƒ YZ d S( ( s Interfaces Attributet TokenizerErrorc B s t Z RS( N( t __name__t __module__( ( ( t C:\Backup\TMAT\tmat\tokenizer.pyR s t MyInterfacec B s t Z d „ Z RS( Nc C sK | i | ƒ } | | | <y | i | | ƒ Wn | i | | ƒ n Xd S( N( t selft gett attrt dictt valuet keyt sett setTaggedValue( R R R R R ( ( R t setDict s ( R R R ( ( ( R R s t TokenizerPluginc B sk t Z d Z e d ƒ Z e d ƒ Z e d ƒ Z e d ƒ Z d „ Z d „ Z d „ Z d „ Z d „ Z RS( s0 A python interface to a tokenizer of some sort s The tokenizer has been started s The name of the tokenizer s/ A dictionary of config values and their types s7 A dictionary of configurable options and their values c C s$ x | i D] } t d ƒ } q Wd S( Ns' An on-the-fly storage spot for %s" % p( R t preferencest pt Attribute( R R ( ( R t __init__ s c C s d S( s Start the tokenizer N( ( R ( ( R t start s c C s d S( s Stop the tokenizer N( ( R ( ( R t stop s c C s d S( s Split the text N( ( R t text( ( R t tokenize s c C s d S( s, Return the version string of the tokenizer N( ( R ( ( R t version s ( R R t __doc__R t runningt displayNameR t valuesR R R R R ( ( ( R R s N( t zope.interfacet InterfaceR t ExceptionR R R ( R R R R R ( ( R t ? s