Subversion Repositories navi

Compare Revisions

Ignore whitespace Rev 99 → Rev 100

/tsimapiak/parse2.py
100,7 → 100,7
 
def parsesent(sent):
sent = sent.strip().lower()
sent = re.sub(ur"[^\wìä ]",u"",sent)
sent = re.sub(ur"[^\wìä' ]",u"",sent)
sent = re.sub(ur"\ +",u" ",sent)
sent = sent.split(u" ")
ret = []