Subversion Repositories navi

Compare Revisions

Ignore whitespace Rev 100 → Rev 101

/tsimapiak/parse2.py
99,7 → 99,7
return ret
 
def parsesent(sent):
sent = sent.strip().lower()
sent = sent.strip().lower().replace(u"’", u"'")
sent = re.sub(ur"[^\wìä' ]",u"",sent)
sent = re.sub(ur"\ +",u" ",sent)
sent = sent.split(u" ")