public class Tokenizer
extends java.io.StreamTokenizer
implements java.io.Serializable
Constructor and Description |
---|
Tokenizer(java.io.Reader text)
creating a tokenizer for the source stream
|
Tokenizer(java.lang.String text) |
Modifier and Type | Method and Description |
---|---|
int |
lineno() |
int[] |
offsetToRowColumn(int offset) |
alice.tuprolog.Token |
readToken()
reads next available token
|
int |
tokenOffset() |
int |
tokenStart() |
public Tokenizer(java.lang.String text)
public Tokenizer(java.io.Reader text)
public alice.tuprolog.Token readToken() throws InvalidTermException, java.io.IOException
InvalidTermException
java.io.IOException
public int lineno()
lineno
in class java.io.StreamTokenizer
public int tokenOffset()
public int tokenStart()
public int[] offsetToRowColumn(int offset)