Interface ITokenizer

Direct known implementers

Yep\Tokenizer\PhpTokenizer, Yep\Tokenizer\Tokenizer

Namespace: Yep\Tokenizer
Located at ITokenizer.php

Methods summary
`public`	# `tokenize( $code )`

Constants summary
`integer`	`TYPE`	# `1`
`integer`	`VALUE`	# `2`
`integer`	`POSITION`	# `4`
`integer`	`OFFSET`	# `8`
`integer`	`LENGTH`	# `16`