Regexp tokenizer/scanner in Go.
The scanner takes in a list of token definitions and string input. it is general and easy to use.
a token is a pair of constant and regexp string.
-
Notifications
You must be signed in to change notification settings - Fork 7
general tokenizer/scanner in Go
License
taylorchu/toki
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
general tokenizer/scanner in Go
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published