3 ***DISCLAIMER***: _These notes are from the defunct k8 project which_
4 _precedes SquirrelJME. The notes for SquirrelJME start on 2016/02/26!_
5 _The k8 project was effectively a Java SE 8 operating system and as such_
6 _all of the notes are in the context of that scope. That project is no_
7 _longer my goal as SquirrelJME is the spiritual successor to it._
11 For the context tokenizer, I should make it easier for the compiler.
15 Everything from the tokenizer will just be an enumeration so that equals on a
16 String will never be the case. I will need to rename the old tokenizer to make
21 The hasNext for tokenizer should just add any tokens which are added.
25 Having the checks for syntax validity in the second level tokenizer makes
26 parsing the code much easier because everything is as to be expected when it