lexer: rewrite

Rewrite the lexer into a restartable state machine to support parsing from
file streams without the need to read the entire source text into memory
first.

As a side effect, the length of labels and strings is unlimited now.

Signed-off-by: Jo-Philipp Wich <jo@mein.io>

1 files changed, 2 insertions, 2 deletions

diff --git a/parser.y b/parser.y
index 11bf3b6..0ee4f30 100644
--- a/parser.y
+++ b/parser.y
@@ -86,9 +86,9 @@ ut_no_empty_obj(struct ut_state *s, uint32_t off)
 	s->error.code = UT_ERROR_UNEXPECTED_TOKEN;
 
 	if (op)
-		s->off = op->off;
+		s->lex.off = op->off;
 
-	for (i = 0; i < sizeof(tokennames) / sizeof(tokennames[0]); i++)
+	for (i = 0; i < __T_MAX; i++)
 		if (yy_find_shift_action(yypParser, (YYCODETYPE)i) < YYNSTATE + YYNRULE)
 			ut_set_error_token(s, i);
 }