lexer: improve token position reporting

 - Report end position for emitted tokens. This is required to reliably
   determine the token length, e.g. for downstream code intelligence
   use cases

 - Fix start offset of continued template literal string tokens.
   Previously the start offset of a literal string following a `${...}`
   placeholder expressions was shifted by one byte

 - Report proper start offset of `TK_LEXP` tokens.

Signed-off-by: Jo-Philipp Wich <jo@mein.io>

0 files changed, 0 insertions, 0 deletions