X-Git-Url: https://git.distorted.org.uk/~mdw/sod/blobdiff_plain/d0be8052ee97b6d685ca9b73a4ccfa22ed04ccf5..1c2db39a35b4efe99594b2a53737d4f0971d01d8:/src/lexer-proto.lisp

diff --git a/src/lexer-proto.lisp b/src/lexer-proto.lisp
index 22d61c0..60235ff 100644
--- a/src/lexer-proto.lisp
+++ b/src/lexer-proto.lisp
@@ -112,6 +112,11 @@
 		      &rest token-types)
   "Discard tokens until we find one listed in TOKEN-TYPES.
 
+   Each of the TOKEN-TYPES is an expression which evaluates to either a
+   two-item list (TYPE VALUE), or a singleton TYPE; the latter is equivalent
+   to a list (TYPE t).  Such a pair matches a token with the corresponding
+   TYPE and VALUE, except that a VALUE of `t' matches any token value.
+
    If KEEP-END is true then retain the found token for later; otherwise
    discard it.  KEEP-END defaults to true if multiple TOKEN-TYPES are given;
    otherwise false.  If end-of-file is encountered then the indicator list is