diff options
| author | Sergio Benitez <sb@sergio.bz> | 2018-11-16 23:37:23 -0800 |
|---|---|---|
| committer | Sergio Benitez <sb@sergio.bz> | 2018-11-16 23:37:23 -0800 |
| commit | 78eb516dda4ed811bfb010f7a69e8eac0fe6ce80 (patch) | |
| tree | d55551717d3ac900396244e5c86855bb0ee36b06 /src/libsyntax/parse | |
| parent | 4ec0ba9545f7c848aafc0bc1b8762507395edd41 (diff) | |
| download | rust-78eb516dda4ed811bfb010f7a69e8eac0fe6ce80.tar.gz rust-78eb516dda4ed811bfb010f7a69e8eac0fe6ce80.zip | |
Ignore non-semantic tokens for 'probably_eq' streams.
Diffstat (limited to 'src/libsyntax/parse')
| -rw-r--r-- | src/libsyntax/parse/token.rs | 5 |
1 files changed, 3 insertions, 2 deletions
diff --git a/src/libsyntax/parse/token.rs b/src/libsyntax/parse/token.rs index 1c6fc1ac185..46fc6454d1c 100644 --- a/src/libsyntax/parse/token.rs +++ b/src/libsyntax/parse/token.rs @@ -570,8 +570,9 @@ impl Token { // // Instead the "probably equal" check here is "does each token // recursively have the same discriminant?" We basically don't look at - // the token values here and assume that such fine grained modifications - // of token streams doesn't happen. + // the token values here and assume that such fine grained token stream + // modifications, including adding/removing typically non-semantic + // tokens such as extra braces and commas, don't happen. if let Some(tokens) = tokens { if tokens.probably_equal_for_proc_macro(&tokens_for_real) { return tokens |