about summary refs log tree commit diff
path: root/src/libsyntax/parse/lexer/tokentrees.rs
AgeCommit message (Collapse)AuthorLines
2018-06-09Crate-ify and delete unused code in syntax::parseMark Simulacrum-1/+1
2018-05-18rustc: Fix joint-ness of stringified token-streamsAlex Crichton-11/+12
This commit fixes `StringReader`'s parsing of tokens which have been stringified through procedural macros. Whether or not a token tree is joint is defined by span information, but when working with procedural macros these spans are often dummy and/or overridden which means that they end up considering all operators joint if they can! The fix here is to track the raw source span as opposed to the overridden span. With this information we can more accurately classify `Punct` structs as either joint or not. Closes #50700
2017-08-30Make fields of `Span` privateVadim Petrochenkov-4/+3
2017-08-15use field init shorthand EVERYWHEREZack M. Davis-1/+1
Like #43008 (f668999), but _much more aggressive_.
2017-06-26Implement `quote!` and other `proc_macro` API.Jeffrey Seyfried-4/+8
2017-03-03Integrate `TokenStream`.Jeffrey Seyfried-13/+11
2017-01-23Remove `open_span` and `close_span` from `Delimited`.Jeffrey Seyfried-5/+1
2017-01-17Introduce `string_reader.parse_all_token_trees()`.Jeffrey Seyfried-0/+138