Fragmentation
ReferencesChoices which affect how a string is split into Fragments. These have to be made up front, because they change what the characters mean rather than what is done with them afterwards.
Enum values
| Name | Value | Description |
|---|---|---|
| Baseline | 0 | Whitespace, linebreaks, numbers, words, brackets and symbols. |
| CStyleLineComments | 1 | Two slashes begin a comment which runs to the end of the line. |
| CStyleBlockComments | 2 | A slash and an asterisk begin a comment which runs to a matching pair in reverse. a missing pair yields a defect. |
| AllCStyleComments | 3 | All supported comment delimiters. |
| PythonComments | 4 | A hash begins a comment which runs to the end of the line. Common in shell, Python and YAML style notations. Note that a hash also introduces a hexadecimal number, and comments are recognised first, so this option and Hexadecimal cannot both be useful at once. |
| LispComments | 16 | A semicolon begins a comment which runs to the end of the line. Common in ini files and lisps. |
| SingleQuotes | 256 | Single quotes delineate a text literal. |
| DoubleQuotes | 512 | Double quotes delineate a text literal. |
| AllQuotes | 768 | Both quote characters. |
| Escapes | 1024 | A backslash inside a text literal escapes the character following it. Turn this off for notations which carry Windows path URIs. |
| Hexadecimal | 65536 | A hash followed by hex digits is a number, i.e. "#FF8800". |
| Default | 67331 | C style comments, both quote characters, escapes and hexadecimal numbers. Bracket shapes must agree. |
| FlexibleBrackets | 16777216 | A bracket pair whose two ends have different shapes is acceptable rather than a defect. Required for half open interval notation such as "[5,8)", and best enabled only where such notation is expected, since it otherwise hides a common typing mistake. |
| Intervals | 16844547 | The default choices, plus tolerance of the mismatched bracket pairs which half open interval notation depends on. |