> For the complete documentation index, see [llms.txt](https://furesoft.gitbook.io/silverfly/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://furesoft.gitbook.io/silverfly/basics/lexer.md).

# Lexer

The lexer is responsible for splitting your code into meaningful tokens. This framework offers an extensible lexer that can be easily configured. For simplicity the lexer emits two special tokens to determine the start and the end of the input. The SOF token represents the start of input and EOF the end of the input.

You can initialize the lexer by overriding the InitLexer method:

```csharp
protected override void InitLexer(LexerConfig lexer)
{
       
}
```