Struct defaultTokenizer

pkg/drain/line_tokenizer.go:18–18

defaultTokenizer is the default implementation of the LineTokenizer interface. It tokenizes a line into a list of tokens using a simple state machine. This is the main point of customization for the DRAIN algorithm, and is largely domain-specific.

// machine. This is the main point of customization for the DRAIN algorithm, and
// is largely domain-specific.
type defaultTokenizer struct{}

var _ LineTokenizer = (*defaultTokenizer)(nil)