The new lakebase tokenizer extension lets you control how Lakebase Search turns text into search terms, so keyword search matches the way your data and users actually read.
The new lakebase tokenizer extension lets you control how Lakebase Search turns text into search terms, so keyword search matches the way your data and users actually read. Native PostgreSQL full text search gives you little control over this step. lakebase tokenizer adds a configurable whole word tokenizer through PostgreSQL's standard text search dictionary interface, with the controls that matter for relevance: Normalization: lowercase text, apply Unicode normalization for byte stable matching, and strip accents so café matches cafe.
Stemming and possessives: reduce words to their root with a native English stemmer and strip trailing 's, so running matches run and John's matches john.
The new lakebase tokenizer extension lets you control how Lakebase Search turns text into search terms, so keyword search matches the way your data and users actually read. Native PostgreSQL full text search gives you little control over this step.
Read the full documentation ↗