GLOBAL_TOKENIZER
cellstate_
core
0.5.0
In cellstate_
core::
llm
cellstate_core
::
llm
Static
GLOBAL_
TOKENIZER
Copy item path
Source
static GLOBAL_TOKENIZER:
OnceLock
<
Arc
<dyn
Tokenizer
>>