Function register_global_tokenizer 

pub fn register_global_tokenizer(tokenizer: Arc<dyn Tokenizer>) -> bool

Register a global tokenizer used by estimate_tokens.

Returns false when a tokenizer has already been registered.