Edge case: all tokens are special tokens or ignored Return infinity to indicate no meaningful bytes were processed
Bhaskar