nebius.base.token_sanitizer.TokenVersionExtractor

class documentation

class TokenVersionExtractor(ABC): (source)

Define the interface that identifies a token version.

Subclasses must implement extract.

Method extract Get the token version from a token string.

@abstractmethod
def extract(self, token: str) -> tuple[TokenVersion, bool]: (source) ¶

overridden in nebius.base.token_sanitizer.DefaultTokenVersionExtractor

Get the token version from a token string.

Parameters
token:`str`	The token string to analyze.
Returns
`tuple[TokenVersion, bool]`	A tuple containing the TokenVersion and a boolean indicating whether the token was recognized.