Is there a way to count tokens?

[Samuel]

@Samuel

have text stored in a “get multiple variables” module, and I’ve calculated its token count with your module. If the token count exceeds a specific limit (eg. 50,000 tokens), what’s the best way to truncate the text to match that limit? Using the ‘slice’ function?

What’s the best way to truncate text? Thanks!