Openai/tiktoken module/function?

When doing any sort of advanced operations with OpenAI APIs, we have to “compute” how many tokens we’ve used and how many are left for each model to work with.

It would be wonderful if implemented an internal “tiktoken” either module or function that could simplify this work for us:
GitHub - openai/tiktoken: tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Hey again @dkindlund :wave:

Just like I mentioned over here, our Idea Exchange is the ultimate place for all sorts of ideas and suggestions related to Make / apps on Make. Feel free to log the idea in and see how many upvotes from other users it gets :slight_smile: