Make a test loop in a scenario

Like I mentioned in your other question, you can replace point three with “Reduce number of max tokens” (and try again).

One way to reduce the number of tokens per repeat, is by using a negative “step” in the Repeater module.

Screenshot_2024-01-08_210151

This starts of with 500, then 400, then 300

Screenshot_2024-01-08_210109

Then, you can insert this variable into the Max Tokens field.

Screenshot_2024-01-08_210114

3 Likes