ReAct with short context lengths?

How do you use ReAct if the model has a small context window but the task is complex enough that the reasoning traces can take up more than 1 context window?

Will using context window extension tricks like interpolation on RoPE to extend 2K to 8K be compatible with the ReAct method?