Seems cool. One more step towards a full operating systems manager.
I guess from the video, you use the toolformer library https://github.com/lucidrains/toolformer-pytorch, and it looks like they use the PalM model underneath.
How bound are your project/functionality to that specific model ? I'm planning to setup a local LLM, and would like a framework that can use the model I choose.