GitHub - OthersideAI/self-operating-computer: A framework to enable multimodal models to operate a computer.
First, here a generalized framework for an autonomous agent :
- Initialize Goal : Define the objective for the AI.
- Task Creation : The AI checks its memory for the last X tasks completed (if any), and then uses it’s objective, and the context of it’s recently completed tasks, to generate a list of new tasks.
- Task Execution : The AI executes the ta