Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

a dynamically updatable memory block or prompt token section #1832

Open
Steven-Owens opened this issue Oct 5, 2024 · 0 comments
Open

a dynamically updatable memory block or prompt token section #1832

Steven-Owens opened this issue Oct 5, 2024 · 0 comments
Assignees

Comments

@Steven-Owens
Copy link

Context
I am trying to make an AI streamer and want to give it an emotional state.

Is your feature request related to a problem? Please describe. (i.e. Problem statement)
While it is fully possible to implement the emotional state as a memory block and in that solution it is possible to overwrite the memory block’s value when the LLM calls an emotion updating function. However it is currently not possible to have the emotional state to auto-update or have a process other than the LLM itself update the emotional state memory block.

Describe the solution you'd like (i.e. Proposed solution)
a memory heartbeat function or a type of section in the prompt tokens that can be dynamically updated by an ‘outside’ process (either during agent steps, chain of thought steps, or between chain of thoughts)

Other use cases
separating interaction with users from the LLM own thoughts (I.e. by implementing a separate FIFO queue for it that can be updated while the agent is still “thinking”). Might also be useful if the agent’s output is being post processed (like by a filter or moration system) to keep the agent informed of what is happening outside.
extension of the previous separate FIFO queues for different classes of users (for example one for humans (Via a ASR system) and/or AI (via a text interface) and others for each of the streaming platform text chat in my streaming use case)

other info
I am a software engineer and have looked over the code in question and think I can add the functionality require once the community the best way to implement it

@sarahwooders sarahwooders self-assigned this Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: To triage
Development

No branches or pull requests

2 participants