Do Large Language Models Dream of AI Agents?

During sleep, The human brain is secreted through different memories, and unifying that task while eliminating those that do not matter. What if Amnesty International could do the same?

Bilt, a company that offers local shopping offers and restaurants for tenants, has deployed several million agents in the hope of doing so.

Bilt uses technology from a start -up company called letta, which allows agents to learn from previous conversations and exchange memories with each other. Using a process called “Sleeptime Compute”, the agents decide the information that must be stored in the long -term memory cellar and what may be required to summon faster.

“We can make one update to [memory] “This is useful in any scenario as she wants an accurate control in the context of agents,” says Andrew Fitz, an Amnesty International engineer in Billlet, and she adds: “This is useful in any scenario where you want an accurate control in the context of the agents,” referring to the text overlooking the model at the time of reasoning.

Large linguistic models can usually “remember” things if the information is included in the context window. If you want to remember chatbot your latest conversation, you need to glue it in the chat.

Most of the artificial intelligence systems can only deal with a limited amount of information in the context window before its ability to use data stumbling and becomes confusing. In contrast, the human brain is able to provide useful information and call it later.

“Your mind is constantly improving and adding more information like sponge,” says Charles Baker, CEO of Letta. “With the language models, it is just like the opposite.

Packer and its founder Sarah Wooders have previously developed MemGPT, an open source project aimed at helping LLMS to identify information that must be stored in the short term for long -term memory. With letta, the duo expanded their approach to allowing agents to learn in the background.

Bilt with Letta is part of a wider batch to give artificial intelligence the ability to store and call useful information, which may make Chatbots more intelligent and agents less vulnerable to error. The memory remains backward in modern artificial intelligence, undermining the intelligence and reliability of artificial intelligence tools, according to the experts you spoke to.

Harrison Chase, founder and executive director of Langchain, another company that has developed a way to improve memory in artificial intelligence agents, says he sees memory a vital part of context engineering – where the user or engineer decides the information that must be fed in the window of context. Langchain offers companies several different types of memory storage for agents, from long -term facts about users to memories of modern experiences. “Memory, I would like to argue, is a form of context,” says Chis. “A large part of the function of the artificial intelligence engineer is basically to obtain the correct context model [information]”

AI tools are gradually less forgotten. Openai announced in February that Chatgpt will store relevant information in order to provide a more specialized experience for users – although the company did not reveal how this works.

Letta and Langchain make the summons more transparent for engineers who build artificial intelligence systems.

“I think it is very important not only to be open forms but also for memory systems open,” says Cleem Dylangoy, CEO of the ITTA.

It is interesting that the CEO of Letta hints that it may also be important to learn artificial intelligence models what you forget. “If one of the users said,” This project that we were working on, wipe it from your memory, “the agent must be able to return and rewrite each memory retrospectively.”

The idea of artificial memories and dreams makes me think Do you dream of Androids with electric sheep? Written by Philip K. Dick, a novel that bends the mind that inspired the elegant made film Blade. Big language models are not impressive yet like the rebellious symmetry of the story, but their memories seem to be completely fragile.

This is an edition of Will Fares Newsletter of the AI. Read the previous newsletters here.