www.memoryplugin.com

Long term memory for dozens of AI tools, designed for power users who want more control and flexibility than native memory systems and who do not want to be locked into any one platform. You can also have the system remember your entire chat history going back years and use this information to help you better in new chats, it sometimes makes chats 10x more useful when I say something like: “Using recall tool, do 10+ calls for 1000 tokens context each to learn about my interests, strengths, curiosities, what I’ve tried in the past, what worked, what didn’t, etc and suggest a new hobby I would enjoy”.

Without long term recall, AI is a super intelligence in your hands that uses the knowledge of the world to give you generic, nearly useless advice because of how generic it is. With long term memory, you have a super-intelligence that knows YOU. This is what MemoryPlugin solves for.

Comments URL: https://news.ycombinator.com/item?id=45889039

Points: 1

# Comments: 0

Lately I’ve worked on a chat history based memory feature that can recall information from every conversation you’ve ever had with ChatGPT and Claude. It’s been particularly useful and also technically fun to implement. Speed has been very important as I do just in time summarisation and a multi stage RAG pipeline, and most LLMs have unacceptable performance. I ended up going with GPT-OSS on Groq due to its ultra low latency often completing full generations before Gemini or ChatGPT APIs return even the first token.

The ability to recall details from conversations going back years makes tasks where I want personalised plans or feedback like 10x more useful, at times I get the AI to ingest tens of thousands of tokens of context to help me better.

Over time, the project has grown to now support more than 17 platforms, thousands of users, and has been growing organically.

As of most recently a major feature I've been working on is full chat history based memory. Being able to remember and recall every conversation you've ever had across multiple supported AI tools, similar to the reference past conversations feature in various AI apps. This has been pretty intense and fun. Ingesting tens of millions of tokens per user, and doing complex multi-stage RAG on-the-fly across this vast dataset with a tight latency target for UX.

The project is MemoryPlugin: https://www.memoryplugin.com

Another project is a RAG app that's built specifically for books. No "we work with your receipts, and legal documents, instruction manuals, product documentation, lecture transcripts, your dogs novel, the script for a play and everything else possible". I wanted something tailored for books, specifically, non-fiction books. When you try to work everywhere, you can not deliver an amazing experience for any one specific use case. AskLibrary is tailored for non-fiction books, so everything from the answer generation pipelines, to the ingestion pipeline, and various other features are all designed for this specific use case. https://www.asklibrary.ai

OpenAI is the only one that says "practically unlimited" and I have never hit any limit on my ChatGPT Pro plan. I hit limits on Claude Max (both plans) several times.

Why are these companies not upfront about what the limits are?

I made a small tool to help me compare various embedding models: https://www.vectorsimilaritytest.com/

Qwen embedding models score very highly but are highly sensitive to word order (they use last token pooling which simplified means they only look at the last word of the input). Change the word order and the scores change completely. Voyage models score highly too, but changing a word from singular to plural can again completely change the scores.

I find myself doing a hybrid search, rerank and shortlist the results, then feed them to an LLM to judge what is and isn't relevant.

Comments URL: https://news.ycombinator.com/item?id=44692386

Points: 2

# Comments: 0