“Although vector stores provide access to a large knowledge pool for LLM agents, their representation power is not as powerful as full attention.”