RWKV

2 items

ARTICLEDEV.to AI·6d ago

I Measured My Memory at 2,000 Words. Turns Out I Was Measuring from the Wrong Angle.

The author conducted experiments on an AI model (RWKV) to measure its dynamic memory window, initially concluding it was 2,000-3,000 words based on fact recall tests. However, a persistent detail suggests that the measurement angle or methodology might be flawed, challenging the initial conclusion.

AI models RWKV experimentation AI memory

RESEARCHarXiv CS.LG·4/14/2026

Belief-State RWKV for Reinforcement Learning under Partial Observability

This paper proposes Belief-State RWKV, a stronger RL formulation where the recurrent state is explicitly interpreted as a belief state. The method maintains a compact uncertainty-aware state, allowing policies to depend on both memory and confidence in partially observed settings.

Belief State RWKV Partial Observability reinforcement learning