Memory hygiene: a relevance floor, no duplicates, and expiry that actually deletes
Three things that decide whether memory improves with use or rots with it. A RELEVANCE FLOOR. Recall returned its top five whatever they scored, so a run about shift cover was handed five memories about certifications simply because nothing better existed — and the block tells the model these are things the workspace remembered, so it reads them as pertinent. Embeddings are unit-normalised, so knowledge_dot is cosine, and 0.30 is where text is usually about something else. A judgement rather than a measurement, and the honest way to tune it is to watch what gets carried on real questions. NO DUPLICATES. The same standing preference comes up in conversation after conversation, and each run that hears it has no idea the last one wrote it down. Five recall slots spent on one fact restated five ways is the normal failure, not a rare one. A write with the same normalised text, in the same org and about the same subject, pushes the existing memory's expiry out instead of adding a row — matched on the same sentence rather than a similar one, because collapsing two genuinely different facts is the worse error. EXPIRY THAT DELETES. expires_at was set and filtered on read, and nothing ever removed anything: the row was invisible and still retained. "We keep it ninety days" has to be true of the table, not only of the query. Prune is batched, and a redaction is kept for a thirty-day grace period so an erasure stays provable shortly afterwards. It runs in the maintenance sweeper that already exists rather than a second scheduler — same ticker, same cancellation, same failure isolation. That forced one honest change: Maintenance() used to be nil without OAuth, on the reasoning that there was nothing to sweep. There is now, and a retention promise enforced only when an unrelated feature happens to be enabled is not a promise. The test that asserted the old behaviour now asserts the new one and says why. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
@@ -249,21 +249,34 @@ func TestMaintenanceSurvivesADatabaseFailure(t *testing.T) {
|
||||
}
|
||||
}
|
||||
|
||||
/* ── It is absent when the surface is ───────────────────────────────────── */
|
||||
/* ── It runs wherever there is something to retain ──────────────────────── */
|
||||
|
||||
// A deployment without OAuth has nothing to sweep, and must not start a ticker
|
||||
// that runs for the life of the process doing nothing.
|
||||
func TestMaintenanceIsNilWhenTheSurfaceIsDisabled(t *testing.T) {
|
||||
// This used to assert the opposite: no OAuth meant nothing to sweep, so no
|
||||
// ticker. Long-term memory changed the premise. Memories carry an expiry that
|
||||
// is a retention promise about personal data, and a promise enforced only when
|
||||
// an unrelated feature happens to be switched on is not a promise. So the
|
||||
// sweeper now exists wherever the database does.
|
||||
func TestMaintenanceRunsForMemoryEvenWithoutOAuth(t *testing.T) {
|
||||
a := newAPI(t) // the standard fixture: no OAuth configuration
|
||||
|
||||
if m := a.srv.Maintenance(); m != nil {
|
||||
t.Error("an unconfigured deployment returned a Maintenance sweeper")
|
||||
m := a.srv.Maintenance()
|
||||
if m == nil {
|
||||
t.Fatal("no sweeper, so expired memories would be retained forever")
|
||||
}
|
||||
|
||||
// And the runner must return immediately rather than tick forever.
|
||||
// It must still do a pass without OAuth configured rather than failing on
|
||||
// the half that is absent.
|
||||
if _, err := m.Sweep(context.Background()); err != nil {
|
||||
t.Errorf("a sweep without OAuth failed: %v", err)
|
||||
}
|
||||
}
|
||||
|
||||
// And the runner still returns immediately when there is genuinely nothing,
|
||||
// rather than ticking for the life of the process.
|
||||
func TestSweepMaintenanceReturnsImmediatelyWithNothingToSweep(t *testing.T) {
|
||||
done := make(chan struct{})
|
||||
go func() {
|
||||
httpserver.SweepMaintenance(context.Background(), a.srv.Maintenance(),
|
||||
httpserver.SweepMaintenance(context.Background(), nil,
|
||||
slog.New(slog.NewTextHandler(io.Discard, nil)))
|
||||
close(done)
|
||||
}()
|
||||
|
||||
Reference in New Issue
Block a user