Fix multi-day Nightscout fetch truncation + data-completeness warnings #12

2026-07-31T12:22:01Z

willemjan commented

2026-07-31 12:22:01 +00:00

No description provided.

willemjan added 2 commits 2026-07-31 12:22:01 +00:00

fix: Nightscout API silently truncated multi-day fetches to ~3-4 days 29d20ca441

_entries_since/_treatments_since requested a single page via `count`,
but Nightscout's /api/v1/entries and /api/v1/treatments ignore a large
`count` and cap the response around ~1150/~700 documents regardless of
how far back the requested period goes. Every report page relying on
fetch_entries_range/fetch_treatments_range (7/14/30/90-day selectors)
was silently only getting the most recent ~3-4 days, no matter the
selected period.

Fixed by paginating with `find[date][$lte]` cursors in a new
_paginated_get(), walking back until the requested `since` boundary is
reached or the server returns a short/empty page (= genuinely no more
data, confirmed by manually paginating against the real instance:
entries go back 50+ days, treatments only ~4 days on this install).

Also added reporting.completeness_warning(), shared by the interactive
pages (via ui_common.render_completeness_warning) and the PDF export,
that distinguishes "a structural gap at the start of the period" (data
wasn't fetched/available) from "scattered gaps below the clinical AGP
coverage threshold" (Danne et al. 2017) — the previous single generic
"X% sensor coverage" message read as a CGM/sensor problem even when
the real cause was this fetch bug.

docs: record FR1 findings and add profile-tuning design spec 55883480c0

requirements-profile-tuning.md: document the LXC 102/107 investigation
outcome (LXC 102's houthacker/nightscout-autotune image already solves
both the analysis and NS-upload directions) and resolve the two open
questions this depended on.

design-profile-tuning.md: full design spec for the separate
glucose-profile-tuning app/service, reviewed and approved.

willemjan merged commit 6c6b175a28 into main

2026-07-31 12:22:10 +00:00

willemjan referenced this pull request

2026-07-31 12:33:52 +00:00

Nightscout only retains ~4 days of treatments (entries go back 140+ days) — investigate MongoDB retention/disk #13

willemjan referenced this pull request

2026-08-01 19:42:33 +00:00

Nightscout only retains ~4 days of treatments (entries go back 140+ days) — investigate MongoDB retention/disk #13

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: willemjan/glucose-dashboard#12