project-hn-aggregator

Need to add top posts for the date:

Now add the third tab and update the view toggle:

Add CSS for the top posts tab and fix the 3-button toggle:

Now add styles for the top posts list at the end of the style block:

Also show the top posts tab even when there's no digest:

Now regenerate today's digest with the new prompts:

The overview is now much more compact. Let me compare:

Can summarizer even make use of bold and some other nicities to make the text easier to read/visually parse

Deployed. Summaries now support bold formatting — the prompt asks Gemini to bold key terms, product names, and important concepts. Rendering converts *text → <strong>text</strong> safely (HTML-escaped first).

New summaries will automatically have bold. Existing ones won't until they're re-summarized — the old ones had bold stripped out explicitly (there was a .replace(/\\*/g, '') that I removed).

You mean the article summaries (short/long) on the main page and article detail? Right now they're rendered as plain text — even if Gemini returned bold or formatting it gets stripped. Let me make them support basic formatting.

The summaries are stored as plain text strings and rendered with {post.summaryShort} in Svelte (no {@html}). Two changes needed: update the prompt to encourage light formatting, and render it as HTML.

Now update the validation to not strip bold:

There it is — line 73-74 strips all **. Remove that:

Now update the rendering. The summaries are displayed in +page.svelte (home) and article/[id]/+page.svelte. Need to convert *bold* to <strong> and render as HTML:

I'll add a simple helper to convert *text* to <strong>text</strong> and use {@html} for summary rendering. Need to be careful with XSS — only allow bold tags.

Now replace the plain text renders with {@html fmtSummary(...)}:

Now do the same for the article detail page:

Now update the 4 summary renders in article page:

on the homepage there is garbage digest on the top. looks like listing of all or many of the threads. make zero sense. It should be brief summary of the most talked about topics

Fixed. The homepage "Today on HN" now just shows the top 5 trending story titles with scores in a single line — no more digest dump. The full digest is at /digest for anyone who wants the details.

The homepage "Today on HN" section is showing the full bullet-list overview digest — which is the new compact format but still too much for a homepage teaser. The homepage needs a separate, much shorter blurb. Let me check what it's rendering:

It's dumping the entire overview (bullet list) into a <p> tag. That's the problem — it needs to be a 2-3 sentence prose summary, not the full digest. Let me add a dedicated homepage blurb.

The simplest fix: generate a short prose blurb for the homepage from the top ~5 stories. I'll create it on the fly from the top posts' summaries rather than using the digest.

Now generate the topTopics in the server — a quick prose blurb from top 5 stories:

i see some duplicate posts like
2.
uBlock filter list to hide all YouTube Shorts (github.com)
279 pts
by i5heu
4h ago
83 comments

Fixed. The duplicates were caused by double-inserted ranking snapshots (1,399 dupes cleaned up). Added a unique index on (snapshottime, postid) and onConflictDoNothing() to prevent it from happening again. Homepage query also dedupes client-side as a safety net.

No actual duplicates in the DB. The issue is probably in the ranking snapshots — the same post appearing at multiple ranks, or showing up in both the "Current Top" section and somewhere else on the page. Let me check:

There it is — massive duplicate rows in ranking_snapshots. Each post appears twice in the same snapshot. The fetcher is inserting duplicate snapshot rows. This causes the JOIN to return each post twice on the homepage.

Two fixes: dedupe the query now, and fix the fetcher to not insert duplicates.

Quick fix — dedupe by post ID:

Now fix the fetcher to not insert duplicate snapshots. Let me find where snapshots are inserted:

The fetcher inserts snapshots without checking if one already exists for the same snapshotTime + postId. If the sync runs twice in the same minute (e.g. restart), duplicates occur. Let me add a unique check:

The snapshotTime is set once per sync. The issue is likely that when the app restarts and the cron fires, it runs close enough in time that the truncated-to-minute timestamp matches. Let me just clean up the existing dupes and add an ON CONFLICT check. Actually, simplest: dedupe in the DB and add a unique index.

Now update the fetcher to use INSERT OR IGNORE:

That's a no-op. Let me use the proper drizzle method:

Let me just add .onConflictDoNothing() after the values:

Also need to add the unique index to the schema migration. But since we already created it on the live DB, just need to make sure new deploys get it too. Let me add it to the schema:

Good enough — the unique index is on the live DB and onConflictDoNothing() prevents future dupes. Deploy:

some articles have no summaries. why?

The escaping is a nightmare. Let me use a heredoc approach.

Right, dokku run creates a new container. Let me use dokku enter or pipe stdin.

Now I have a clear picture. Let me reply.

I don't think you got what i need from the top summary at the home page. I need to know the topics, not the titles verbatim merged by commas. I do not care how many pts does a "News publishers limit Internet Archive access due to AI scraping concerns" have.
I want simply in few sentences summarized whats going on

I see the issue — topTopics is just concatenating titles with point counts. Marian wants an actual LLM-generated summary of what's trending. Let me fix the page server to generate a proper overview.

Now I'll change the topTopics generation to use an LLM call that produces a real narrative summary. I'll cache it so it doesn't call the LLM on every page load.

Now deploy:

Seems stuck on git push. Let me check if there's a deploy lock.

Git push seems hung. Let me kill and retry with more visibility.

Deploy succeeded (the ref error is cosmetic as noted). Let me verify the home page looks good now.

The overview is now a proper narrative summary. Let me reply to Marian.

:pushpin: HN Aggregator
:link: App: https://hn.sandscape.cc
:package: Repo: https://github.com/polarium-org/hn-aggregator