Build improvements #60

Open
andyinabox wants to merge 5 commits from build-improvements into main
andyinabox commented 2026-04-15 12:02:07 +02:00 (Migrated from gitlab.com)

Title

Track video sources and add playlist analyzer

Summary

  • Track per-playlist source stats (duration, clip count, percentage) in the manifest and
    compute them during the build via a new source-stats step
  • Add a cmd/analyzeplaylist CLI that reports how playlist items flow through the filter
    pipeline (fetched → wrongDate / formatUnavailable / tooLarge / noCaptions / infoError /
    accepted)
  • Extend YouTubeService playlist methods with a FilterCallback so filter-stage
    reasons can be observed by callers
  • Introduce PlaylistSource and a parse-playlists step that resolves channel names to
    playlist IDs, so source labels use the channel name
  • Update the builder's default playlists to use the new @ChannelName:PlaylistID format
    (CBS News, NBC News, Fox News)

Test plan

  • go test ./...
  • make builder-local produces a manifest with a populated sources array
  • go run ./cmd/analyzeplaylist against a known playlist reports sensible filter
    counts
## Title Track video sources and add playlist analyzer ## Summary - Track per-playlist source stats (duration, clip count, percentage) in the manifest and compute them during the build via a new `source-stats` step - Add a `cmd/analyzeplaylist` CLI that reports how playlist items flow through the filter pipeline (fetched → wrongDate / formatUnavailable / tooLarge / noCaptions / infoError / accepted) - Extend `YouTubeService` playlist methods with a `FilterCallback` so filter-stage reasons can be observed by callers - Introduce `PlaylistSource` and a `parse-playlists` step that resolves channel names to playlist IDs, so source labels use the channel name - Update the builder's default playlists to use the new `@ChannelName:PlaylistID` format (CBS News, NBC News, Fox News) ## Test plan - [x] `go test ./...` - [x] `make builder-local` produces a manifest with a populated `sources` array - [x] `go run ./cmd/analyzeplaylist` against a known playlist reports sensible filter counts
andyinabox commented 2026-04-15 12:02:17 +02:00 (Migrated from gitlab.com)

marked the checklist item go test ./... as completed

marked the checklist item **go test \./\.\.\.** as completed
andyinabox commented 2026-04-15 12:02:18 +02:00 (Migrated from gitlab.com)

marked the checklist item make builder-local produces a manifest with a populated sources array as completed

marked the checklist item **make builder\-local produces a manifest with a populated sources array** as completed
andyinabox commented 2026-04-15 12:02:19 +02:00 (Migrated from gitlab.com)

marked the checklist item go run ./cmd/analyzeplaylist against a known playlist reports sensible filter counts as completed

marked the checklist item **go run \./cmd/analyzeplaylist against a known playlist reports sensible filter
counts** as completed
andyinabox commented 2026-05-05 15:49:12 +02:00 (Migrated from gitlab.com)

added 1 commit

  • a053ff65 - add clean logs to build tasks

Compare with previous version

added 1 commit <ul><li>a053ff65 - add clean logs to build tasks</li></ul> [Compare with previous version](/andyinabox/yesterdaysnews/-/merge_requests/60/diffs?diff_id=1783251141&start_sha=72994366e243ef49e2bba1c4d4828513a93e015a)
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin build-improvements:build-improvements
git switch build-improvements

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch main
git merge --no-ff build-improvements
git switch build-improvements
git rebase main
git switch main
git merge --ff-only build-improvements
git switch build-improvements
git rebase main
git switch main
git merge --no-ff build-improvements
git switch main
git merge --squash build-improvements
git switch main
git merge --ff-only build-improvements
git switch main
git merge build-improvements
git push origin main
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
andy/yesterdaysnews!60
No description provided.