Dependabot #190-#194 combined with Zustand 5.1.0, soupsieve 4.1, coverage 7.17.3, Ruff 0.17.5 and a cargo update (wry 0.57.2, tauri-plugin-opener 2.7.3), each past a 3-day cooldown; Wrangler 4.161.0 with regenerated Worker types; tapable held at 2.3.3. Version 4.6.2 with a short changelog entry.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The project moves to maintenance mode (stable, feature-complete): docs, templates and badges (EN + VI). Qodana analysis in CI for the TypeScript / JavaScript, Python and Rust projects, with the findings of its first reports fixed. Version 4.6.1.
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
The 4.6.0 website passed the owner's VoiceOver test on an iPhone 14 Pro in Safari, Chrome and Brave; ACCESSIBILITY.md (+ VI) and CLAUDE.md record it.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Accessibility pass for the website and the apps (WCAG 2.2 AA target) and the accessibility statement: root ACCESSIBILITY.md + docs/i18n/vi/ACCESSIBILITY.md, the accessibility issue form, a default PR template; focus management, the '/' shortcut switch, chart names and data tables, contrast tokens with a CI check, Windows contrast themes; a docs sync of verified mismatches; version 4.6.0 with the two deps sweeps since 4.5.0 (#176, #182).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The runbook's WAF test now uses a Node fetch one-liner (connection pool):
xargs curl only reached ~20 requests/s, below the rule's 300 per 10 s.
Measured 2026-10-27: 800 requests in 4.9 s -> 111 x 200, 201 x Worker 429,
488 x WAF 1015.
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Measured on production after the 4.5.0 deploy: with a new connection per
request, 1,000 requests in 53 s got no 429 from RL_SITE (120/60 s); over
one keep-alive connection, 429 after ~93. The ratelimits binding counts per
machine of a data centre and syncs late, so the zone's WAF rule is the
limit that holds against floods. Verified once the owner set the rule
(300/10 s): 800 requests in 4.9 s gave 111 x 200, 201 x Worker 429 and
488 x WAF 1015, with the site answering again 10 s later.
Runbook test commands, code comments, CLAUDE.md gotcha 43, the 4.5.0
changelog entry.
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Every request that runs the Worker is counted per client (IPv4, or IPv6
/64): RL_SITE 120/min (app pages, public /api, the old apps' /data JSON,
misses), RL_IMG 600/min (covers), RL_ADMIN 300/min (/admin + /api/admin);
RL_SUGGEST 5 and RL_GATE 20 stay on top for their POSTs. Verified bots are
not counted. Over a limit: 429 + Retry-After 60 (JSON for the API, covers,
files and /data with CORS; a script-less EN/VI page for app pages). Fails
open.
Every rate-limit namespace moves to 8801-8806 (staging 8901-8906):
namespace ids are account-wide, and other Workers on the account use
1001-1006, so RL_SUGGEST / RL_GATE shared their counters.
docs/operations.md section 1 step 15: the zone's WAF rate-limiting rule as
the first layer (Free plan: one rule, IP, 10 s; 300 requests / 10 s).
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
SonarQube Cloud analyses in GitHub Actions instead of Automatic
Analysis, with test coverage (sonarcloud.yml): token (skips Dependabot
and fork PRs, which get no SONAR_TOKEN) → coverage (pytest-cov and
Vitest v8, no secrets) → scan (sonarqube-scan-action v8.3.0, full
history, sonar.projectVersion from webapp/package.json).
sonar-project.properties replaces .sonarcloud.properties: tests marked
as tests, coverage exclusions for code without unit tests by design,
Python 3.14 (the analyzer has no 3.15 yet), binary images and the
SQLite migrations (claimed by the PL/SQL analyzer, which only warned)
left out.
Adds pytest-cov / coverage (dev lock recompiled on Python 3.14) and
@vitest/coverage-v8 (Dependabot group with vitest). Docs: CLAUDE.md
gotcha 41, THIRD_PARTY, dev_env, CONTRIBUTING (EN + VI).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The first SonarQube Cloud scan reported 57 issues. 45 are fixed in code, the 11 on the saved itch.io test pages leave the scan via .sonarcloud.properties, and css:S8776 (Tailwind's @utility nesting) is a false positive to mark on SonarQube Cloud.
Worker: trailing slashes and the gate cookie's padding are trimmed by trimEnd() instead of /\/+$/ (quadratic on the public 404 path); the feed and collection parsers lose their backtracking regexes; compareCodeUnits keeps the code-unit sorts (the rule's localeCompare is locale-dependent); Number.*, DEFAULT_SIZES, crypto.randomUUID; i18n-edit.mjs reads stdin. Pipeline: the NSFW notices are one selector list, either class (the rule's ".a.b" would need both), each tested; plain if-guards; update_info.main returns None; no plain-http adapter; [[ ]] in cf_build_status.sh.
Supply chain: requirements*.txt are hash-locked pip-tools compiles of requirements*.in (on Python 3.14, which Dependabot reads from the header), installed with --require-hashes --only-binary :all: in block scalars; npm ci --ignore-scripts in CI and the release builds (verified by manual release runs on all platforms); npm run cf:check.
Release 4.4.2: also ships the toolchain upgrade (#149, #154) and Dependabot #141-#148, #150, #152, #153. CLAUDE.md gotchas 40 and 41.
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Dependabot's pip updater reads .python-version and supports Python
3.10-3.14 only, so the 3.15 pin from the toolchain upgrade aborted both
the pip version updates and the pip dependency graph ("Dependabot
detected the following Python requirement for your project: '3.15.*'").
The pin now lives in .github/python-version, read only by setup-python's
python-version-file (python-ci, refresh scan + apply, update); Dependabot
falls back to its default 3.14, which every pinned package supports.
Move it back once Dependabot lists 3.15 (CLAUDE.md gotcha 39).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
TypeScript 7.0.2 (the native compiler) now runs `tsc -b` in `npm run build`.
It has no JavaScript API until 7.1, and typescript-eslint (peer
typescript <6.1) and scripts/i18n-edit.mjs need one, so the two are
installed side by side: `@typescript/native` = npm:typescript@^7.0.2
(bin tsc) and `typescript` = npm:@typescript/typescript6@^6.0.2 (the 6.0
API, bin tsc6). No tsconfig or source change: TS 7 reports 0 errors.
Node 26: webapp/.node-version 24 -> 26 (CI and both release workflows read
it), engines >=26, @types/node 26. npm 11.20 gates dependency install
scripts on `allowScripts`, so esbuild and workerd are approved by name.
Python 3.15: .python-version 3.14 -> 3.15, ruff target py315, urllib3
declared (scraper.py imports it). UTF-8 mode is the default since 3.15,
so the workflows drop PYTHONUTF8.
Dependabot: keep the `typescript` alias off new majors, group
@typescript/*, @types/node up to 26. Docs and CLAUDE.md follow (gotcha 6
rewritten, gotcha 38 for allowScripts).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The browser extension (poli0981/itch-f2p-extension) and the Telegram bot (poli0981/telegram-scraper-bot) are archived. Removed: POST /api/ingest (ingest.ts, requireService, the idempotency store, RL_INGEST, ACCESS_AUD_INGEST; it never received a game), the admin's "Browser extension" auto-approve source and "Extension" queue label, and the About page's Telegram numeric-ID note. No D1 migration: the idempotency table and the 'ext' CHECK stay.
Policies (Privacy, ToS, EULA + installer RTF, Disclaimer, Security; EN + VI) drop the extension / ingest wording; Last updated 2026-10-16, LEGAL_VERSION unchanged. Docs, CLAUDE.md and pipeline comments updated.
Release 4.4.1 (also ships #131, #135, #136, #137).
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Admin: add games from any list or itch.io collection (Check first, batches of 200, per-game ingest tracking from scripts/state/ingest_outcomes.json), followed collections and auto-approve run by the cron in one [auto] commit, bulk remove/edit up to 100 games in one commit, New games, Activity and Settings pages. D1 migration 0002 (applied to production before this merge). Policies (ToS, Privacy, Disclaimer, EN + VI) cover approval by the maintainer's rules; LEGAL_VERSION 2026-10-13.
Web: the theme button shows the theme in use, no dark-mode flash (pre-paint script, hash in three CSPs), Charts tabs stay mounted (no rebuilt charts or replayed animations), 300 ms entrances, scrollbar gutter on mouse devices.
Release 4.4.0 (changelog also covers #130).
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Below md: a one-row tab bar (the Vietnamese labels had wrapped out of the
fixed-height bar), 12px legends and 11px ticks, horizontal Languages and
Avg session bars, the reason under each recent deletion, the KPI total
across the row, a taller Genres card.
At every size: all 15 Genre labels on one line (Recharts had hidden 8,
the two largest included), pie legends in data order with muted text,
translated removal reasons (reasonKey in lib/deleted-reason), locale axis
numbers, treemap labels that fit their cells, no "(made_with[0])" in the
engine chart's description. CLAUDE.md: chart notes, gotcha 32 and the
unreleased-on-main note.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
itch.io answers a password-protected game with HTTP 200 and its password form (div.game_password_page / input[name=game_password]); the refresh counted it as a parse failure forever. scraper.is_password_protected() recognises it; refresh gives a "private" strike ("Game page is password-protected", removed when seen again >= 20 h later, counted by the mass-change guard); update_info drops such links as a final outcome; the Removed page and Deletion Reasons chart label the reason (EN/VI). CLAUDE.md names the new signing key 838884804847BE7AE5FCF0A96AD1AB0921B96825; 03F965C2E2DB5C6B is revoked.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
force_update.yml called refresh.yml through `uses:` and failed at startup ("workflow file issue", no annotation); it had never run since v4. It now dispatches refresh.yml with full=true (new workflow_dispatch input; refresh.yml drops workflow_call). refresh.yml's scan checks out the branch as it is when the job starts, so runs waiting in the refresh-pipeline queue see the previous run's state and consecutive force-update dispatches cover consecutive batches. Verified end to end on the branch (one URL re-scraped and applied to main as f03211d).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
itch.io game pages now carry an "AI Disclosure" row (AI Assisted, then what it was used for), a "Content" row ("No generative AI was used", /games/tag-no-ai) and an "Accessibility" row. The scraper reads them into three optional fields (ai_disclosure, ai_content, accessibility), which the daily refresh keeps current; description becomes the creator's tagline (og:description), else the first sentence as before; whitespace inside titles and links is collapsed. A --full re-scrape keeps a known release_date / thumbnail (itch.io shows "Published" only for a few weeks).
Web app: "Generative AI" and "Accessibility" filters on /games (?ai=, ?access=), game-page rows, three charts (Overview: Generative AI; Discovery: Accessibility Features, What AI Was Used For). EN/VI strings, docs, changelog, version 4.3.0.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Catalog packs: the build emits /data/pack/manifest-v1.json plus
content-hashed deflate-raw packs (columns + dictionaries); the site and
the apps read them (about 264 KB on a first visit instead of about 520 KB
of JSON). Descriptions live in their own packs and load on demand (a game
page: its chunk; a search: all of them).
- The IndexedDB cache is stored as compressed bytes by a small binary
persister (replaces @tanstack/query-async-storage-persister); fflate is
the lazy fallback where the browser has no Compression Streams.
- The readable /data/*.json goes only to apps 4.0-4.1.1 (Tauri Origin);
everyone else gets a 410 with links to the repository
(worker/legacy-data.ts, five positive run_worker_first entries).
- /img: exact width strings only, fallback originals and missing images
kept at the edge for a day, failed background puts are logged.
- Themed scrollbars and a "Hide scrollbars" setting (Settings and the
display menu); chart cards no longer block their list scrollbars.
- Policies (LEGAL_VERSION 2026-10-03): data reuse goes through the
repository. Docs, changelog and version 4.2.0.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- contact@ / legal@ / privacy@ / security@ / takedown@poli0981.dev
(Google Workspace aliases) replace the @freeitchgames.win addresses in
the policies (EN + VI), READMEs, issue templates, security.txt and the
installer EULA.
- Privacy Policy: Google Workspace replaces Cloudflare Email Routing as
the email processor (provider table, transfers, contact section).
- About page: website, contact email and the poli0981.dev/links hub;
mailto: links open without a blank tab; the apps may open mailto:.
- LEGAL_VERSION 2026-09-29, so the legal gate asks once more.
- Version 4.1.1 (about.ts, package.json, tauri.conf.json, Cargo.toml/lock).
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
- operations.md: verification gate setup (bot token, Transform Rule,
header check, GATE_SECRET last, smoke tests, off switch); Web Analytics
is injected by the zone (checked live), not a build token; staging is
deployed by hand from any branch; a release checklist replaces the
finished v4 release order; the unused repo secrets can go.
- CLAUDE.md: gate, chart and changelog notes, three new gotchas, current
counts, .rpm, announce-discussion.yml is local, current state.
- READMEs (EN/VI): the quick check, list layout on phones, .rpm,
TanStack Query only, the build monitor, cf_build_status.sh.
- dev_env (EN/VI): GATE_* secrets, PKCS#1 keys work as downloaded.
- webapp/README, TAURI.md, THIRD_PARTY.md, CONTRIBUTING (EN/VI): lazy
routes, .rpm, Cargo.lock is committed, squash or merge commit.
- _headers: caching for favicon.svg and the web manifest; comments.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Approving from the queue failed with 500 "internal_error"; the Worker log
said: TypeError: "pkcs8" must be PKCS#8 formatted string. GitHub downloads
App keys as PKCS#1, which WebCrypto cannot import.
- github.ts wraps a PKCS#1 PEM into PKCS#8 itself (and turns two-character
"
" escapes into newlines), so the downloaded key works unchanged.
- GitHub failures throw GitHubError and the admin API answers 502
github_error with the reason, instead of a bare internal error.
- Admin CSP allows the Cloudflare beacon the zone injects into every HTML
response; dropped browsing-topics from Permissions-Policy (Chrome no
longer knows the feature and logs an error on every page).
- Docs: the key needs no openssl conversion any more.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Implements the approved mockup (Free Itch Games, dark and light).
- Tailwind CSS 4 via @tailwindcss/vite (no PostCSS / tailwind.config), design
tokens in src/index.css, tw-animate-css, self-hosted Geist / Geist Mono.
- A sticky top nav (global search with the / shortcut, display menu for
theme / language / density / 18+, phone sheet menu) and a footer replace the
sidebar; the window scrolls, with scroll restoration on back / forward.
- Welcome page at / (catalog status, features, recently added) replaces the
dashboard.
- Games: search, genre / platform / status / tags / language / input / engine,
minimum rating, plays-in-browser, sort and page live in the URL
(lib/game-filters.ts, unit-tested); facet counts ignore their own filter;
a table on desktop, a list on phones, 100 per page. Counts show the whole
catalog while 18+ games are hidden.
- New game detail page (breadcrumb back to the same list, facts, tags that
open the matching list, copy link, report a problem), searchable Removed
page, simpler Settings, restyled error pages and charts header.
- Legal gate is an overlay above the page (deep links land where they
pointed), with translated document names; no "Leave" button in the apps.
- Cached data stays on screen when a background refresh fails (offline).
- Numbers and dates follow the language (lib/format.ts).
- New favicon, PWA icons and OG image from the same tokens
(scripts/gen_assets.py uses the Geist fonts from node_modules).
- Removed: sidebar, dashboard, data-table components, TanStack Table /
Virtual, sonner and toast settings, the unused Select primitive; 81 unused
i18n keys; prefs now persist only the keys still in use.
- Review fixes: routers without startTransition (useSearchParams was stale,
so quick filter clicks and typed searches overwrote each other or pulled
the visitor back from a game); paging starts at the top and Back returns
to the old position; the 18+ confirmation is an in-app dialog
(window.confirm is a no-op in the macOS app); the apps show only the legal
gate until it is accepted (covers load from itch.io there); breadcrumb goes
back; named popovers, list semantics, IME-safe Enter, English plurals,
pointer cursor, --brand-soft without color-mix, copy-link fallback.
- wrangler.jsonc: id of the production D1 database (created by command,
0001_init applied); runbook notes that R2 must be enabled first.
- Docs: CLAUDE.md, CHANGELOG, webapp README / TAURI.md, THIRD_PARTY,
ACKNOWLEDGEMENTS, docs/operations.md; Dependabot groups for Tailwind 4.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Licenses
- Code stays MIT (LICENSE: 2025-2026 poli0981 (SkullMute)). The catalog
data (data_game/LICENSE.md) and the documentation are CC BY 4.0 (full
legal code in LICENSES/CC-BY-4.0.txt); creators' descriptions, cover
images, names and trademarks are excluded. NOTICE.md: license map and
non-affiliation with itch.io.
Policies (English + Vietnamese mirrors, dated 2026-09-18, applying from
4.0.0)
- Terms of Use now cover the website and the public data, with the
content-removal / copyright process, prohibited uses (bulk scraping,
/img abuse, /admin and ingest access, Suggest spam), 18+ opt-in and
Vietnamese law with the consumer-rights reservation.
- Privacy Policy rewritten for Cloudflare as processor: exact browser
storage, cookies, Turnstile, D1 retention (Suggest notes 180 days,
idempotency 7 days), rights under Law No. 91/2025/QH15 and the GDPR.
- EULA covers only the desktop and Android apps (also the installer RTF).
- Disclaimer, Security Policy (private reporting, scope, safe harbor) and
Code of Conduct (Contributor Covenant 2.1) rewritten; PAT, GPG and
Telegram-bot material removed.
Docs and templates
- README / CONTRIBUTING (EN + VI), webapp/README, TAURI.md, dev_env
(EN + VI), THIRD_PARTY, ACKNOWLEDGEMENTS; new docs/operations.md
(Cloudflare + GitHub setup, v4 release order, routine tasks).
- CLAUDE.md rewritten for the v4 architecture; CHANGELOG [4.0.0].
- Issue templates: config.yml (Suggest page + private security reports),
"Add games" points to /suggest, "Remove a game" gained a rights-holder
section; PR templates updated; CODEOWNERS.
- Dependabot npm version updates resume with the v4 merge (limit 5).
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
BREAKING: the public web app has no sign-in anymore and uses real paths
(BrowserRouter); /add and /workflows are gone (admin comes in Phase 4).
Platform
- wrangler.jsonc: Worker (worker/index.ts) + static assets with SPA
fallback; only /img/* and /api/* run the Worker. R2 binding THUMBS,
`staging` env for the v4 pre-release Worker. worker-configuration.d.ts
from `wrangler types` (checked in CI with --check).
- vite-plugins/catalog-data.ts bundles data_game + deleted log into
dist/data (build fails on bad JSON / index mismatch), emits urls.json
(thumbnail allow-list) and a real-path sitemap; version.json carries
the build stamp so data-only rebuilds keep identical JS.
- Data is read same-origin from /data (Tauri: https://freeitchgames.win/data,
CORS *); chunks load with allSettled.
- worker/img.ts: /img/<160|640>/<itch path> serves a WebP rendered once
per image+width by Image Transformations and stored in R2 (edge cache
→ R2 → transform); catalog allow-list, fixed upstream host, hotlink
block, streamed original on transform failure, 403/404 upstream → 404.
15 vitest cases.
- Enforced CSP (same-origin + Web Analytics/Turnstile), cache headers for
/assets, /data, og/icons; security.txt; robots disallows /api, /admin.
App
- Remove PAT/GPG sign-in, bulk edit/delete, undo, workflow dispatch,
Octokit and OpenPGP (and ~220 write-path i18n keys); Settings keeps
language/theme/density/notifications only.
- react-router 8 (unified package), React 19.3, TanStack/Recharts/etc.
minors, Vite 8 rolldown codeSplitting groups; legacy #/ links are
rewritten to paths; old PAT/GPG localStorage keys are cleared; reload
once on vite:preloadError after a deploy.
- GameThumb uses the /img proxy (referrerPolicy no-referrer, N/A-safe).
Tauri
- Real CSP, drop the unused http plugin + capability, read-only
descriptions, rust-version 1.88, drop the time pin, commit Cargo.lock.
Also: remove the GitHub Pages redirect workflow/stub (deployed by v4
Phase 0); add scripts/i18n-edit.mjs (TS-parser based key maintenance for
en.ts/vi.ts).
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* feat(pipeline): rotating refresh + patch/apply pipeline, drop lists/
Replace check_paid / check_alive / update_reviews / update_status: each
crawled all 2,600+ pages sequentially, overran its job timeout, saved
only at the end and has lost every run since late June (unreported:
timeouts end as "cancelled").
- scripts/refresh.py: daily slice of ~1/7 of the catalog (pending
strikes first, then least recently checked), one GET per game for
alive / paid / rating / status (+ release_date, thumbnail, updated_at
backfill). Removal needs the same 404/410 or paid strike on two
different UTC days. Paced requests, capped Retry-After back-off, stop
after 3x 429, checkpoints and an in-script deadline. --full replaces
force_update.py (rotating batches, editable fields preserved).
- Scanners emit a URL-keyed patch (patch.py); apply_patch.py applies it
to the latest main and runs validate.py; bash/commit_push.sh fetches,
re-applies and retries pushes, so concurrent writers never clobber
each other.
- update_info.py: canonical URLs (canonical.py), skip games in the
deleted log, keep transient failures queued (max 3 runs, tracked in
scripts/state/), stamp added_at, never drop links queued meanwhile.
- data_store.py: games stay in their chunk, re-slice only past
thresholds, write only changed bytes; index/count_history change only
with data (no more no-op commits).
- validate.py (schema, enums, canonical/unique URLs, index consistency)
+ normalize one invalid safe_virus ("y" -> "Yes").
- tests/: 85 network-free pytest cases, HTML fixtures (from sample/),
shared URL vectors and golden chunk/serialization fixtures for the
future Worker port.
- Workflows: refresh.yml (scan -> apply -> notify), update.yml (runs on
queue change), force_update.yml (refresh.yml full mode),
notify-failure.yml (Discord on failure/cancel/rate limit),
python-ci.yml, webapp-ci.yml, deploy-status.yml; draft-first release
with one create-release job and tauri-action v1, no caches in release
builds; SHA-pinned actions, permissions: {} defaults, reusable
workflows pinned with explicit secrets, injection fixes; dependabot.yml.
- Remove lists/, generate_md, generate_table, log_deleted,
deleted_games.txt, the Telegram bot-ingest path and old bash wrappers;
update README (EN/VI), CONTRIBUTING, templates, CLAUDE.md, CHANGELOG
and mark the retired Telegram path in the policies.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* fix(pipeline): review findings on the refresh / ingest rewrite
Removals
- Mass-change guard: a run whose removals or new strikes exceed
max(10, 10%) of the games it checked withholds all its removals and
alerts (mass_change). Withheld games are marked withheld_at and stay
withheld in later (even single-URL or rate-limited) runs until a healthy
check clears them or a run is dispatched with allow_mass_removal.
- Checkpoints never carry removals, so a scan that dies before its guard
cannot delete games; apply_patch re-checks the per-run limit and caps
any patch at max(25, 5%) of the catalog (ALLOW_MASS_REMOVAL=1 overrides).
- Strikes mature by time, not calendar day: a second sighting must come
>= 20 h after the first (strike_at), so two checks around midnight UTC no
longer remove a game.
- Overlapping scans can't undo each other: refresh_state merges keep the
newest check and the newest full stamp in either apply order, and a
removal is skipped when a newer check has landed since.
- A corrupt count_history.json fails the apply instead of being replaced
by a one-row history.
Ingest
- A second spelling of a queued game no longer drops the first copy
before it reaches a final outcome.
- A dispatched url is processed first and kept in temp_link.json
(queue_add) until it finishes, so a retry, deadline or rate-limit stop
keeps it.
- Failures count as an attempt only >= 6 h apart and a 429 counts as none,
so a burst of queued runs can't burn a link's three attempts.
- Non-string queue entries are cleaned on every apply instead of crashing
it; {"url": ...} objects are unwrapped.
CI
- queue: max on the ingest, refresh-apply and force-update concurrency
groups: the default queue replaced (and silently dropped) pending runs.
- Seed scripts/state/*.json and mkdir -p before git add (the pathspec
failed on an empty patch until the directory existed on main).
- Cancelling a refresh / force-update / desktop release really stops it
(!cancelled() instead of always()).
- deploy-status.yml becomes an hourly check of main's latest finished
"Workers Builds: free-games-itchio-list" run (bash/cf_build_status.sh):
GitHub never starts check_run workflows for GITHUB_TOKEN data commits.
- The reusable release notifiers still take their script from
poli0981/.github@main; the caller comments now say so.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* fix(pipeline): close the remaining mass-removal and monitor gaps
From the second review round of the pipeline fixes:
- A strike spike now marks every strike of that run withheld_at (the
checkpoint of a run that dies mid-spike too), so a later short,
rate-limited or single-URL run can't remove them without an
allow_mass_removal dispatch.
- Withheld games take at most half of a run's budget (all of it for the
allow_mass_removal run that confirms them), and a withheld full-mode
game moves its `full` stamp, so neither rotation stalls on them.
- refresh.yml runs one scan -> apply pipeline at a time (workflow-level
concurrency refresh-pipeline, queue: max), so an older removal can't be
applied after a newer healthy check of the same game.
- deploy-status.yml alerts once per failed Cloudflare build, keyed on its
check-run id and marked only after the Discord post, instead of by age
(which could drop an alert after a missed run, or repeat it); the
monitor walks main's first-parent history so preview builds of merged
branch commits are never mistaken for the site's build.
- CLAUDE.md: merge PRs with squash or a merge commit, never by fast-forward.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
- Add webapp/wrangler.jsonc (Workers static assets from ./dist, SPA
fallback, workers_dev/preview_urls off) and build the web app to
webapp/dist. The config-less Workers Builds deploy was serving the raw
webapp/ source tree (blank page, /package.json and /src/* public).
- npm audit fix in-range (vite 8.3.0, react-router-dom 7.18.4, postcss
8.5.28, transitive fixes): closes all Dependabot alerts, audit = 0.
Add wrangler as a pinned devDependency, engines node >=22.22,
.node-version 24.
- public/_headers: Referrer-Policy, frame denial, Permissions-Policy,
COOP, CSP report-only; immutable cache for hashed /assets/*.
- release_android.yml: Node 24 action majors (setup-java v6,
upload-artifact v7, setup-android v4, checkout/setup-node v7),
SHA-pinned, timeout + concurrency, tag via env.
- GitHub Pages now publishes only a redirect stub (pages-redirect/)
that keeps #/ routes and clears the old PAT/GPG localStorage keys;
drop notify-deploy.yml.
- .gitattributes: fix invalid '* text = auto' / '* eol = lf'; binary
rules; stop export-ignoring README/policy docs. .gitignore: local
contacts/QR assets, wrangler state, .dev.vars, keystores.
- Scraper workflows: unbuffered UTF-8 logs; pause the schedules of
check_paid/check_alive/update_reviews/update_status (full passes over
2,600+ games exceed their timeouts and lose all work).
- Point canonical/og/manifest/sitemap/robots and doc links at
freeitchgames.win; regenerate OG image (fit title); interim Cloudflare
notice in the Privacy Policy.
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
v3.8.0 (Android APK) is tagged and released. Flip "in progress" -> released,
extend the tag range to v3.8.0, and note the release_android.yml gotcha:
setup-java `cache: gradle` hard-fails because gen/android is generated mid-job.
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Ship the webapp as a sideloadable arm64-v8a .apk alongside the desktop
installers — the same React + Tauri app running in an Android WebView.
- Fix the bundle identifier to be Android-valid (alphanumeric — Android
rejects hyphens, Tauri rejects underscores):
com.poli0981.free-games-itchio-webapp -> com.poli0981.freegamesitchio.
release_desktop.yml now reads the macOS .pkg --identifier from config.
- Realign Tauri/Cargo/UI versions to 3.8.0 (sane, monotonic versionCode).
- Add bundle.android.minSdkVersion 24.
- New release_android.yml: arm64-v8a build, post-signed with zipalign +
apksigner (gen/ stays gitignored — no Gradle edits). Attaches to the
draft Release on a v* tag; uploads a workflow artifact on manual dispatch.
- Mobile UX: Android back button -> router history (useBackButton hook),
safe-area insets, platform-aware sidebar badge (Desktop/Mobile app).
- Add @tauri-apps/api dependency; docs in TAURI.md, README(.vi), CLAUDE.md.
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
bundle.windows.nsis.license does not exist in @tauri-apps/cli 2.11.0 and broke
the v3.7.0 desktop build; document the bundle.licenseFile (RTF) workaround so
future sessions don't relearn it. Bump current-state note to v3.7.1.
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Web: full-screen first-launch legal gate (LegalGate) blocks the app until the
user accepts the current LEGAL_VERSION; persists as prefs.acceptedLegalVersion
in localStorage (no cookie). Reuses LEGAL_LINKS; re-prompts on LEGAL_VERSION bump.
Built on raw Radix Dialog (focus-trapped, no close-X, Esc/outside-click disabled).
Desktop: Windows NSIS installer shows an EULA "I Agree" page via
bundle.windows.nsis.license -> src-tauri/installer/EULA.txt.
Charts: /charts split into four lazy per-tab chunks (charts/tabs/*). Each tab
imports its chart components directly (index.ts barrel removed) so the bundler
keeps each tab's components in its own chunk; non-default tabs' component code
loads only on activation. Recharts still loads with the default Overview tab.
Also: about.ts version -> 3.7.0 + Opus 4.8 credit; Privacy Policy localStorage
key note (EN + VI); CHANGELOG + CLAUDE.md updates.
Verified: eslint, tsc -b, knip, npm audit (0 vulns), ruff, vulture all clean;
browser smoke test of gate (appear / accept / persist / version-bump re-prompt)
and per-tab lazy loading (reach-tab + its charts load only on tab click).
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
- Add 6 charts (game-count line, genre treemap, KPI cards, deletions
over time, deletion reasons, most-rated) and split charts.tsx into a
charts/ module (one file per chart, shared chart-card + palette).
- Track catalog size over time: data_store.py appends data_game/
count_history.json daily; backfill_count_history.py seeds it from git.
- Add scripts/json_io.py with shared load/save and a URL-keyed
dedup_deleted so the deleted-games log can't double-log re-added games.
- Add a scroll-to-top button and a ruff config (pyproject.toml).
- Refactor docs for v3.5.0 (CHANGELOG, README badges, CLAUDE.md).
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
- New scripts/update_reviews.py + bash + workflow on cron '0 5 1,15 * *':
refresh rating + rating_count fortnightly via scrape_game_info, skip on
network/parse errors so old values aren't blanked.
- New scripts/update_status.py + bash + workflow on cron '0 6 1 * *':
refresh status monthly using the same pattern.
- New scripts/force_update.py + bash + workflow (workflow_dispatch only):
optional url input; empty input re-scrapes every game. Always preserves
safe_virus / notes / nsfw per CLAUDE.md "Editable vs read-only fields".
Doubles as the canonical mojibake repair tool.
- Chain generate_table.yml on the three new workflows so lists/*.md regen
automatically after data mutations.
- Fix UTF-8 mojibake on webapp writes: webapp/src/lib/github/contents.ts
readFileWithSha and git-data.ts bulkDeleteGames decoded GitHub's base64
content with atob alone (Latin-1 binary string). Multi-byte UTF-8 sequences
became mojibake; next write re-encoded them as UTF-8, double-corrupting per
edit cycle. Confirmed damage in data_game/game_info_002.json
('BotÃÂão Esquerdo' was 'Botão Esquerdo'). Extract shared helper
webapp/src/lib/github/encoding.ts (base64ToUtf8 / utf8ToBase64) using
TextDecoder('utf-8') / TextEncoder; route both call sites through it.
- Version bumps: README + README.vi -> 3.4.0, about.ts APP.version -> 3.4.0,
new CHANGELOG entry, CLAUDE.md GitHub Actions table + gotcha #8 updated.
- No Rust binary change: tauri Cargo.toml / tauri.conf.json untouched.
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Captures the context that's expensive to re-derive every time:
- Layer split (Python pipeline vs webapp vs Tauri).
- Local dev commands and Vite alias / output paths.
- Code-split layout and webapp folder map.
- Which 3 of the 23 game fields are user-editable.
- All 7 GitHub Actions workflows with triggers and purposes.
- Release / tag procedure (signed tags from main only).
- Correct fine-grained PAT permissions (Actions:write, NOT
workflow:write).
- Ten gotchas that each cost us a release to learn:
universal-apple-darwin + bundle_dmg.sh, macos-13 retirement, Tauri
icons must exist, .pkg via pkgbuild, Vite v8 base option, TS 6
baseUrl deprecation, lucide v1 brand icon removal, base64 newlines
on contents API, workflow_dispatch returns 204, docs/app/ is
gitignored.
- Safe-edit rules and the current trunk state.
Lives at the repo root so any tool that auto-loads CLAUDE.md picks
it up.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>