The browser extension (poli0981/itch-f2p-extension) and the Telegram bot (poli0981/telegram-scraper-bot) are archived. Removed: POST /api/ingest (ingest.ts, requireService, the idempotency store, RL_INGEST, ACCESS_AUD_INGEST; it never received a game), the admin's "Browser extension" auto-approve source and "Extension" queue label, and the About page's Telegram numeric-ID note. No D1 migration: the idempotency table and the 'ext' CHECK stay.
Policies (Privacy, ToS, EULA + installer RTF, Disclaimer, Security; EN + VI) drop the extension / ingest wording; Last updated 2026-10-16, LEGAL_VERSION unchanged. Docs, CLAUDE.md and pipeline comments updated.
Release 4.4.1 (also ships #131, #135, #136, #137).
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Admin: add games from any list or itch.io collection (Check first, batches of 200, per-game ingest tracking from scripts/state/ingest_outcomes.json), followed collections and auto-approve run by the cron in one [auto] commit, bulk remove/edit up to 100 games in one commit, New games, Activity and Settings pages. D1 migration 0002 (applied to production before this merge). Policies (ToS, Privacy, Disclaimer, EN + VI) cover approval by the maintainer's rules; LEGAL_VERSION 2026-10-13.
Web: the theme button shows the theme in use, no dark-mode flash (pre-paint script, hash in three CSPs), Charts tabs stay mounted (no rebuilt charts or replayed animations), 300 ms entrances, scrollbar gutter on mouse devices.
Release 4.4.0 (changelog also covers #130).
[skip-discuss]
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Catalog packs: the build emits /data/pack/manifest-v1.json plus
content-hashed deflate-raw packs (columns + dictionaries); the site and
the apps read them (about 264 KB on a first visit instead of about 520 KB
of JSON). Descriptions live in their own packs and load on demand (a game
page: its chunk; a search: all of them).
- The IndexedDB cache is stored as compressed bytes by a small binary
persister (replaces @tanstack/query-async-storage-persister); fflate is
the lazy fallback where the browser has no Compression Streams.
- The readable /data/*.json goes only to apps 4.0-4.1.1 (Tauri Origin);
everyone else gets a 410 with links to the repository
(worker/legacy-data.ts, five positive run_worker_first entries).
- /img: exact width strings only, fallback originals and missing images
kept at the edge for a day, failed background puts are logged.
- Themed scrollbars and a "Hide scrollbars" setting (Settings and the
display menu); chart cards no longer block their list scrollbars.
- Policies (LEGAL_VERSION 2026-10-03): data reuse goes through the
repository. Docs, changelog and version 4.2.0.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- contact@ / legal@ / privacy@ / security@ / takedown@poli0981.dev
(Google Workspace aliases) replace the @freeitchgames.win addresses in
the policies (EN + VI), READMEs, issue templates, security.txt and the
installer EULA.
- Privacy Policy: Google Workspace replaces Cloudflare Email Routing as
the email processor (provider table, transfers, contact section).
- About page: website, contact email and the poli0981.dev/links hub;
mailto: links open without a blank tab; the apps may open mailto:.
- LEGAL_VERSION 2026-09-29, so the legal gate asks once more.
- Version 4.1.1 (about.ts, package.json, tauri.conf.json, Cargo.toml/lock).
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
The Privacy Policy said the Project's code sets no cookies and that
Turnstile runs only on the Suggest page. With the verification gate:
- Privacy (EN/VI): the Turnstile check before the site loads (about once
per 48 hours, verified bots exempt, /data open), the __Host-fig_gate
cookie (issue time + signature, 48 h, strictly necessary), the
webapp.gate storage entry, retention, Cloudflare's role.
- ToS (EN/VI): don't circumvent the verification check or share its cookie.
- EULA (EN/VI/RTF): list the .rpm package v4.0.0 already shipped.
- LEGAL_VERSION and the About page date → 2026-09-24, so the legal gate
asks everyone once more.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Licenses
- Code stays MIT (LICENSE: 2025-2026 poli0981 (SkullMute)). The catalog
data (data_game/LICENSE.md) and the documentation are CC BY 4.0 (full
legal code in LICENSES/CC-BY-4.0.txt); creators' descriptions, cover
images, names and trademarks are excluded. NOTICE.md: license map and
non-affiliation with itch.io.
Policies (English + Vietnamese mirrors, dated 2026-09-18, applying from
4.0.0)
- Terms of Use now cover the website and the public data, with the
content-removal / copyright process, prohibited uses (bulk scraping,
/img abuse, /admin and ingest access, Suggest spam), 18+ opt-in and
Vietnamese law with the consumer-rights reservation.
- Privacy Policy rewritten for Cloudflare as processor: exact browser
storage, cookies, Turnstile, D1 retention (Suggest notes 180 days,
idempotency 7 days), rights under Law No. 91/2025/QH15 and the GDPR.
- EULA covers only the desktop and Android apps (also the installer RTF).
- Disclaimer, Security Policy (private reporting, scope, safe harbor) and
Code of Conduct (Contributor Covenant 2.1) rewritten; PAT, GPG and
Telegram-bot material removed.
Docs and templates
- README / CONTRIBUTING (EN + VI), webapp/README, TAURI.md, dev_env
(EN + VI), THIRD_PARTY, ACKNOWLEDGEMENTS; new docs/operations.md
(Cloudflare + GitHub setup, v4 release order, routine tasks).
- CLAUDE.md rewritten for the v4 architecture; CHANGELOG [4.0.0].
- Issue templates: config.yml (Suggest page + private security reports),
"Add games" points to /suggest, "Remove a game" gained a rights-holder
section; PR templates updated; CODEOWNERS.
- Dependabot npm version updates resume with the v4 merge (limit 5).
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* feat(pipeline): rotating refresh + patch/apply pipeline, drop lists/
Replace check_paid / check_alive / update_reviews / update_status: each
crawled all 2,600+ pages sequentially, overran its job timeout, saved
only at the end and has lost every run since late June (unreported:
timeouts end as "cancelled").
- scripts/refresh.py: daily slice of ~1/7 of the catalog (pending
strikes first, then least recently checked), one GET per game for
alive / paid / rating / status (+ release_date, thumbnail, updated_at
backfill). Removal needs the same 404/410 or paid strike on two
different UTC days. Paced requests, capped Retry-After back-off, stop
after 3x 429, checkpoints and an in-script deadline. --full replaces
force_update.py (rotating batches, editable fields preserved).
- Scanners emit a URL-keyed patch (patch.py); apply_patch.py applies it
to the latest main and runs validate.py; bash/commit_push.sh fetches,
re-applies and retries pushes, so concurrent writers never clobber
each other.
- update_info.py: canonical URLs (canonical.py), skip games in the
deleted log, keep transient failures queued (max 3 runs, tracked in
scripts/state/), stamp added_at, never drop links queued meanwhile.
- data_store.py: games stay in their chunk, re-slice only past
thresholds, write only changed bytes; index/count_history change only
with data (no more no-op commits).
- validate.py (schema, enums, canonical/unique URLs, index consistency)
+ normalize one invalid safe_virus ("y" -> "Yes").
- tests/: 85 network-free pytest cases, HTML fixtures (from sample/),
shared URL vectors and golden chunk/serialization fixtures for the
future Worker port.
- Workflows: refresh.yml (scan -> apply -> notify), update.yml (runs on
queue change), force_update.yml (refresh.yml full mode),
notify-failure.yml (Discord on failure/cancel/rate limit),
python-ci.yml, webapp-ci.yml, deploy-status.yml; draft-first release
with one create-release job and tauri-action v1, no caches in release
builds; SHA-pinned actions, permissions: {} defaults, reusable
workflows pinned with explicit secrets, injection fixes; dependabot.yml.
- Remove lists/, generate_md, generate_table, log_deleted,
deleted_games.txt, the Telegram bot-ingest path and old bash wrappers;
update README (EN/VI), CONTRIBUTING, templates, CLAUDE.md, CHANGELOG
and mark the retired Telegram path in the policies.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* fix(pipeline): review findings on the refresh / ingest rewrite
Removals
- Mass-change guard: a run whose removals or new strikes exceed
max(10, 10%) of the games it checked withholds all its removals and
alerts (mass_change). Withheld games are marked withheld_at and stay
withheld in later (even single-URL or rate-limited) runs until a healthy
check clears them or a run is dispatched with allow_mass_removal.
- Checkpoints never carry removals, so a scan that dies before its guard
cannot delete games; apply_patch re-checks the per-run limit and caps
any patch at max(25, 5%) of the catalog (ALLOW_MASS_REMOVAL=1 overrides).
- Strikes mature by time, not calendar day: a second sighting must come
>= 20 h after the first (strike_at), so two checks around midnight UTC no
longer remove a game.
- Overlapping scans can't undo each other: refresh_state merges keep the
newest check and the newest full stamp in either apply order, and a
removal is skipped when a newer check has landed since.
- A corrupt count_history.json fails the apply instead of being replaced
by a one-row history.
Ingest
- A second spelling of a queued game no longer drops the first copy
before it reaches a final outcome.
- A dispatched url is processed first and kept in temp_link.json
(queue_add) until it finishes, so a retry, deadline or rate-limit stop
keeps it.
- Failures count as an attempt only >= 6 h apart and a 429 counts as none,
so a burst of queued runs can't burn a link's three attempts.
- Non-string queue entries are cleaned on every apply instead of crashing
it; {"url": ...} objects are unwrapped.
CI
- queue: max on the ingest, refresh-apply and force-update concurrency
groups: the default queue replaced (and silently dropped) pending runs.
- Seed scripts/state/*.json and mkdir -p before git add (the pathspec
failed on an empty patch until the directory existed on main).
- Cancelling a refresh / force-update / desktop release really stops it
(!cancelled() instead of always()).
- deploy-status.yml becomes an hourly check of main's latest finished
"Workers Builds: free-games-itchio-list" run (bash/cf_build_status.sh):
GitHub never starts check_run workflows for GITHUB_TOKEN data commits.
- The reusable release notifiers still take their script from
poli0981/.github@main; the caller comments now say so.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
* fix(pipeline): close the remaining mass-removal and monitor gaps
From the second review round of the pipeline fixes:
- A strike spike now marks every strike of that run withheld_at (the
checkpoint of a run that dies mid-spike too), so a later short,
rate-limited or single-URL run can't remove them without an
allow_mass_removal dispatch.
- Withheld games take at most half of a run's budget (all of it for the
allow_mass_removal run that confirms them), and a withheld full-mode
game moves its `full` stamp, so neither rotation stalls on them.
- refresh.yml runs one scan -> apply pipeline at a time (workflow-level
concurrency refresh-pipeline, queue: max), so an older removal can't be
applied after a newer healthy check of the same game.
- deploy-status.yml alerts once per failed Cloudflare build, keyed on its
check-run id and marked only after the Discord post, instead of by age
(which could drop an alert after a missed run, or repeat it); the
monitor walks main's first-parent history so preview builds of merged
branch commits are never mistaken for the site's build.
- CLAUDE.md: merge PRs with squash or a merge commit, never by fast-forward.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
- Add webapp/wrangler.jsonc (Workers static assets from ./dist, SPA
fallback, workers_dev/preview_urls off) and build the web app to
webapp/dist. The config-less Workers Builds deploy was serving the raw
webapp/ source tree (blank page, /package.json and /src/* public).
- npm audit fix in-range (vite 8.3.0, react-router-dom 7.18.4, postcss
8.5.28, transitive fixes): closes all Dependabot alerts, audit = 0.
Add wrangler as a pinned devDependency, engines node >=22.22,
.node-version 24.
- public/_headers: Referrer-Policy, frame denial, Permissions-Policy,
COOP, CSP report-only; immutable cache for hashed /assets/*.
- release_android.yml: Node 24 action majors (setup-java v6,
upload-artifact v7, setup-android v4, checkout/setup-node v7),
SHA-pinned, timeout + concurrency, tag via env.
- GitHub Pages now publishes only a redirect stub (pages-redirect/)
that keeps #/ routes and clears the old PAT/GPG localStorage keys;
drop notify-deploy.yml.
- .gitattributes: fix invalid '* text = auto' / '* eol = lf'; binary
rules; stop export-ignoring README/policy docs. .gitignore: local
contacts/QR assets, wrangler state, .dev.vars, keystores.
- Scraper workflows: unbuffered UTF-8 logs; pause the schedules of
check_paid/check_alive/update_reviews/update_status (full passes over
2,600+ games exceed their timeouts and lose all work).
- Point canonical/og/manifest/sitemap/robots and doc links at
freeitchgames.win; regenerate OG image (fit title); interim Cloudflare
notice in the Privacy Policy.
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Web: full-screen first-launch legal gate (LegalGate) blocks the app until the
user accepts the current LEGAL_VERSION; persists as prefs.acceptedLegalVersion
in localStorage (no cookie). Reuses LEGAL_LINKS; re-prompts on LEGAL_VERSION bump.
Built on raw Radix Dialog (focus-trapped, no close-X, Esc/outside-click disabled).
Desktop: Windows NSIS installer shows an EULA "I Agree" page via
bundle.windows.nsis.license -> src-tauri/installer/EULA.txt.
Charts: /charts split into four lazy per-tab chunks (charts/tabs/*). Each tab
imports its chart components directly (index.ts barrel removed) so the bundler
keeps each tab's components in its own chunk; non-default tabs' component code
loads only on activation. Recharts still loads with the default Overview tab.
Also: about.ts version -> 3.7.0 + Opus 4.8 credit; Privacy Policy localStorage
key note (EN + VI); CHANGELOG + CLAUDE.md updates.
Verified: eslint, tsc -b, knip, npm audit (0 vulns), ruff, vulture all clean;
browser smoke test of gate (appear / accept / persist / version-bump re-prompt)
and per-tab lazy loading (reach-tab + its charts load only on tab click).
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Rewrote the four English legal docs (DISCLAIMER, EULA, ToS, PrivacyPolicy) to
be tighter and more enforceable while keeping the project's voice — TL;DR, numbered
sections, definitions, severability, governing law (Vietnam), explicit "not legal
advice" notice, removal-request path. PrivacyPolicy now includes per-storage
table and PAT lifecycle steps.
Added Vietnamese translations for all six policy / community docs under
docs/i18n/vi/ plus a top-level README.vi.md. Each VI file notes that the English
version is the controlling text for legal interpretation.
About page: new "Legal & policies" Card listing Disclaimer, EULA, ToS, Privacy,
Code of Conduct, Security, License (MIT), and Changelog with a pointer to the
Vietnamese translations. New LegalLink interface + LEGAL_LINKS const in
webapp/src/lib/about.ts following the THIRD_PARTY/SOCIAL_LINKS pattern.
Optional UI:
- Tauri desktop: maximize button disabled (maximizable: false in
tauri.conf.json). Window remains resizable.
- DataTable: scrollbar hidden via new .scrollbar-hide Tailwind utility added to
webapp/src/index.css; scrolling still works.
Bookkeeping: README badge bumped to 3.1.4 + Vietnamese language badge + pointer
to README.vi.md and docs/i18n/vi/. CHANGELOG entry for 3.1.4.
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
- CONTRIBUTING.md gains a section 8 covering webapp/Tauri local dev
commands and a few house rules (don't commit dist/, update
about.ts when adding deps).
- SECURITY.md is no longer "we don't even have user data" because the
webapp can hold a GitHub PAT. Adds a PAT-handling section explaining
the AES-GCM/PBKDF2 storage, the recommended fine-grained scopes,
and what NOT to do (classic PATs, shared kiosks). Adds a brief note
about npm / Rust crate vulnerability reporting.
- PrivacyPolicy.md was technically inaccurate ("we collect None") now
that the webapp persists prefs and an encrypted PAT in localStorage.
Adds a table of every localStorage key the webapp writes, the two
GitHub endpoints it talks to, and the extra itch.io endpoints the
Tauri build hits. Still: no cookies, no tracking, no analytics, no
third-party scripts.
- All three "Last updated" lines bumped to 2026-05-04.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>