9 Commits
Author SHA1 Message Date
poli0981andClaude Opus 5.5 f199e2ea17 Retire the browser extension's ingest API; release 4.4.1 (#138)
The browser extension (poli0981/itch-f2p-extension) and the Telegram bot (poli0981/telegram-scraper-bot) are archived. Removed: POST /api/ingest (ingest.ts, requireService, the idempotency store, RL_INGEST, ACCESS_AUD_INGEST; it never received a game), the admin's "Browser extension" auto-approve source and "Extension" queue label, and the About page's Telegram numeric-ID note. No D1 migration: the idempotency table and the 'ext' CHECK stay.

Policies (Privacy, ToS, EULA + installer RTF, Disclaimer, Security; EN + VI) drop the extension / ingest wording; Last updated 2026-10-16, LEGAL_VERSION unchanged. Docs, CLAUDE.md and pipeline comments updated.

Release 4.4.1 (also ships #131, #135, #136, #137).

[skip-discuss]

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 17:56:46 +07:00
poli0981andClaude Opus 5.5 a3bfe04b40 Compact catalog packs, binary cache, themed scrollbars; bump to 4.2.0 (#103) [skip-discuss]
- Catalog packs: the build emits /data/pack/manifest-v1.json plus
  content-hashed deflate-raw packs (columns + dictionaries); the site and
  the apps read them (about 264 KB on a first visit instead of about 520 KB
  of JSON). Descriptions live in their own packs and load on demand (a game
  page: its chunk; a search: all of them).
- The IndexedDB cache is stored as compressed bytes by a small binary
  persister (replaces @tanstack/query-async-storage-persister); fflate is
  the lazy fallback where the browser has no Compression Streams.
- The readable /data/*.json goes only to apps 4.0-4.1.1 (Tauri Origin);
  everyone else gets a 410 with links to the repository
  (worker/legacy-data.ts, five positive run_worker_first entries).
- /img: exact width strings only, fallback originals and missing images
  kept at the edge for a day, failed background puts are logged.
- Themed scrollbars and a "Hide scrollbars" setting (Settings and the
  display menu); chart cards no longer block their list scrollbars.
- Policies (LEGAL_VERSION 2026-10-03): data reuse goes through the
  repository. Docs, changelog and version 4.2.0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 19:19:42 +07:00
poli0981andClaude Opus 5.5 cb12c0c326 Move contact addresses to @poli0981.dev, bump to 4.1.1 (#99)
- contact@ / legal@ / privacy@ / security@ / takedown@poli0981.dev
  (Google Workspace aliases) replace the @freeitchgames.win addresses in
  the policies (EN + VI), READMEs, issue templates, security.txt and the
  installer EULA.
- Privacy Policy: Google Workspace replaces Cloudflare Email Routing as
  the email processor (provider table, transfers, contact section).
- About page: website, contact email and the poli0981.dev/links hub;
  mailto: links open without a blank tab; the apps may open mailto:.
- LEGAL_VERSION 2026-09-29, so the legal gate asks once more.
- Version 4.1.1 (about.ts, package.json, tauri.conf.json, Cargo.toml/lock).

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-29 23:12:08 +07:00
poli0981andClaude Opus 5.5 fdf0645829 docs(legal): verification cookie and Turnstile check in the policies
The Privacy Policy said the Project's code sets no cookies and that
Turnstile runs only on the Suggest page. With the verification gate:

- Privacy (EN/VI): the Turnstile check before the site loads (about once
  per 48 hours, verified bots exempt, /data open), the __Host-fig_gate
  cookie (issue time + signature, 48 h, strictly necessary), the
  webapp.gate storage entry, retention, Cloudflare's role.
- ToS (EN/VI): don't circumvent the verification check or share its cookie.
- EULA (EN/VI/RTF): list the .rpm package v4.0.0 already shipped.
- LEGAL_VERSION and the About page date → 2026-09-24, so the legal gate
  asks everyone once more.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-24 17:58:35 +07:00
poli0981andClaude Opus 5 6f4a956855 docs: v4.0.0 licenses, policies and documentation (v4 Phase 5)
Licenses
- Code stays MIT (LICENSE: 2025-2026 poli0981 (SkullMute)). The catalog
  data (data_game/LICENSE.md) and the documentation are CC BY 4.0 (full
  legal code in LICENSES/CC-BY-4.0.txt); creators' descriptions, cover
  images, names and trademarks are excluded. NOTICE.md: license map and
  non-affiliation with itch.io.

Policies (English + Vietnamese mirrors, dated 2026-09-18, applying from
4.0.0)
- Terms of Use now cover the website and the public data, with the
  content-removal / copyright process, prohibited uses (bulk scraping,
  /img abuse, /admin and ingest access, Suggest spam), 18+ opt-in and
  Vietnamese law with the consumer-rights reservation.
- Privacy Policy rewritten for Cloudflare as processor: exact browser
  storage, cookies, Turnstile, D1 retention (Suggest notes 180 days,
  idempotency 7 days), rights under Law No. 91/2025/QH15 and the GDPR.
- EULA covers only the desktop and Android apps (also the installer RTF).
- Disclaimer, Security Policy (private reporting, scope, safe harbor) and
  Code of Conduct (Contributor Covenant 2.1) rewritten; PAT, GPG and
  Telegram-bot material removed.

Docs and templates
- README / CONTRIBUTING (EN + VI), webapp/README, TAURI.md, dev_env
  (EN + VI), THIRD_PARTY, ACKNOWLEDGEMENTS; new docs/operations.md
  (Cloudflare + GitHub setup, v4 release order, routine tasks).
- CLAUDE.md rewritten for the v4 architecture; CHANGELOG [4.0.0].
- Issue templates: config.yml (Suggest page + private security reports),
  "Add games" points to /suggest, "Remove a game" gained a rights-holder
  section; PR templates updated; CODEOWNERS.
- Dependabot npm version updates resume with the v4 merge (limit 5).

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 17:55:02 +07:00
poli0981andClaude Opus 5 e020be12fa feat(pipeline): rotating refresh + patch/apply pipeline, drop lists/ (v4 Phase 1) (#82)
* feat(pipeline): rotating refresh + patch/apply pipeline, drop lists/

Replace check_paid / check_alive / update_reviews / update_status: each
crawled all 2,600+ pages sequentially, overran its job timeout, saved
only at the end and has lost every run since late June (unreported:
timeouts end as "cancelled").

- scripts/refresh.py: daily slice of ~1/7 of the catalog (pending
  strikes first, then least recently checked), one GET per game for
  alive / paid / rating / status (+ release_date, thumbnail, updated_at
  backfill). Removal needs the same 404/410 or paid strike on two
  different UTC days. Paced requests, capped Retry-After back-off, stop
  after 3x 429, checkpoints and an in-script deadline. --full replaces
  force_update.py (rotating batches, editable fields preserved).
- Scanners emit a URL-keyed patch (patch.py); apply_patch.py applies it
  to the latest main and runs validate.py; bash/commit_push.sh fetches,
  re-applies and retries pushes, so concurrent writers never clobber
  each other.
- update_info.py: canonical URLs (canonical.py), skip games in the
  deleted log, keep transient failures queued (max 3 runs, tracked in
  scripts/state/), stamp added_at, never drop links queued meanwhile.
- data_store.py: games stay in their chunk, re-slice only past
  thresholds, write only changed bytes; index/count_history change only
  with data (no more no-op commits).
- validate.py (schema, enums, canonical/unique URLs, index consistency)
  + normalize one invalid safe_virus ("y" -> "Yes").
- tests/: 85 network-free pytest cases, HTML fixtures (from sample/),
  shared URL vectors and golden chunk/serialization fixtures for the
  future Worker port.
- Workflows: refresh.yml (scan -> apply -> notify), update.yml (runs on
  queue change), force_update.yml (refresh.yml full mode),
  notify-failure.yml (Discord on failure/cancel/rate limit),
  python-ci.yml, webapp-ci.yml, deploy-status.yml; draft-first release
  with one create-release job and tauri-action v1, no caches in release
  builds; SHA-pinned actions, permissions: {} defaults, reusable
  workflows pinned with explicit secrets, injection fixes; dependabot.yml.
- Remove lists/, generate_md, generate_table, log_deleted,
  deleted_games.txt, the Telegram bot-ingest path and old bash wrappers;
  update README (EN/VI), CONTRIBUTING, templates, CLAUDE.md, CHANGELOG
  and mark the retired Telegram path in the policies.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* fix(pipeline): review findings on the refresh / ingest rewrite

Removals
- Mass-change guard: a run whose removals or new strikes exceed
  max(10, 10%) of the games it checked withholds all its removals and
  alerts (mass_change). Withheld games are marked withheld_at and stay
  withheld in later (even single-URL or rate-limited) runs until a healthy
  check clears them or a run is dispatched with allow_mass_removal.
- Checkpoints never carry removals, so a scan that dies before its guard
  cannot delete games; apply_patch re-checks the per-run limit and caps
  any patch at max(25, 5%) of the catalog (ALLOW_MASS_REMOVAL=1 overrides).
- Strikes mature by time, not calendar day: a second sighting must come
  >= 20 h after the first (strike_at), so two checks around midnight UTC no
  longer remove a game.
- Overlapping scans can't undo each other: refresh_state merges keep the
  newest check and the newest full stamp in either apply order, and a
  removal is skipped when a newer check has landed since.
- A corrupt count_history.json fails the apply instead of being replaced
  by a one-row history.

Ingest
- A second spelling of a queued game no longer drops the first copy
  before it reaches a final outcome.
- A dispatched url is processed first and kept in temp_link.json
  (queue_add) until it finishes, so a retry, deadline or rate-limit stop
  keeps it.
- Failures count as an attempt only >= 6 h apart and a 429 counts as none,
  so a burst of queued runs can't burn a link's three attempts.
- Non-string queue entries are cleaned on every apply instead of crashing
  it; {"url": ...} objects are unwrapped.

CI
- queue: max on the ingest, refresh-apply and force-update concurrency
  groups: the default queue replaced (and silently dropped) pending runs.
- Seed scripts/state/*.json and mkdir -p before git add (the pathspec
  failed on an empty patch until the directory existed on main).
- Cancelling a refresh / force-update / desktop release really stops it
  (!cancelled() instead of always()).
- deploy-status.yml becomes an hourly check of main's latest finished
  "Workers Builds: free-games-itchio-list" run (bash/cf_build_status.sh):
  GitHub never starts check_run workflows for GITHUB_TOKEN data commits.
- The reusable release notifiers still take their script from
  poli0981/.github@main; the caller comments now say so.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* fix(pipeline): close the remaining mass-removal and monitor gaps

From the second review round of the pipeline fixes:
- A strike spike now marks every strike of that run withheld_at (the
  checkpoint of a run that dies mid-spike too), so a later short,
  rate-limited or single-URL run can't remove them without an
  allow_mass_removal dispatch.
- Withheld games take at most half of a run's budget (all of it for the
  allow_mass_removal run that confirms them), and a withheld full-mode
  game moves its `full` stamp, so neither rotation stalls on them.
- refresh.yml runs one scan -> apply pipeline at a time (workflow-level
  concurrency refresh-pipeline, queue: max), so an older removal can't be
  applied after a newer healthy check of the same game.
- deploy-status.yml alerts once per failed Cloudflare build, keyed on its
  check-run id and marked only after the Discord post, instead of by age
  (which could drop an alert after a missed run, or repeat it); the
  monitor walks main's first-parent history so preview builds of merged
  branch commits are never mistaken for the site's build.
- CLAUDE.md: merge PRs with squash or a merge commit, never by fast-forward.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 17:52:57 +07:00
poli0981andClaude Opus 5 1c600586a4 fix: deploy the real build to freeitchgames.win + Phase 0 hotfixes (#81)
- Add webapp/wrangler.jsonc (Workers static assets from ./dist, SPA
  fallback, workers_dev/preview_urls off) and build the web app to
  webapp/dist. The config-less Workers Builds deploy was serving the raw
  webapp/ source tree (blank page, /package.json and /src/* public).
- npm audit fix in-range (vite 8.3.0, react-router-dom 7.18.4, postcss
  8.5.28, transitive fixes): closes all Dependabot alerts, audit = 0.
  Add wrangler as a pinned devDependency, engines node >=22.22,
  .node-version 24.
- public/_headers: Referrer-Policy, frame denial, Permissions-Policy,
  COOP, CSP report-only; immutable cache for hashed /assets/*.
- release_android.yml: Node 24 action majors (setup-java v6,
  upload-artifact v7, setup-android v4, checkout/setup-node v7),
  SHA-pinned, timeout + concurrency, tag via env.
- GitHub Pages now publishes only a redirect stub (pages-redirect/)
  that keeps #/ routes and clears the old PAT/GPG localStorage keys;
  drop notify-deploy.yml.
- .gitattributes: fix invalid '* text = auto' / '* eol = lf'; binary
  rules; stop export-ignoring README/policy docs. .gitignore: local
  contacts/QR assets, wrangler state, .dev.vars, keystores.
- Scraper workflows: unbuffered UTF-8 logs; pause the schedules of
  check_paid/check_alive/update_reviews/update_status (full passes over
  2,600+ games exceed their timeouts and lose all work).
- Point canonical/og/manifest/sitemap/robots and doc links at
  freeitchgames.win; regenerate OG image (fit title); interim Cloudflare
  notice in the Privacy Policy.

Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 16:26:06 +07:00
poli0981andClaude Opus 4.7 89e0197ee5 release(v3.1.4): legal docs rewrite, Vietnamese i18n, Legal Card, UI polish (#38)
Rewrote the four English legal docs (DISCLAIMER, EULA, ToS, PrivacyPolicy) to
be tighter and more enforceable while keeping the project's voice — TL;DR, numbered
sections, definitions, severability, governing law (Vietnam), explicit "not legal
advice" notice, removal-request path. PrivacyPolicy now includes per-storage
table and PAT lifecycle steps.

Added Vietnamese translations for all six policy / community docs under
docs/i18n/vi/ plus a top-level README.vi.md. Each VI file notes that the English
version is the controlling text for legal interpretation.

About page: new "Legal & policies" Card listing Disclaimer, EULA, ToS, Privacy,
Code of Conduct, Security, License (MIT), and Changelog with a pointer to the
Vietnamese translations. New LegalLink interface + LEGAL_LINKS const in
webapp/src/lib/about.ts following the THIRD_PARTY/SOCIAL_LINKS pattern.

Optional UI:
- Tauri desktop: maximize button disabled (maximizable: false in
  tauri.conf.json). Window remains resizable.
- DataTable: scrollbar hidden via new .scrollbar-hide Tailwind utility added to
  webapp/src/index.css; scrolling still works.

Bookkeeping: README badge bumped to 3.1.4 + Vietnamese language badge + pointer
to README.vi.md and docs/i18n/vi/. CHANGELOG entry for 3.1.4.

Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-05 11:55:18 +07:00
poli0981 e2728be0a5 Add docs & fix comment 2025-12-28 16:37:25 +07:00