12 Commits
Author SHA1 Message Date
poli0981andClaude Opus 5.5 45f64e6c39 docs(rate-limits): Worker binding counts per machine; test over one connection (#168)
Measured on production after the 4.5.0 deploy: with a new connection per
request, 1,000 requests in 53 s got no 429 from RL_SITE (120/60 s); over
one keep-alive connection, 429 after ~93. The ratelimits binding counts per
machine of a data centre and syncs late, so the zone's WAF rule is the
limit that holds against floods. Verified once the owner set the rule
(300/10 s): 800 requests in 4.9 s gave 111 x 200, 201 x Worker 429 and
488 x WAF 1015, with the site answering again 10 s later.

Runbook test commands, code comments, CLAUDE.md gotcha 43, the 4.5.0
changelog entry.

[skip-discuss]

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 06:17:42 +07:00
poli0981andClaude Opus 5.5 7920011c70 feat(worker): rate limits for the whole site (4.5.0) (#167)
Every request that runs the Worker is counted per client (IPv4, or IPv6
/64): RL_SITE 120/min (app pages, public /api, the old apps' /data JSON,
misses), RL_IMG 600/min (covers), RL_ADMIN 300/min (/admin + /api/admin);
RL_SUGGEST 5 and RL_GATE 20 stay on top for their POSTs. Verified bots are
not counted. Over a limit: 429 + Retry-After 60 (JSON for the API, covers,
files and /data with CORS; a script-less EN/VI page for app pages). Fails
open.

Every rate-limit namespace moves to 8801-8806 (staging 8901-8906):
namespace ids are account-wide, and other Workers on the account use
1001-1006, so RL_SUGGEST / RL_GATE shared their counters.

docs/operations.md section 1 step 15: the zone's WAF rate-limiting rule as
the first layer (Free plan: one rule, IP, 10 s; 300 requests / 10 s).

[skip-discuss]

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 06:02:49 +07:00
poli0981andClaude Opus 5.5 f199e2ea17 Retire the browser extension's ingest API; release 4.4.1 (#138)
The browser extension (poli0981/itch-f2p-extension) and the Telegram bot (poli0981/telegram-scraper-bot) are archived. Removed: POST /api/ingest (ingest.ts, requireService, the idempotency store, RL_INGEST, ACCESS_AUD_INGEST; it never received a game), the admin's "Browser extension" auto-approve source and "Extension" queue label, and the About page's Telegram numeric-ID note. No D1 migration: the idempotency table and the 'ext' CHECK stay.

Policies (Privacy, ToS, EULA + installer RTF, Disclaimer, Security; EN + VI) drop the extension / ingest wording; Last updated 2026-10-16, LEGAL_VERSION unchanged. Docs, CLAUDE.md and pipeline comments updated.

Release 4.4.1 (also ships #131, #135, #136, #137).

[skip-discuss]

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 17:56:46 +07:00
poli0981andClaude Opus 5.5 b0ebb8e9c6 chore(wrangler): drop inherited workers_dev / preview_urls from env.staging (#110)
Both keys are inheritable in wrangler, so staging already resolves to
false from the top level (checked with unstable_readConfig). Vars,
bindings and the empty crons override stay: those are not inherited.

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-04 08:38:25 +07:00
poli0981andClaude Opus 5.5 a3bfe04b40 Compact catalog packs, binary cache, themed scrollbars; bump to 4.2.0 (#103) [skip-discuss]
- Catalog packs: the build emits /data/pack/manifest-v1.json plus
  content-hashed deflate-raw packs (columns + dictionaries); the site and
  the apps read them (about 264 KB on a first visit instead of about 520 KB
  of JSON). Descriptions live in their own packs and load on demand (a game
  page: its chunk; a search: all of them).
- The IndexedDB cache is stored as compressed bytes by a small binary
  persister (replaces @tanstack/query-async-storage-persister); fflate is
  the lazy fallback where the browser has no Compression Streams.
- The readable /data/*.json goes only to apps 4.0-4.1.1 (Tauri Origin);
  everyone else gets a 410 with links to the repository
  (worker/legacy-data.ts, five positive run_worker_first entries).
- /img: exact width strings only, fallback originals and missing images
  kept at the edge for a day, failed background puts are logged.
- Themed scrollbars and a "Hide scrollbars" setting (Settings and the
  display menu); chart cards no longer block their list scrollbars.
- Policies (LEGAL_VERSION 2026-10-03): data reuse goes through the
  repository. Docs, changelog and version 4.2.0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-03 19:19:42 +07:00
poli0981andClaude Opus 5.5 2c2d990f33 feat(worker): Turnstile verification gate for the web app
Until a visitor passes a Cloudflare Turnstile check, app pages ("/" is
now Worker-first too) answer with a self-contained verification page and
/img covers with 403, so a browser loads nothing of the site before the
check. Passing sets an HttpOnly, host-only cookie (HMAC of its issue
time) good for BOT_GATE_TTL_HOURS (48). The page then reloads into the
link that was asked for, and the legal gate follows as before.

- /assets, /data (desktop/Android apps, CC BY reuse), robots, sitemap,
  og image, /api/* and /admin* stay ungated.
- Verified bots pass with the token a zone Transform Rule adds
  (x-fig-known-bot); clients that only claim to be a search crawler get
  a 503, never the noindex page.
- Fails open: it needs BOT_GATE="on", the Turnstile keys, GATE_SECRET
  and GATE_BOT_TOKEN; deleting GATE_SECRET switches it off at once.
- POST /api/verify: same-origin, RL_GATE (IPv4 / IPv6 /64), siteverify
  with action "gate". GET reports the pass for the page and the SPA.
- turnstile.ts: siteverify shared with Suggest, which now also checks
  the hostname and action (a token from one page can't be spent on the
  other) and answers 503 when Turnstile is unreachable.
- SPA: a tab whose pass ran out re-checks when shown again or when a
  cover fails, and reloads into the verification page.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-24 17:56:33 +07:00
poli0981andClaude Opus 5 e4a5ee532d fix(worker): keep the dashboard settings in wrangler.jsonc; Access fixes
- wrangler.jsonc vars now hold the production values set in the dashboard
  (GitHub App ids, Access team domain and AUD tags, Turnstile site key).
  A deploy replaces plain-text variables with the file's values, so the
  next data commit would have blanked them.
- access.ts: ignore a trailing slash in ACCESS_TEAM_DOMAIN (the issuer is
  the bare origin; the dashboard value had one).
- /admin redirects to /admin/ (the path the Access application covers), so
  the visitor gets the login page instead of a 403.
- Runbook: values must be changed in the file.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 22:18:37 +07:00
poli0981andClaude Opus 5 902384ea2f feat(web): v4 redesign — top nav, Welcome page, URL-synced filters (v4 Phase 3)
Implements the approved mockup (Free Itch Games, dark and light).

- Tailwind CSS 4 via @tailwindcss/vite (no PostCSS / tailwind.config), design
  tokens in src/index.css, tw-animate-css, self-hosted Geist / Geist Mono.
- A sticky top nav (global search with the / shortcut, display menu for
  theme / language / density / 18+, phone sheet menu) and a footer replace the
  sidebar; the window scrolls, with scroll restoration on back / forward.
- Welcome page at / (catalog status, features, recently added) replaces the
  dashboard.
- Games: search, genre / platform / status / tags / language / input / engine,
  minimum rating, plays-in-browser, sort and page live in the URL
  (lib/game-filters.ts, unit-tested); facet counts ignore their own filter;
  a table on desktop, a list on phones, 100 per page. Counts show the whole
  catalog while 18+ games are hidden.
- New game detail page (breadcrumb back to the same list, facts, tags that
  open the matching list, copy link, report a problem), searchable Removed
  page, simpler Settings, restyled error pages and charts header.
- Legal gate is an overlay above the page (deep links land where they
  pointed), with translated document names; no "Leave" button in the apps.
- Cached data stays on screen when a background refresh fails (offline).
- Numbers and dates follow the language (lib/format.ts).
- New favicon, PWA icons and OG image from the same tokens
  (scripts/gen_assets.py uses the Geist fonts from node_modules).
- Removed: sidebar, dashboard, data-table components, TanStack Table /
  Virtual, sonner and toast settings, the unused Select primitive; 81 unused
  i18n keys; prefs now persist only the keys still in use.
- Review fixes: routers without startTransition (useSearchParams was stale,
  so quick filter clicks and typed searches overwrote each other or pulled
  the visitor back from a game); paging starts at the top and Back returns
  to the old position; the 18+ confirmation is an in-app dialog
  (window.confirm is a no-op in the macOS app); the apps show only the legal
  gate until it is accepted (covers load from itch.io there); breadcrumb goes
  back; named popovers, list semantics, IME-safe Enter, English plurals,
  pointer cursor, --brand-soft without color-mix, copy-link fallback.
- wrangler.jsonc: id of the production D1 database (created by command,
  0001_init applied); runbook notes that R2 must be enabled first.
- Docs: CLAUDE.md, CHANGELOG, webapp README / TAURI.md, THIRD_PARTY,
  ACKNOWLEDGEMENTS, docs/operations.md; Dependabot groups for Tailwind 4.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 21:21:14 +07:00
poli0981andClaude Opus 5 8f121a8e9c feat(worker): review queue, admin API, ingest and suggest endpoints (v4 Phase 4)
Adds the server side of the admin and the automatic game discovery. The
catalog stays JSON in this repo; the Worker writes it as a GitHub App
(GraphQL createCommitOnBranch with expectedHeadOid: verified commits,
retried on a race) and keeps only the review queue in D1.

- worker/admin.ts: /api/admin/* (queue list, approve/reject, add, edit the
  three maintainer fields, remove with reason + R2 cover cleanup, restore)
  and the /admin shell with its own CSP. Every request re-verifies the
  Cloudflare Access JWT (aud + maintainer email + same-origin writes).
  Approving commits to scripts/temp_link.json, which starts update.yml.
  The maintainer's email goes to the D1 audit log only, never a commit.
- worker/ingest.ts: POST /api/ingest for the browser extension (Access
  service token, per-client rate limit, Idempotency-Key replay, <= 150
  items / 64 KB), replacing its PAT commits.
- worker/suggest.ts: public POST /api/suggest (same-origin, per-IP rate
  limit, Turnstile siteverify, canonical itch.io URL) into the queue.
- worker/discover.ts + scheduled(): every 4 h, one itch.io RSS feed
  (round-robin, 6 h back-off on 429) into the queue, then reconcile
  (queued -> ingested / failed) and retention (idempotency 7 d, form
  notes 180 d).
- worker/queue.ts: URL classification (catalog, pending, deleted,
  blocklist) and the D1 store; worker/repo.ts builds each admin commit
  from the files at the head of main, byte-compatible with the Python
  pipeline (golden fixtures).
- wrangler.jsonc: D1 (bound by name; migrations applied by hand), rate
  limits, cron, non-secret settings as vars (empty until setup: features
  answer 503 until configured), staging env without the cron.
  `npm run cf:types` ignores .dev.vars so the committed types are stable.
- Tests: 159 passing; the SQL runs against a real local D1 (workerd via
  wrangler's platform proxy).

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 17:55:01 +07:00
poli0981andClaude Opus 5 ce177d8f27 fix(web): review findings on the Worker platform (v4 Phase 2)
- Missing files no longer get the app shell: `not_found_handling: "none"`
  and worker/spa.ts answer /assets/*, /data/* and file-like misses with a
  real 404 (no-store). A stale hashed chunk used to get index.html with
  the year-long immutable cache of /assets/*. Routes get the shell with
  200; unknown paths and unknown game slugs get it with 404.
- Recharts is off the first load again (~314 -> ~195 KB gzip): drop the
  vendor-charts group, which captured React and clsx, and give
  vendor-react the top priority.
- Web build target restored (Safari/iOS 15.4): Vite 8's default shipped
  Radix class static blocks unlowered, a blank page on iOS 15.
- The allow-list cache shares only loaded values, never an in-flight
  promise: a cancelled first /img request hung every later one.
- /img answers upstream resets and R2 errors with a 502 instead of an
  uncaught exception, and releases unused upstream bodies.
- Per-route canonical + robots (useSeoHead) instead of a static root
  canonical and og:url on every page.
- Legacy hash redirect: crafted hashes (#//host, #/\host) go home
  instead of throwing before React mounts.
- Chunk-reload guard is time-windowed and storage-safe.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 17:55:01 +07:00
poli0981andClaude Opus 5 1910d61d08 feat(web)!: Cloudflare Worker platform, read-only app (v4 Phase 2)
BREAKING: the public web app has no sign-in anymore and uses real paths
(BrowserRouter); /add and /workflows are gone (admin comes in Phase 4).

Platform
- wrangler.jsonc: Worker (worker/index.ts) + static assets with SPA
  fallback; only /img/* and /api/* run the Worker. R2 binding THUMBS,
  `staging` env for the v4 pre-release Worker. worker-configuration.d.ts
  from `wrangler types` (checked in CI with --check).
- vite-plugins/catalog-data.ts bundles data_game + deleted log into
  dist/data (build fails on bad JSON / index mismatch), emits urls.json
  (thumbnail allow-list) and a real-path sitemap; version.json carries
  the build stamp so data-only rebuilds keep identical JS.
- Data is read same-origin from /data (Tauri: https://freeitchgames.win/data,
  CORS *); chunks load with allSettled.
- worker/img.ts: /img/<160|640>/<itch path> serves a WebP rendered once
  per image+width by Image Transformations and stored in R2 (edge cache
  → R2 → transform); catalog allow-list, fixed upstream host, hotlink
  block, streamed original on transform failure, 403/404 upstream → 404.
  15 vitest cases.
- Enforced CSP (same-origin + Web Analytics/Turnstile), cache headers for
  /assets, /data, og/icons; security.txt; robots disallows /api, /admin.

App
- Remove PAT/GPG sign-in, bulk edit/delete, undo, workflow dispatch,
  Octokit and OpenPGP (and ~220 write-path i18n keys); Settings keeps
  language/theme/density/notifications only.
- react-router 8 (unified package), React 19.3, TanStack/Recharts/etc.
  minors, Vite 8 rolldown codeSplitting groups; legacy #/ links are
  rewritten to paths; old PAT/GPG localStorage keys are cleared; reload
  once on vite:preloadError after a deploy.
- GameThumb uses the /img proxy (referrerPolicy no-referrer, N/A-safe).

Tauri
- Real CSP, drop the unused http plugin + capability, read-only
  descriptions, rust-version 1.88, drop the time pin, commit Cargo.lock.

Also: remove the GitHub Pages redirect workflow/stub (deployed by v4
Phase 0); add scripts/i18n-edit.mjs (TS-parser based key maintenance for
en.ts/vi.ts).

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 17:54:49 +07:00
poli0981andClaude Opus 5 1c600586a4 fix: deploy the real build to freeitchgames.win + Phase 0 hotfixes (#81)
- Add webapp/wrangler.jsonc (Workers static assets from ./dist, SPA
  fallback, workers_dev/preview_urls off) and build the web app to
  webapp/dist. The config-less Workers Builds deploy was serving the raw
  webapp/ source tree (blank page, /package.json and /src/* public).
- npm audit fix in-range (vite 8.3.0, react-router-dom 7.18.4, postcss
  8.5.28, transitive fixes): closes all Dependabot alerts, audit = 0.
  Add wrangler as a pinned devDependency, engines node >=22.22,
  .node-version 24.
- public/_headers: Referrer-Policy, frame denial, Permissions-Policy,
  COOP, CSP report-only; immutable cache for hashed /assets/*.
- release_android.yml: Node 24 action majors (setup-java v6,
  upload-artifact v7, setup-android v4, checkout/setup-node v7),
  SHA-pinned, timeout + concurrency, tag via env.
- GitHub Pages now publishes only a redirect stub (pages-redirect/)
  that keeps #/ routes and clears the old PAT/GPG localStorage keys;
  drop notify-deploy.yml.
- .gitattributes: fix invalid '* text = auto' / '* eol = lf'; binary
  rules; stop export-ignoring README/policy docs. .gitignore: local
  contacts/QR assets, wrangler state, .dev.vars, keystores.
- Scraper workflows: unbuffered UTF-8 logs; pause the schedules of
  check_paid/check_alive/update_reviews/update_status (full passes over
  2,600+ games exceed their timeouts and lose all work).
- Point canonical/og/manifest/sitemap/robots and doc links at
  freeitchgames.win; regenerate OG image (fit title); interim Cloudflare
  notice in the Privacy Policy.

Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 16:26:06 +07:00