© Chucky Software Other Website Cloner by LB

[Admin]

==============================================================================
==============================================================================
--------- Клонер сайтов на Node.js (ESM, TypeScript).
------- Playwright + playwright-extra (stealth) качает ассеты через axios
------ Перезаписывает ссылки на локальные пути и упаковывает результат в zip.
----- Есть CLI, локальный веб-GUI (браузер) и десктоп (WPF) с тем же опциями.
==============================================================================
==============================================================================
site-cloner.exe - Десктоп (WPF) — основной запуск двойным щелчком
site-cloner-server.exe - Бэкенд: CLI + веб-GUI в браузере (без окна WPF)
==============================================================================
==============================================================================
======> Реализовано:
[+] Рендер через Playwright + stealth; повтор/backoff, Retry-After, keep-alive.
[+] SSRF-блок приватных адресов + защита от path traversal.
[+] Стриминг больших файлов (openStream / pipeToFile) без загрузки в память.
[+] Перезапись a[href], link/script/img/source/srcset, CSS url() и @import, инлайн-<style>, srcset, m3u8.
[+] Charset из Content-Type (в т.ч. windows-1251).
[+] Proxy: http/https/socks5 (+ авто-нормализация схемы), Playwright + axios.
[+] Manifest с хэшами и режимы resume / update.
[+] Обнаружение URL через sitemap.xml (включая sitemap-index и gzip).
[+] Обход SPA: роуты из JS (--spa) и подсказки из JSON API при --spa-xhr.
[+] Glob/re-фильтры URL, вырезание типовых tracker-тегов из HTML.
[+] Auth: storageState, интерактивный --auth-login, сохранение сессии.
[+] WARC 1.1 (gzip) для архивирования HTTP.
[+] Экспорт зеркала в каркас Hugo (static/ + hugo.toml) и Next (public/ + App Router).
[+] Cluster: шардирование URL и --cluster-workers с merge *.shard*.manifest.json.
==============================================================================
==============================================================================


--------- Site cloner on Node.js (ESM, TypeScript).
------- Playwright + playwright-extra (stealth) pumps assets via axios
------ Overwrites links to local paths and packages the result in a zip.
----- There is a CLI, a local web GUI (browser) and a desktop (WPF) with the same options.


site-cloner.exe - Desktop (WPF) — basic double
-click launch site-cloner-server.exe - Backend: CLI + web GUI in browser (without WPF window)


======> Implemented:
[+] Rendering via Playwright + stealth; repeat/backoff, Retry-After, keep-alive.
[+] SSRF-block of private addresses + protection from path traversal.
[+] Streaming of large files (openStream / pipeToFile) without loading into memory.
[+] Overwriting a[href], link/script/img/source/srcset, CSS url() and @import, inline<style>, srcset, m3u8.
[+] Charset from Content-Type (including windows-1251).
[+] Proxy: http/https/socks5 (+ auto-normalization scheme), Playwright + axios.
[+] Manifest with hashes and resume/update modes.
[+] URL detection via sitemap.xml (including sitemap index and gzip).
[+] SPA bypass: routes from JS (--spa) and hints from the JSON API for --spa-xhr.
[+] Glob/re-URL filters, cutting out typical tracker tags from HTML.
[+] Auth: storageState, interactive --auth-login, session saving.
[+] WARC 1.1 (gzip) for HTTP archiving.
[+] Exporting mirrors to the Hugo framework (static/ + hugo.toml) and Next (public/ + App Router).
[+] Cluster: URL sharding and --cluster-workers with merge *.shard*.manifest.json.