2023 Changelog
1.0.0-alpha.4
2023-12-26
Secutils.dev API
⚠ BREAKING CHANGES
- platform: switch to a new database migration naming schema and dedicated tables for user data
- platform: use proper REST URLs for all utilities APIs
Features
- platform: add support for job retries (constant, linear, and exponential) (secutils@f3decab)
- platform: allow cross-origin requests to the utilities APIs (secutils@c1b0dde)
- certificates: introduce support for a new
Certificates -> Private keys
utility API (secutils@ae8a581, secutils#8) - certificates: allow sharing certificate templates (secutils@1d57188)
- web-scraping: introduce
Web Scraping -> Content trackers
utility API (secutils@b879bf1) - web-scraping: add diff support for the
Web Scraping -> Resources trackers
preview (secutils@a647e79) - web-scraping: add support for custom HTTP request headers in
Web Scraping -> Resources trackers
utility API (secutils@83f48c0) - web-scraping: notify users about failed attempts to check changes in resources or content (secutils@473191e)
- web-security: implement an API for importing content security policies (CSP) (secutils@2db6c0a)
- webhooks: add support for "subdomain"-based webhook URLs (secutils@eada924)
Fixes
- platform: use
secutils/{version}
as theUser-Agent
HTTP header for all outbound HTTP requests (secutils@0a2d7e2) - web-scraping: surface web page content and resources tracker errors in the API responses (secutils@888c8ac)
- webhooks: properly handle webhook request for root path (
/
) (secutils@a5c3dcd)
Full Changelog: secutils@v1.0.0-alpha.3...v1.0.0-alpha.4
Secutils.dev Web UI
Features
- platform: add support for job retries in all web page tracker UIs (only constant strategy) (secutils-webui@b44fd2d)
- certificates: introduce UI for a new
Certificates -> Private keys
utility (secutils-webui@a9462dd, check out the guides to learn more)
- certificates: allow sharing certificate templates (secutils-webui@dc3a269, check out the guides to learn more)
- web-scraping: add UI for custom HTTP headers for web page trackers (secutils-webui@5ec9b00)
- web-scraping: introduce UI for a new
Web Scraping -> Content
utility (secutils-webui@dcde972, check out the guides to learn more)
- web-scraping: redesign web page tracker previews (secutils-webui@22bea69)
- web-security: implement UI for importing content security policies (CSP) (secutils-webui@de60ab7, check out the guides and this blog post to learn more)
- webhooks: add support for "subdomain"-based webhook URLs (secutils-webui@edc77c3, check out the guides to learn more)
- webhooks: support responders with the same path, but different HTTP methods (secutils-webui@ec43221)
Fixes
- platform: make sure grid items are rendered consistently (secutils-webui@6213cc6)
- certificates: properly handle name change in certificate template editor (secutils-webui@5134646)
- certificates: fix docs links for certificate templates and private keys (secutils-webui@87d1759)
- web-scraping: use tracker ID as a unique identifier instead of name (secutils-webui@6ead9be)
- web-security: remove
X-User-Share-Id
from URL if it is invalid to avoid infinite reload loop (secutils-webui@64ea260)
Enhancements
- web-scraping: render web page tracker name with indicators for scheduled checks and notifications (secutils-webui@7fca493)
Full Changelog: secutils-webui@v1.0.0-alpha.3...v1.0.0-alpha.4
Secutils.dev Web Scraper
Features
- web-page: add support for custom request HTTP headers (secutils-web-scraper@6a743ea)
- web-page: disable browser cache and selectively proxy requests to bypass CSP/CORS restrictions (secutils-web-scraper@6825861)
- web-page: disable CORS with
--disable-web-security
Chromium launch flag (secutils-web-scraper@f9507eb) - web-page: introduce new Web Content scraper API (secutils-web-scraper@a7d9de0)
Fixes
- web-page: bump web page
load
timeout from 5000ms to 10000ms (secutils-web-scraper@a9ee6ad) - web-page: serialize content state even if it has exceeded allowed size (secutils-web-scraper@7df4534)
- web-page: use only web page URL, headers, and user scripts to calculate cache key (secutils-web-scraper@bc163f5)
- web-page: use proper cryptographic hash for the response cache key (secutils-web-scraper@bec0919)
Enhancements
- web-page: use more stable Chrome DevTools Protocol to capture external resources (secutils-web-scraper@129ca5a)
- web-page: pretty print HTML content (secutils-web-scraper@cb613f4)
- web-page: use stable JSON stringifier to persist web page extracted content (secutils-web-scraper@5165a83)
Full Changelog: secutils-web-scraper@v1.0.0-alpha.3...v1.0.0-alpha.4
1.0.0-alpha.3
2023-10-03
Secutils.dev API
Features
- [Web Scraping] Added support for automatic scheduled checks for changes in tracked web page resources: hourly, daily, weekly, monthly. Refer to the documentation & guides to learn more. (secutils#20)
- [Web Scraping] Added support for email notifications when changes in tracked web page resources are detected. Refer to the documentation & guides to learn more. (secutils@7595eb)
- [Web Scraping] Added support for custom web resources trackers scripts (JavaScript) to assist with resource filtering and mapping. Refer to the documentation & guides to learn more. (secutils#19)
- [Web Security] Added support for shareable user resources to improve collaboration (only for CSP in this release). Refer to the documentation & guides to learn more. (secutils#21)
- [Digital Certificates] Made key size (RSA, DSA) and curve name (EC) configurable in certificate templates. (secutils#8)
Enhancements
- [Search] Upgraded to Tantivy
v0.21.0
(secutils@2a5c83) and switched to lenient query parser for the keywords search to make search more error-tolerant. (secutils@2f6c10) - [Misc] Updated OpenSSL libs in a Docker image. (secutils@e98a31)
- [Misc] Switched Docker image to use non-root user for better security. (secutils@36555c)
- [Misc] Dependency upgrades
Full Changelog: secutils@v1.0.0-alpha.2...v1.0.0-alpha.3
Secutils.dev Web UI
Features
- [Web Scraping] Added UIs to support web page resources tracking enhancements provided by the latest Secutils.dev API. (secutils-webui@d2a102, secutils-webui@f485ff, secutils-webui@683b5b)
- [Digital Certificates] Added UIs to support certificate templates enhancements provided by the latest Secutils.dev API. (secutils-webui@f83328, secutils-webui@569883, secutils-webui@de81c8)
- [Web Security] Added UIs to support shareable user resources to improve collaboration (only for CSP in this release). Refer to the documentation & guides to learn more. (secutils#21)
Enhancements
- [Misc] Switched main Docker image to
nginxinc/nginx-unprivileged:alpine3.18-slim
for better security and lighter size. (secutils-webui@b31692) - [Misc] Dependency upgrades
Full Changelog: secutils-webui@v1.0.0-alpha.2...v1.0.0-alpha.3
Secutils.dev Web Scraper
Features
- [Web Scraping] Extended Resources API to support custom JavaScript scripts for resources filtering and mapping. (secutils-web-scraper@ba5406)
POST /api/resources
Accept: application/json
Content-Type: application/json
{
"url": "https://secutils.dev",
"scripts": {
"resourceFilterMap": "return resource.type === 'script' ? resource : null;"
}
}
Enhancements
- [Misc] Enabled sandbox for the headless Chromium used to extract web page resources and switched Docker image to use non-root user for better security. (secutils-web-scraper@4717f7)
- [Misc] Dependency upgrades
Full Changelog: secutils-web-scraper@v1.0.0-alpha.2...v1.0.0-alpha.3
1.0.0-alpha.2
2023-07-25
Secutils.dev API
Features
- [Web Scraping] Added support for web page resources tracking functionality (secutils#14).
Enhancements
- [Digital Certificates] Fall back to the latest version of the X.509 certificate defined by the spec if not specified by the client (secutils#1)
- [Search] Switch to Tantivy
v0.20.0
and change data folder naming scheme to include search index version to support auto-reindexing (secutils@ef9dbf) - [Misc] Bump Docker image to Alpine 3.18 (secutil@9653ac)
- [Misc] Add parameter validation for the utils actions APIs (secutils@a02a01).
- [Misc] Dependency upgrades
Full Changelog: secutils@v1.0.0-alpha.1...v1.0.0-alpha.2
Secutils.dev Web UI
Features
- [Web Scraping] Added UIs to support web page resources tracking functionality (secutils#14).
Enhancements
- [Docs] Update footer to include links to Blog and Documentation (secutils-webui@8ce447)
- [Misc] Bump Docker "builder" image to
node:20-alpine3.18
(secutils-webui@48a505) - [Misc] Dependency upgrades
Fixes
- [Security] Recover original URL after signin (secutils#9)
- [Misc] Switch local watch port to
7171
(secutils-webui@9adb12)
Full Changelog: secutils-webui@v1.0.0-alpha.1...v1.0.0-alpha.2
Secutils.dev Web Scraper
Features
- [Web Scraping] Initial release of Secutils.dev Web Scraper component 🎉
Full Changelog: secutils-web-scraper@main
1.0.0-alpha.1
2023-06-01
ANNOUNCEMENT
This is the first public release of Secutils.dev 🎉
Secutils.dev API
Features
- [Webhooks] Added support for basic webhooks functionality.
- [Digital Certificates] Added support for generation of the certificate templates.
- [Web Security] Added support for generation of the Content Security Policies (CSP).
Secutils.dev Web UI
Features
- [Webhooks] Added UIs to support basic webhooks functionality.
- [Digital Certificates] Added UIs to support generation of the certificate templates.
- [Web Security] Added UIs to support generation of the Content Security Policies (CSP).