README

extractor/CHANGELOG.md

@@ -0,0 +1,3 @@
+# 1.0.0 (2024-05-07)
+
+- Initial release

extractor/README.md

@@ -1 +1,22 @@
 # Web page extractor
+
+Allows to extract the HTML content of a web page.
+
+## Objective
+
+When pushing regular links to your Nuclia Knowledge Box, the content of the page is extracted by the Nuclia processing, but your web pages may not be accessible from the internet. This extractor allows you to extract the content of your web pages locally and so the Nuclia Sync Agent can push the corresponding content to your Nuclia Knowledge Box.
+
+It must be used in conjunction with the [Nuclia Sync agent](https://github.com/nuclia/sync-agent).
+It must be deployed on the same machine as the Nuclia Sync agent, and it runs on port 8091.
+
+## Installation
+
+```bash
+npm install @nuclia/extractor
+```
+
+## Usage
+
+```bash
+npm start
+```

package.json

@@ -1,6 +1,6 @@
 {
   "name": "nuclia-sync-agent-app",
-  "version": "1.4.2",
+  "version": "1.5.0",
   "description": "This is a Nuclia Sync Agent App",
   "main": "build/index.js",
   "scripts": {

server/CHANGELOG.md

@@ -1,3 +1,7 @@
+# 1.5.0 (2024-05-07)
+
+- Supports local extraction of web pages
+
 # 1.4.2 (2024-04-30)
 
 - When loading folders, expose `displayPath` when needed and possible, according the connector types.