[components] Expose the worker in a specific file instead of inlining it?

[severo]

The worker is currently inlined (base64):

hyperparam-cli/packages/components/src/workers/parquetWorkerClient.ts

Line 1 in c536f49

import ParquetWorker from './parquetWorker?worker&inline'

The result from npm run build:

> @hyparam/[email protected] build
> tsc && vite build

vite v5.4.10 building for production...
✓ 42 modules transformed.

[vite:dts] Start generate declaration files...
computing gzip size (0)...[vite:dts] Declaration files built in 2095ms.

dist/index.es.js  237.16 kB │ gzip: 124.11 kB │ map: 128.20 kB
dist/index.umd.js  225.50 kB │ gzip: 122.69 kB │ map: 124.80 kB
✓ built in 2.83s

The alternative is to remove &inline. In this case, the result of npm run build is:

> @hyparam/[email protected] build
> tsc && vite build

vite v5.4.10 building for production...
✓ 42 modules transformed.

[vite:dts] Start generate declaration files...
dist/assets/parquetWorker-KNlj7o13.js  145.82 kB
dist/index.es.js                        42.16 kB │ gzip: 12.44 kB │ map: 128.00 kB
[vite:dts] Declaration files built in 2181ms.

dist/index.umd.js  30.63 kB │ gzip: 11.03 kB │ map: 124.65 kB
✓ built in 2.92s

But it means the users must serve the worker file in their app, which means docs + support.

[severo]

refs:
vitejs/vite#15547
vitejs/vite#7352

[severo]

Also look at how it's handled in other libraries:

• https://github.com/arethetypeswrong/arethetypeswrong.github.io/blob/main/packages/web/worker/tsconfig.json
• https://github.com/mholt/PapaParse/blob/4af6882e0ea91b0baad30345f190b38d50e7535e/papaparse.js#L49

[severo]

Also see https://github.com/surma/rollup-plugin-off-main-thread (seen in https://www.npmjs.com/package/microbundle#building-module-workers), in particular look at the gist which shows the result:

https://gist.github.com/surma/a02db7b53eb3e7870bf539b906ff6ff6

---

Also (unrelated): should we look at https://github.com/GoogleChromeLabs/comlink? It removes the need to use postMessage... Not sure if it's a good idea to add this extra-layer though.