feat: implement text chunking processor with fixed token length and d… #181
| Job | Run time |
|---|---|
| 6m 2s | |
| 7m 32s | |
| 4m 1s | |
| 5m 45s | |
| 4m 8s | |
| 7m 11s | |
| 5m 2s | |
| 4m 46s | |
| 5m 25s | |
| 5m 40s | |
| 5m 4s | |
| 7m 11s | |
| 5m 0s | |
| 5m 57s | |
| 6m 30s | |
| 6m 18s | |
| 4m 8s | |
| 3m 53s | |
| 4m 38s | |
| 5m 3s | |
| 5m 16s | |
| 4m 48s | |
| 4m 49s | |
| 6m 37s | |
| 5m 49s | |
| 6m 8s | |
| 3m 42s | |
| 4m 2s | |
| 4m 57s | |
| 5m 1s | |
| 4m 47s | |
| 4m 53s | |
| 4m 36s | |
| 5m 40s | |
| 5m 38s | |
| 5m 52s | |
| 3h 11m 49s |