add max chunk limit into fixed token length algorithm #51
| Job | Run time |
|---|---|
| 4m 53s | |
| 7m 15s | |
| 1m 46s | |
| 7m 15s | |
| 1m 43s | |
| 1m 27s | |
| 6s | |
| 2m 23s | |
| 7m 55s | |
| 2m 50s | |
| 7m 44s | |
| 2m 23s | |
| 7m 42s | |
| 55m 22s |
| Job | Run time |
|---|---|
| 4m 53s | |
| 7m 15s | |
| 1m 46s | |
| 7m 15s | |
| 1m 43s | |
| 1m 27s | |
| 6s | |
| 2m 23s | |
| 7m 55s | |
| 2m 50s | |
| 7m 44s | |
| 2m 23s | |
| 7m 42s | |
| 55m 22s |