Import: ICU error

[isgat]

Hi. I'm trying to import pbf file, but getting error when tokenizer starts. I thought it was because of old version of ICU (50.2), so I upgraded it to 71.1 but I get the same error.

2023-01-13 11:48:22: Using project directory: /srv/nominatim/nominatim-project
2023-01-13 11:48:26: Creating database
2023-01-13 11:48:28: Setting up country tables
2023-01-13 11:48:29: Importing OSM data file
2023-01-13 11:48:29  osm2pgsql version 1.7.2
2023-01-13 11:48:29  Database version: 13.9
2023-01-13 11:48:29  PostGIS version: 3.0
2023-01-13 11:48:30  Parsing gazetteer style file '/usr/local/etc/nominatim/import-extratags.style'.
NOTICE:  table "place" does not exist, skipping
2023-01-13 13:52:55  Reading input files done in 7465s (2h 4m 25s).
2023-01-13 13:52:55    Processed 488790919 nodes in 993s (16m 33s) - 492k/s
2023-01-13 13:52:55    Processed 43949157 ways in 4241s (1h 10m 41s) - 10k/s
2023-01-13 13:52:55    Processed 1221076 relations in 2231s (37m 11s) - 547/s
2023-01-13 13:52:55  Done postprocessing on table 'planet_osm_nodes' in 0s
2023-01-13 13:52:55  Done postprocessing on table 'planet_osm_ways' in 0s
2023-01-13 13:52:55  Done postprocessing on table 'planet_osm_rels' in 0s
2023-01-13 13:52:55  osm2pgsql took 7466s (2h 4m 26s) overall.
2023-01-13 13:52:57: Importing wikipedia importance data
2023-01-13 13:52:57: Wikipedia importance dump file not found. Calculating importance values of locations will not use Wikipedia importance data.
2023-01-13 13:52:57: Importing secondary importance raster data
2023-01-13 13:52:57: Secondary importance file not imported. Falling back to default ranking.
2023-01-13 13:52:57: Create functions (1st pass)
2023-01-13 13:53:00: Create tables
2023-01-13 13:53:53: Create functions (2nd pass)
2023-01-13 13:53:53: Create table triggers
2023-01-13 13:53:53: Create partition tables
2023-01-13 13:54:06: Create functions (3rd pass)
2023-01-13 13:54:06: Initialise tables
2023-01-13 13:54:10: Load data into placex table
.....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................2023-01-13 14:53:08: Setting up tokenizer


Traceback (most recent call last):
  File "/usr/local/bin/nominatim", line 20, in <module>
    phpcgi_path='/bin/php-cgi'))
  File "/usr/local/lib64/nominatim/lib-python/nominatim/cli.py", line 264, in nominatim
    return parser.run(**kwargs)
  File "/usr/local/lib64/nominatim/lib-python/nominatim/cli.py", line 126, in run
    return args.command.run(args)
  File "/usr/local/lib64/nominatim/lib-python/nominatim/clicmd/setup.py", line 124, in run
    tokenizer = self._get_tokenizer(args.continue_at, args.config)
  File "/usr/local/lib64/nominatim/lib-python/nominatim/clicmd/setup.py", line 190, in _get_tokenizer
    return tokenizer_factory.create_tokenizer(config)
  File "/usr/local/lib64/nominatim/lib-python/nominatim/tokenizer/factory.py", line 69, in create_tokenizer
    tokenizer.init_new_db(config, init_db=init_db)
  File "/usr/local/lib64/nominatim/lib-python/nominatim/tokenizer/icu_tokenizer.py", line 58, in init_new_db
    self.loader = ICURuleLoader(config)
  File "/usr/local/lib64/nominatim/lib-python/nominatim/tokenizer/icu_rule_loader.py", line 59, in __init__
    self._setup_analysis()
  File "/usr/local/lib64/nominatim/lib-python/nominatim/tokenizer/icu_rule_loader.py", line 141, in _setup_analysis
    self.normalization_rules)
icu.ICUError: ("A '::id' rule specifies an unknown transliterator", -1, -1, '\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', '\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'), error code: 65569

Nominatim 4.2.0
CentOS 7.8.2003
ICU 71.1
Python 3.6.8
PyICU 2.10.2

I have no idea. What should I check?

[lonvia]

It surely looks like an issue of old ICU library. Are you sure that PyICU picks up the right version and doesn't fall back to the system-installed one?

[isgat]

You're right. PyICU used old version of ICU. It was installed before I updated ICU. I just reinstalled PyICU and the error is gone.