We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
@petrospaps I'm trying to override the dynamic=true parameter in the localconfig.properties file by using the value on the end of the url list file.
dynamic=true
localconfig.properties
Following the instructions in the README has not resulted in the static scraper being used. Below are the snippets of the url list file that I tried.
https://bgee.org/sitemap_main.xml,static https://bgee.org/?page=gene&gene_id=ENSG00000274928,static https://bgee.org/?page=gene&gene_id=ENSG00000274928, static
None of these overrode the dynamic setting in the local config file.
Even removing the setting from the local config file did not result in the static scraper being used.
I'm basing this on the following exert of the log file
11:26:16.619 [INFO] hwu.elixir.scrape.scraper.examples.FileScraper - Attempting to scrape: https://bgee.org/?page=gene&gene_id=ENSG00000274928 11:26:16.619 [INFO] hwu.elixir.scrape.scraper.ScraperFilteredCore - dynamic scraping setting 11:26:27.713 [ERROR] hwu.elixir.scrape.scraper.ScraperCore - URL timed out: https://bgee.org/?page=gene&gene_id=ENSG00000274928. Trying JSoup. 11:26:28.295 [DEBUG] hwu.elixir.scrape.scraper.ScraperFilteredCore - Number of JSONLD sections: 0
The text was updated successfully, but these errors were encountered:
Equivalent log messages when static is set in the configuration file
tatic scraping setting 11:31:29.682 [DEBUG] hwu.elixir.scrape.scraper.ScraperFilteredCore - Number of JSONLD sections: 0 11:31:29.728 [INFO] hwu.elixir.scrape.scraper.ScraperCore - https://bgee.org/?page=gene&gene_id=ENSA
Sorry, something went wrong.
Related to #85
fixed issue #86 when setting static/dynamic scrape on a specific url …
bccf6dd
…in the url list text file.
Need to document how to annotate the configuration file
petrospaps
No branches or pull requests
@petrospaps I'm trying to override the
dynamic=true
parameter in thelocalconfig.properties
file by using the value on the end of the url list file.Following the instructions in the README has not resulted in the static scraper being used. Below are the snippets of the url list file that I tried.
None of these overrode the dynamic setting in the local config file.
Even removing the setting from the local config file did not result in the static scraper being used.
I'm basing this on the following exert of the log file
The text was updated successfully, but these errors were encountered: