Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--ignore_fragments is not supported (but documented) #38

Open
agross opened this issue Jun 3, 2016 · 5 comments
Open

--ignore_fragments is not supported (but documented) #38

agross opened this issue Jun 3, 2016 · 5 comments

Comments

@agross
Copy link

agross commented Jun 3, 2016

$ bundle exec rawler --ignore_fragments http://google.com
Error: unknown argument '--ignore_fragments'.
Try --help for help.

$ bundle exec rawler --ignore_fragments http://google.com
Error: unknown argument '--ignore_fragments'.
Try --help for help.

--help doesn't print the option, despite it being documented on GitHub.

$ bundle exec rawler --help
Rawler is a command line utility for parsing links on a website

Usage:
      rawler http://example.com [options]

where [options] are:
  --username, -u <s>:   HTTP Basic Username
  --password, -p <s>:   HTTP Basic Password
      --wait, -w <f>:   Seconds to wait between requests, may be fractional
                        e.g. '1.5' (default: 3.0)
           --log, -l:   Log results to file rawler_log.txt
   --logfile, -o <s>:   Specify logfile, implies --log (default:
                        rawler_log.txt)
           --css, -c:   Check CSS links
      --skip, -s <s>:   Skip URLs that match a pattern
     --iskip, -i <s>:   Skip URLs that match a case insensitive pattern
   --include, -n <s>:   Only include URLS that match a pattern
  --iinclude, -d <s>:   Only include URLS that match a case insensitive
                        pattern. Equivalent to '--include
                        ^http://mysite.com/*'.
         --local, -a:   Restrict to the given URL and below
       --version, -v:   Print version and exit
          --help, -h:   Show this message
@agross
Copy link
Author

agross commented Jun 3, 2016

$ gem list --local rawler

*** LOCAL GEMS ***

rawler (0.1.8)

@matkoniecz
Copy link

@oscardelben So this gem is dead, right?

@agross
Copy link
Author

agross commented Jan 25, 2017

@matkoniecz I think it is. In the meantime I switched to this one which also has more features: https://www.npmjs.com/package/broken-link-checker

@matkoniecz
Copy link

@agross Thanks for a recommendation!

@oscardelben
Copy link
Owner

Hi,

It's not actively maintained. Sorry about that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants