Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Wayback Archive source is not working #50

Open
Devang-Solanki opened this issue Aug 20, 2024 · 0 comments · May be fixed by #59
Open

Wayback Archive source is not working #50

Devang-Solanki opened this issue Aug 20, 2024 · 0 comments · May be fixed by #59
Assignees
@dogancanbakir
Labels
Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors.

Comments

@Devang-Solanki
Copy link

tldfinder version:

[INF] Current Version: v0.0.1

tldfinder command:

~/go/bin/tldfinder -d com -all -sources waybackarchive -v

Current Behavior:

[INF] Current tldfinder version v0.0.1 (latest)
[INF] Loading provider config from /home/devang/.config/tldfinder/provider-config.yaml
[DBG] Selected source(s) for this search: bufferover, censys, dnsrepo, netlas, crtsh, waybackarchive, whoisxmlapi
[INF] Enumerating sub(domains) for "com" TLD
[DBG] Cannot use the dnsrepo source because there was no API key/secret defined for it.
[DBG] Cannot use the bufferover source because there was no API key/secret defined for it.
[DBG] Cannot use the censys source because there was no API key/secret defined for it.
[DBG] Cannot use the whoisxmlapi source because there was no API key/secret defined for it.
[DBG] Cannot use the netlas source because there was no API key/secret defined for it.
[WRN] Could not run source crtsh: pq: Sorry, the "certificate_identity" table has been superseded by a Full Text Search index on the "certificate" table.
[DBG] Response for failed request against http://web.archive.org/cdx/search/cdx?url=*.com/*&output=txt&fl=original&collapse=urlkey:
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN">
<title>403 Forbidden</title>
<h1>Forbidden</h1>
<p>This type of CDX query requires authorization.</p>
[WRN] Could not run source waybackarchive: unexpected status code 403 received from http://web.archive.org/cdx/search/cdx?url=*.com/*&output=txt&fl=original&collapse=urlkey
[DBG] Response for failed request against https://app.netlas.io/api/domains_count/?q=domain:*.com:
{"detail":"api key doesn't exist"}
[WRN] Could not run source netlas: unexpected status code 400 received from https://app.netlas.io/api/domains_count/?q=domain:*.com
[INF] Found 0 domains for com in 626 milliseconds 76 microseconds

Expected Behavior:

Returns tld from waybackarchive

Steps To Reproduce:

  1. Run ~/go/bin/tldfinder -d com -all -sources waybackarchive -v
  2. See error...

image
@Devang-Solanki Devang-Solanki added the Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors. label Aug 20, 2024
@dogancanbakir dogancanbakir self-assigned this Aug 20, 2024
@dogancanbakir dogancanbakir linked a pull request Aug 28, 2024 that will close this issue
Open
4 tasks
@dogancanbakir dogancanbakir linked a pull request Aug 28, 2024 that will close this issue
Allow private tlds only #59
Open
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dogancanbakir dogancanbakir

Labels
Type: Bug Inconsistencies or issues which will cause an issue or problem for users or implementors.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Allow private tlds only projectdiscovery/tldfinder
2 participants
@dogancanbakir @Devang-Solanki