Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make a package #1

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions .github/workflows/python-publish.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
# This workflow will upload a Python Package using Twine when a release is created
# For more information see: https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-python#publishing-to-package-registries

# This workflow uses actions that are not certified by GitHub.
# They are provided by a third-party and are governed by
# separate terms of service, privacy policy, and support
# documentation.

name: Upload Python Package

on:
release:
types: [published]

permissions:
contents: read

jobs:
deploy:

runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v3
- name: Set up Python
uses: actions/setup-python@v3
with:
python-version: '3.x'
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install build
- name: Build package
run: python -m build
- name: Publish package
uses: pypa/gh-action-pypi-publish@27b31702a0e7fc50959f5ad993c78deac1bdfc29
with:
user: __token__
password: ${{ secrets.PYPI_API_TOKEN }}
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
wclone.egg-info
build
*__pycache__
.vscode
dist
74 changes: 70 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,79 @@
# Basic website cloner

**Description:**

* This script is a basic website cloner that downloads all the files from a website and saves them in a folder.
* It works by scraping all the links on the page, save them locally, and replace them with the local path.

**Usage:**
```bash
python3 website_cloner.py <url>
## Installation

## From [pypi](pypi.org).

```sh
pip3 install wclone
```

## From source

```sh
git clone https://github.com/Simatwa/website-clone.git
cd website-cloner
bash install.sh
```

## Usage

```sh
$ wclone <url>
```

**More info:**
* In order to use the tor network, you need to download the [tor package](https://www.torproject.org/dist/torbrowser/11.0.9/tor-win32-0.4.6.10.zip) and start the tor service.

* In order to use the tor network, you need to download the [tor package](https://www.torproject.org/dist/torbrowser/11.0.9/tor-win32-0.4.6.10.zip) and start the tor service.

<details>

<summary>

> For further info run `$ wclone --help`

</summary>

```
usage: wclone [-h] [-v] [-tp PROXY]
[-o FOLDER] [-w PATH]
[--use-tor]
host

Basic website cloner written in Python

positional arguments: host URL pointing to a
website
options:
-h, --help show this help
message and exit
-v, ---version
show program's
version number and
exit
-tp PROXY, --tor-proxy PROXY
Proxy server url
without schema -
localhost:9050
-o FOLDER, --output FOLDER
Folder for saving
contents - host
-w PATH, --workspace PATH
Directory for saving
contents - /data/dat
a/com.termux/files/h
ome/temp
--use-tor Use tor proxy -
False
```
</details>





235 changes: 0 additions & 235 deletions app.py

This file was deleted.

Binary file added dist/wclone-1.0.0.tar.gz
Binary file not shown.
3 changes: 3 additions & 0 deletions install.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
#!/usr/bin/bash
pip3 install .
wclone -h
Loading