CHANGELOG.md

Change Log

All notable changes to this project will be documented in this file.

Upgrade version:

• git checkout main
• git pull

Upgrade library dependencies (if required):

• python3 -m pip install -r requirements.txt -U

[8.2.0] - 2023-04

• removed statsmodels which has a dependency on scipy which is huge and causes a lot of problems

[8.0.*] - 2023-04

• bug fixes and improvements

[8.0.0] - 2023-04-07

• added Coinbase Advanced Trade exchange

[7.0.*] - 2023-01

• version 7 is released as a major update
• version 7.0.* will include hotfixes
• ui is now using the rich library with colour
• technical indicator code migrated to pandas-ta
• additional technical analysis options
• strategy code improved
• many code improvements and bug fixes
• docker build improved
• additional unit tests

[6.4.3] - 2022-06-12

• fixed variable "err" referenced before assignment in Kucoin and CoinbasePro API files that was introduced in v6.4.2
• consolidated some code in Kucoin and CoinbasePro API files, eliminating a bunch of duplicated lines
• added dataframe variable to additional execute_job function calls in pycryptobot.py to help minimize API requests

[6.4.2] - 2022-06-12

• changed a couple config settings so they can be disabled via command line arguments
• fixed CoinbasePro and Kucoin API errors for standard API access - believe all errors causing restarts are now resolved Only an occasional HTML Error which can't be fixed on our end.
• moved get_ticker call up pycryptobot.py to be inline with get_historical_data and add a new row data with ticker before technical anlaysis is performed. This creates moreasynchronous data and makes output as accurate as we can based on last call.
• changed get_historical_data call to only be called at candle close instead of every iteration and use ticker to fill data between candle open and close.
• known problems with CoinbasePro and Kucoin websocket functions still exist, but above fixes will make websocket fixes easier
• fixed standard indicators still being process when custom strategies are enabled
• consolidated a bunch of locations where code was duplicated based on Exchange
• added additional dataframe function to PyCyptoBot that will store additionally called dataframes dynamically and update them with ticker date like the main dataframe. This greatly reduces the number of API calls when running SmartSwitch, checking "bullonly" or wanting to check anything else on a different granularity than what is currently running. This is used for all additional calls for live and non-live checks, but not for Sims as that has it's own cache system already. Might be able to clean up Sim code as well in the future.
• consolidated numerous indicators and signals in Trading_Pta.py to help prevent dataframe fragmentation
• revised default Strategy_CS.py to be a little less risky and include so new features. Added extra comments to code.
• shortened dataframe references in Strategy_CS.py to hopefully be less confusing for users
• added additional dataframe features to Strategy_CS.py
• fixed trades occurring any time and not only at candle close. Can be overridden, but standard trades occur at close as they should again.

[6.4.1] - 2022-05-05

• reverted some recent changes to Coinbase Pro and Kucoin websocket code that caused incorrect data (still not totally right)
• fixed last of the regular Kucoin error messages which were related to get_ticker
• added custom strategy files to gitignore so they dont get overwritten by mistake
• Kucoin API is only return 100 rows of historical data the fix is to pass in a start date which is calculated so that it will return 300 rows of data
• Fix for bug 'Updater' object has no attribute 'send_message'

[6.4.0] - 2022-05-03

• fix problems with Kucoin websockets ticker
• added some additional check to help with JSON errors with Coinbasepro and Kucoin
• fixed Kucoin cache to properly disable and be disabled by default
• added trailing sell feature - uses 0% for default if not in config
• added dynamic trailing stoploss option (fixed version is default if dynamix not enabled)
• added option for pandas-ta library with option talib and both use custom Trading_Pta.py file
• added requirements-advanced.txt for installing pandas-ta library as to not require on all installations, use this for other option libraries in future talib requires additional OS installation to function, did not include in any requirements file and is totally optional and loaded automatically if installed
• added option to create separate Trading_myPta.py file for user edits to prevent overwrites during updating
• added pandas_ta_help.py file to view pandas-ta help database and test ta signals
• added option for custom trade indicators and signals with Strategy_CS.py file
• added option to create serapate Strategy_myCS.py file for user edits to prevent overwrites during updating
• added numerous customized indicators and signals in Strategy_CS.py with non-traditional settings. Uses points system for buy/sell signals
• added selltriggeroveride option to be used with custom strategy (if/while all signals are strong buy, don't trigger any Sells allowing for greater profit)
• added options to trailing sell and buy that use the custom points system to trigger immediate buys or sells if the respective setting is active
• added trailingsellbailout setting - if trailing sell is active and waiting, but self.price drops drastically, sell immediately at this level
• revised buy/sell transactions in pycryptobot.py for better recovery if an error occurs during trade processing (revising previous fixes)
• added adjusttotalperiods config option as advanced option to adjust periods/candles to compensate for Kucoin 100 candle max (hope to fix in future), but this option can also be used for traders looking to trade newly added coins on exchanges
• added manual_trades_only config option for users wanting HODL some coins, but still monitor margin and status. Manual trade through Telegram Bot or on exchange.
• made a few spell corrections
• added some new comments in places needing them

[6.3.0] - 2022-04-13

• added pycryptobot configuration editor

[6.2.0] - 2022-03-15

• added webgui.py this is web interface, it has some of the telegram bot functions (more will be added) and can be run standalone or along side self.telegram_bot.py
• added bot controls to webgui
• added market scanner options to webgui (please note if using the telegram bot as well the schedules for webgui and telegram bot are separate processes)
• added visual gauges to dashboard (current margins & last 7 day trade margin)
• added log viewer page to webgui it will list logs from the default log location (this will be selectable in a future update)

[6.1.0] - 2022-02-22

[Telegram Bot]

• added logging, logs are saved into ./telegram_logs folder.
• added "logger_level": option in the telegram section of config default is "INFO" other options can be used.
• added trades summary to control panel (24h, 7d, 14d, 31d or all)
• fixed screener/scanner stopping bots that are on the exception list, the exception list is now checked when the screener/scanner starts and stops bots.
• fixed bot count when screener/scanner starts or stops bots
• fixed max bot count not always limiting the number of running bots
• added "exchange_bot_count": in scanner section of config to allow max number of bots running on each exchange
• added screener to config editor
• added "autostart" : in scanner section of config, if enabled, when self.telegram_bot.py is started it will run the market scanner and start any previous open orders.
• including code refactoring.

[6.0.0] - 2022-02-08

• major release

[5.2.6] - 2022-01-30

• fixed some spelling mistakes
• suppressed some of the Kucoin error messages, only displays after last retry attempt
• cleaned up a couple of the retry loops for Kucoin API to make more efficient
• moved the buy/sell error check code further down pycryptobot.py to allow other variables to be set first

[5.2.5] - 2022-01-21

• more exception handling added for JSONDecode errors
• fixed Telegram Reload config market not valid error
• added telegram_bot log file and telegram_logs folder
• revise buy/sell code. Still occasional problems with last update.
• fix trailingstoplosstrigger logic
• bot in docker container runs as user pycryptobot as UID:GID 1000 (First non root user).
• docker bot container size minified for better layer caching and faster downloads.
• updating caching system timer. Screener update including volatility checking, package version check and debugging functionality.

[5.2.4] - 2022-01-16

• fix indentation problems. Incorporated Get_orders caching system (Kucoin). Misc. fixes.

[5.2.3] - 2022-01-15

• fix possible issue where the trade could be processed multiple times on the same pass through the buy/sell process

[5.2.2] - 2022-01-13

• fixed bug in Base and Quote increment functions for Kucoin
• improved BUY and SELL code after fixing increment bug

[5.2.1] - 2022-01-12

• minor updates to trade confirmations added previously

[5.2.0] - 2022-01-11

• updated telegram bot config editor
• added option to enable/disable screener/scanner notifications
• update to default parser to set to correct object type

[5.1.4] - 2022-01-10

• fixed spelling mistake in Kucoin api.py file
• added balance checking to verify buy/sell trades occurred
• revised get_balance code for Coinbase and Kucion to verify a response from API
• revised market/symbol regex in self.telegram_bot.py to match rest of code

[5.1.3] - 2022-01-03

• fixed spelling mistake in comment

[5.1.2] - 2022-01-01

• bugfixes - minor revisions to previous fixes
• modify Sell text - immediate actions don't say at Close any more.
• adjust scanner to only display message for skipping leveraged bots once.

[5.1.1] - 2021-12-31

• bugfixes

[5.1.0] - 2021-12-27

• added trailingimmediatebuy option to buy as soon as trailingbuypcnt is reached, instead of waiting until candle close
• added preventloss option to enable selling prior to margin reaching 0% profit to prevent loss
• added preventlosstrigger - margin set point to start watching for preventloss (see readme)
• added preventlossmargin - margin set point to sell at for preventloss (see readme)
• reordered some test in is_sell_trigger to minimize processing on every pass under some conditions

[5.0.2] - 2021-12-26

• revised fix for change_pcnt_high variable from previous
• fixed is_sell_trigger immediate action it was waiting until candle close

[5.0.1] - 2021-12-23

• change tgbot manual buy/sell check
• fix change_pcnt_high variable error for some tokens
• modified tgbot helper.py code so that it does not require Python 3.9
• Moved log and telegram output messages for buy and sell transaction to display after API call to help prevent notifications of trades that hadn't occurred yet if API error.

[5.0.0] - 2021-12-20

• major version number increased

[4.6.2] - 2021-12-18

• Fix bug in trailingbuypcnt code that could cause the waiting self.price to continually change and prevent a buy
• fix error when saving trade data for the first time
• Add all option to Sell command
• Add unit tests for TG Bot

[4.6.1] - 2021-12-09

• Add trailingbuypcnt as config option with a default of 0 and follow self.price lower. See README for details.
• clean up Strategy.py debug messages with debug bool variable
• increase market and currency regex to allow 20 characters for base currency instead of 10.

[4.6.0] - 2021-12-09

• Added trailingstoplosstrigger to pair.json file + change percentage
• Fixed sims with smartswitch and added the 5 minute granularity to sims
• Added buyminsize so the bot will not buy anything below this value
• Added sellsmartswitch this sets the sell granularity to 5 minutes once sold it will switch back to normal smartswitch
• Added restart open orders this will start any bots that have open orders (these state is added to data.json when each bot starts)
• Added cleandata to when the TG bot starts
• Added control dashboard to TG Bot, to replace some inline commands
• Refactored TG Bot code

[4.5.2] - 2021-12-04

• Fix smartswitch in Simulations
• Fix a few incorrectly defined variables
• Fix sim result margins
• Add open trade margin to Sim Summary
• Add config option for buylastsellsize
• Add buylastsellsize to Simulations
• Add retry loop to Coinbase Public API call
• Increase is_market_valid to 10 chars for base currency regex
• Add marketmultibuycheck config option to prevent multiple buys with some problem market pairs
• some minor file formatting cleanup with VSCode format command

[4.5.1] - 2021-11-22

• Added Kucoin websockets
• Fixed Kucoin failing when using scanner

[4.4.2] - 2021-11-21

• Telegram scanner bugfix

[4.4.1] - 2021-11-16

• Fix for binance candles not incrementing with websockets
• Add bypass FileNotFoundException for pairs.json file
• Fix for double buys when using websockets
• Fix bug for Tracker CSV function
• Fix missing code for Telegram output options
• Add timestamp to Sim buy message output for Telegram

[4.4.0] - 2021-11-01

• Rename /restartbots to /resumebots
• Fixed error when {market}.json file might not be complete (bot stopped).
• Add /cleandata to remove any {market}.json file which are not complete (bot stopped)
• Add not to create telegram_data folder when running sims
• Add /startscanner to TG Bot to scan marks and start bots (hourly schedule set in config)
• Add /stopscanner to TG Bot to stop scanning markets
• Add /addexception to TG Bot to add pair to exceptions list so won't be started by scanner process
• Add /removeexception to TG Bot to remove a pair from exceptions list
• Add multiple market scanning to scanner.py
• Add exception list so that scanner.py doesn't pick a pair your don't want traded

[4.3.3] - 2021-11-08

• fix for Kucoin 429 errors, KeyError('data') and ValueError for time format
• addition work on fix for Kucoin multiple buys for same pair when more Quote funds than Base funds in account
• Kucoin API general tidying of error messages and logging
• Kucoin runs without any regular re-occurring errors in log
• added trade timestamps to Telegram output
• added Telegram config option --telegramtradesonly: will show trades, but not smart switch or last action changed
• added Telegram config option --disabletelegramerrormsgs: will not send Logger messages to telegram
• added ability to specify api_key_file via command line arguments with --api_key_file

[4.3.2] - 2021-11-02

• fix for Kucoin multiple buys on same traded pair when API error occurs

[4.3.1] - 2021-10-28

• fix for Kucoin margin calculation
• fix for Kucoin get_orders not always returning a response
• fix for SIM smartswitching
• Update for TG bot to show uptime with /showinfo

[4.3.0] - 2021-10-23

• formatting CHANGELOG.md

[4.2.1] - 2021-10-19

• fixed TG BOT checking if market/pair already exists before saving
• fixed TG BOT indicator states

[4.2.0] - 2021-10-17

• Added /deletebot will delete bot from /startbot list
• fixed issue with fast-sample with no date causing exception
• fixed issue when bot throws an exception it does not exit
• fixed issue when exception is raised TG bot still thinks the bot is active
• fixed /startbots will only start bots that are not already running
• fixed when Telegram replaces -- with a long dash
• fixed if folder exists in telegram_data folder
• added validation for exchange and markets when using /addnew
• refactored TG bot code

[4.1.0] - 2021-10-01

• Fixed issue when websockets are enabled making to many API calls (for those that are still required they will be called once per minute instead of on every iteration).
• Added telegram bot (telegram_bot.py) this has to be run separately to pycryptobot.py
• Added option to enable the telegram bot this does not start it, just enables writing data required for the telegram bot (--telegrambotcontrol)
• Added user_id to telegram section in config, this is used so that only you can control the bot
• Added datafolder to telegram section in config, this is used when running multiple bots from different folders
• Added Telegram Bot Setup instructions text file
• Removed some debug logging left in by mistake
• Fix issue with Kucoin margins not calculating correctly
• Added Kucoin to yaml files

[4.0.4] - 2021-09-27

• Added Kucoin to --init (auto config)
• Added ability to parse --market in the same format as coinbase (ie ONT-USD)
• Added Websockets webhooks example script
• Added Coinbase Pro webhooks example script
• Telegram output tweaks
• Print currency trading on dryrun simulation summary

[4.0.3] - 2021-09-23

• fix for binance webhooks granularity

[4.0.2] - 2021-09-23

• fix for kucoin minimum order function raising an exception

[4.0.1] - 2021-09-22

• add option to disable insufficient funds exception and log as warning instead (--enableinsufficientfundslogging)

[4.0.0] - 2021-09-21

Added

• Kucoin exchange API (websockets not enabled)
• Websockets available for Binance and Coinbase Pro --websocket
• Added websvc.py to Docker

Changed

• Updated healthcheck to use a basic HTTPS request instead of a get_time() API call
• Disabled Seasonal ARIMA Model ML by default --enableml
• Removed healthcheck to reduce API calls for scaling

[3.6.1] - 2021-09-13

Added

• Websockets POC scripts for Coinbase Pro and Binance
• Seasonal ARIMA model predictions are not optional --enableml
• Updating Dockerfile to python:3.9-slim-bullseye
• switching to multistage venv Dockerfile and adding build-essentials in 1st stage to minimize Image size and build dependencies from source like numpy or statsmodels on arm64

[3.6.0] - 2021-09-06

Added

• fixed williams %r indicator and added it to the websvc dashboard
• added adx14 indicator and added it to the websvc dashboard
• fix for sim index "IndexError('index 0 is out of bounds for axis 0 with size 0')"
• fix for DF High not tracking the sim date in use, this stopped nobuynearhighpcnt working fully
• moved trades csv file to CSV folder

[3.5.0] - 2021-09-05

Added

• added Seasonal ARIMA model predictions to websvc analysis

[3.4.0] - 2021-09-03

Changed

• update to smartswitch sim processing speed.
• update to sim summary to include total margin and profit/loss.
• fixed timestamp bug when using simstartdate.
• fixed graphs in sim mode.
• remove limit for sims using specific granularity.
• fix for profit and loss summary for simulations
• added trade history in simulation summary and will also export to CSV '({market}{daterange}_trades.csv)'
• added trade history export to csv 'trades.csv'
• added web portal ./websvc.py

[3.3.1] - 2021-08-29

Changed

• added additional error handling for Coinbase Pro get_time()

[3.3.0] - 2021-08-28

Changed

• added "nobuynearhighpcnt" to specify the percentage from high that the bot should not buy if "disablebuynearhigh" is not specified.
• added a catch and display of exception message for get_time()

[3.2.15] - 2021-08-24

Changed

• add proper shebang and exec permissions to pycryptobot.py (run from CLI, etc.)

[3.2.14] - 2021-08-24

Changed

• Found and fixed 'currency' key exception
• Fixed simulation summary

[3.2.13] - 2021-08-23

Changed

• Binance US is missing 'tradeFee' API endpoint, now returns default fee for this url

[3.2.12] - 2021-08-23

Added

• Verbose debug option to is_sell_trigger and is_wait_trigger

Changed

• Logic in is_sell_trigger and is_wait_trigger

[3.2.11] - 2021-08-22

Changed

• Adjustment to is_wait_trigger
• Tidying up repo
• Fixed version

[3.2.10] - 2021-08-20

Changed

• 'stats' for binance was retuning incorrect percentage gains.
• 'statdetail' was not working for binance as some values were string instead of float

[3.2.9] - 2021-08-16

Added

• 'nosellminpcnt' to specify minimum margin to not sell
• 'nosellmaxpcnt' to specify maximum margin to not sell
• fixed Stats.py issue on smaller datasets
• fixed recvwindow issue
• binance.us is now working

Changed

• Various small bug fixes

[3.2.8] - 2021-08-12

Changed

• Surrounded API calls for both Binance and Coinbase Pro within a try except

[3.2.7] - 2021-08-11

Changed

• Surrounded signed Binance API calls within a try except

[3.2.6] - 2021-08-09

Changed

• Fixed custom logging bug
• Add a try/catch to resolve "currency" key issue with recvwindow
• Removed previous failsafe check for "currency" in get_accounts

[3.2.5] - 2021-08-09

Changed

• Added failsafe check for "currency" in get_accounts

[3.2.4] - 2021-08-09

Changed

• Updated auth_api to return an empty JSON response on recvwindow

[3.2.3] - 2021-08-09

Changed

• Config file bugfix

[3.2.2] - 2021-08-08

Add

• Drafted new release

[3.2.1] - 2021-08-08

Changed

• Removed log rotation from the bot as it shouldn't be there
• Removed debug code which was left in

[3.2.0] - 2021-08-08

Changed

• Binance code improvements
• Updated Stochastic RSI

[3.1.1] - 2021-08-07

Changed

• Updated Binance self.price calculation

[3.1.0] - 2021-08-07

Changed

• Refactor text boxes in logs

[3.0.1] - 2021-08-07

Changed

• Fix recvwindow for binance

[3.0.0] - 2021-08-03

Changed

• Replaced python-binance library with in-built code
• Loads of enhancements and improvements
• Unit tests added and improved

[2.49.1] - 2021-08-1

Changed

[2.51.0] - 2021-08-06

Changed

• Add section about code style to CONTRIBUTING.md

[2.50.0] - 2021-08-06

Changed

• Upgrade pip to latest version before using it to install packages

[2.49.1] - 2021-08-01

Changed

• The gitignore pattern excluded the configmap.yaml for the helm chart.

[2.49.0] - 2021-08-01

Added

• Added Kubernetes helm charts

[2.48.2] - 2021-08-01

Changed

• Fixed misaligned text on initial bot info table

[2.48.1] - 2021-08-01

Changed

• Fixed output formatting

[2.48.0] - 2021-08-01

Changed

• Fixed fast-sample smartswitching for coinbase

[2.47.1] - 2021-07-13

Changed

• Fixed simulation date issues

[2.47.0] - 2021-07-13

Changed

• Fixed smartwitch for coinbase historic data limit
• Fixed smartswitching date sync

[2.46.2] - 2021-07-13

Changed

• Added --disablebuyema argument

• Updated README.md

[2.46.1] - 2021-07-12

Changed

• use granularity instead of self.getGranularity

• use granularity instead of self.granularity in getHistoricalDateRange() call

• Update README.md

[2.46.0] - 2021-07-09

Changed

• Increased number of attempts at retrieving previous orders in binance api

[2.45.2] - 2021-07-08

Changed

• Improved ADX technical indicator

Added

• Added ATR technical indicator

[2.45.1] - 2021-07-06

Changed

• Fixed ARIMA bug in coinbase pro when frequency not set in dataframe

[2.45.0] - 2021-07-06

Added

• Added ADX technical indicator
• Added auto migrate API keys to coinbasepro.key and/or binance.key

[2.44.1] - 2021-07-05

Changed

• Updated README.md

[2.44.0] - 2021-07-05

Added

• Added log file rotation

[2.43.1] - 2021-07-05

Changed

• Filter on filled orders only in Binance dataframe

[2.42.0] - 2021-07-03

Changed

• Fixed smartswitch for binance simulation mode and live
• Fixed smartswitch timings to use sim date instead of just defaulting to current date
• Update goldencross using the actual sim date in sim mode only
• Update to check when your last order is buy but your coin balance in 0 switch to buy instead
  • Possible bug if you transfer or convert coins on the exchange instead of selling them
• Update to use correct market data in sim mode + smartswitching

[2.41.0] - 2021-07-03

Added

• statdetail flag which gives a detailed list of transactions (works with --statstartdate and --statgroup)

[2.40.0] - 2021-07-03

Changed

• Updated validation for Telegram keys

[2.39.0] - 2021-06-27

Changed

• Added "api_key_file" to config to keep credentials out of config files for safety

[2.38.0] - 2021-06-23

Changed

• Added statstartdate flag to ignore trades before a given date in stats function
• Added statgroup flag to merge stats of multiple currency pairs
• Fixed stats for coinbase pro

[2.37.3] - 2021-06-22

Changed

• Fixed smart switch back bug

[2.37.2] - 2021-06-21

Changed

• Fixed "simstart" bug

[2.37.1] - 2021-06-18

Changed

• Fixed issue from previous release

[2.37.0] - 2021-06-18

Changed

• Refactored the new stats feature into it's own Stats class
• Fixed a bug with get_orders() for Coinbase Pro
• Fixed the rounding issue with precision greater than 4
• Fixed the dummy account which has been broken with a previous PR
• Updated unit tests

[2.31.1] - 2021-06-13

Changed

• Create default config if missing, avoid creating empty config

[2.31.0] - 2021-06-13

Changed

• Separated strategy into Strategy model for custom strategies

[2.30.2] - 2021-06-12

Changed

• Minor changes in quote currency extraction (binance.py)

[2.30.1] - 2021-06-12

Changed

• Suppressed ARIMA model warning

[2.30.0] - 2021-06-12

Changed

• Improved ARIMA model output to console
• Reduced polling from 2 minutes to 1 minute

[2.29.0] - 2021-06-11

Added

• Added the Seasonal ARIMA machine learning model for self.price predictions

[2.28.0] - 2021-06-11

Added

• Added Stochastic RSI and Williams %R technical indicators

[2.27.0] - 2021-06-08

Changed

• Optimised simulations, they run a lot faster now

Added

• Added self.get_historical_data_chained

[2.26.0] - 2021-06-07

Changed

• Updated validation to allow for custom Coinbase Pro passphrases

[2.25.0] - 2021-06-06

Added

• Added CHANGELOG.md

Changed

• Removed check for 'fees' on Binance orders which doesn't exist

Fixed

• Pandas 'SettingWithCopyWarning' in models/exchange/coinbase_pro/api.py