Problem with connection to my IB paper account via IB Gateway and IBAPI native Python

[oskoa]

Hi everyone,

I am trying to run IB Gateway on a cloud server (without GUI) and connect to it via python (ibapi) on the same server that IB Gateway is running.

I have cloned the latest version of ib-gateway-docker and followed instructions on how to build and run with docker compose up.
based on my observation, it looks like the container does run but faces a problems when I try to connect via python.

Here's my simple python snippet for testing the connection:

from ibapi.client import EClient
from ibapi.wrapper import EWrapper  

class IBapi(EWrapper, EClient):
     def __init__(self):
         EClient.__init__(self, self) 

app = IBapi()
app.connect('127.0.0.1', 4002, 10)
app.run()

app.disconnect()

Here's the container log when I try to run the python script:

ib-gateway-1  | 2024-06-24 15:04:42:963 IBC: Login attempt: 1
ib-gateway-1  | 2024-06-24 15:04:42:968 IBC: trading mode from settings: tradingMode=paper
ib-gateway-1  | 2024-06-24 15:04:43:043 IBC: Click button: Paper Log In
ib-gateway-1  | 2024-06-24 15:04:45:503 IBC: detected frame entitled: IBKR Gateway; event=Lost focus
ib-gateway-1  | 2024-06-24 15:04:45:504 IBC: detected frame entitled: IBKR Gateway; event=Deactivated
ib-gateway-1  | 2024-06-24 15:04:45:514 IBC: detected frame entitled: Loading...; event=Activated
ib-gateway-1  | 2024-06-24 15:04:45:545 IBC: detected frame entitled: Loading...; event=Focused
ib-gateway-1  | 2024-06-24 15:04:45:546 IBC: detected frame entitled: Loading...; event=Opened
ib-gateway-1  | 2024-06-24 15:04:45:547 IBC: Found Gateway main window
ib-gateway-1  | 2024-06-24 15:04:45:548 IBC: Got main window from future
ib-gateway-1  | 2024-06-24 15:04:45:548 IBC: Invoking config dialog menu
ib-gateway-1  | 2024-06-24 15:04:46:099 IBC: detected frame entitled: Loading...; event=Lost focus
ib-gateway-1  | 2024-06-24 15:04:46:101 IBC: detected frame entitled: Loading...; event=Deactivated
ib-gateway-1  | 2024-06-24 15:04:46:103 IBC: detected frame entitled: Authenticating...; event=Activated
ib-gateway-1  | 2024-06-24 15:04:46:109 IBC: detected frame entitled: Connecting to server...; event=Focused
ib-gateway-1  | 2024-06-24 15:04:46:110 IBC: detected frame entitled: Connecting to server...; event=Opened
ib-gateway-1  | 2024-06-24 15:04:47:369 IBC: detected frame entitled: Authenticating...; event=Lost focus
ib-gateway-1  | 2024-06-24 15:04:47:370 IBC: detected frame entitled: Authenticating...; event=Deactivated
ib-gateway-1  | 2024-06-24 15:04:47:372 IBC: detected dialog entitled: Enter security code; event=Activated
ib-gateway-1  | 2024-06-24 15:04:47:386 IBC: detected dialog entitled: Enter security code; event=Focused
ib-gateway-1  | 2024-06-24 15:04:47:387 IBC: detected dialog entitled: Enter security code; event=Opened
ib-gateway-1  | 2024/06/24 15:06:14 socat[146] E connect(5, AF=2 127.0.0.1:4002, 16): Connection refused
ib-gateway-1  | 2024/06/24 15:07:45 socat[147] E connect(5, AF=2 127.0.0.1:4002, 16): Connection refused
ib-gateway-1  | 2024-06-24 15:07:49:509 IBC: detected dialog entitled: Enter security code; event=Closed
ib-gateway-1  | 2024/06/24 15:08:46 socat[153] E connect(5, AF=2 127.0.0.1:4002, 16): Connection refused

It looks like 2FA is a problem (Enter security code) . The python code triggers a text message to my phone. Does anyone know how to deal with 2FA? I doubt I have deactivate it since it is required every time I login to my paper account via the GUI.

I am attaching my .env for reference:

TWS_USERID=MyUserID
TWS_PASSWORD=MyPass
# ib-gateway
#TWS_SETTINGS_PATH=/home/ibgateway/Jts
# tws
#TWS_SETTINGS_PATH=/config/tws_settings
TWS_SETTINGS_PATH=
TWS_ACCEPT_INCOMING=
TRADING_MODE=paper
READ_ONLY_API=no
VNC_SERVER_PASSWORD=
TWOFA_TIMEOUT_ACTION=restart
BYPASS_WARNING=
AUTO_RESTART_TIME=11:59 PM
AUTO_LOGOFF_TIME=
TWS_COLD_RESTART=
SAVE_TWS_SETTINGS=
RELOGIN_AFTER_2FA_TIMEOUT=yes
TIME_ZONE=Europe/Zurich
CUSTOM_CONFIG=
SSH_TUNNEL=
SSH_OPTIONS=
SSH_ALIVE_INTERVAL=
SSH_ALIVE_COUNT=
SSH_PASSPHRASE=
SSH_REMOTE_PORT=
SSH_USER_TUNNEL=
SSH_RESTART=
SSH_VNC_PORT=

I do not modify the yml file at all and use what is there on the repo.

I appreciate your help with this.

[gnzsnz]

I would suggest you to connect through VNC to make sure everything is working fine. ideally you don't need it in "steady mode" but the main reason to have it is to solve any issue.

i don't understand why you have MFA for paper, I don't have it for my paper account, and AFAIK it's only available for live account. if you have MFA set with text messages, then you need to enter the message manually. it's better to use the ibkr app for MFA as you approve the login in the app.

make sure you can see in the log IBC: Logging has completed the API won't work until you complete authentication.

[oskoa]

IBC: Logging has completed never shows up. The tail of the log is the one I copied above. I believe, aside from the 2FA, there may be other issues?

I am using the IB mobile app but still receive text messages somehow. I will look into changing the settings. I was also surprised why I need 2FA for a demo account.

I will try to update this thread if I find any solution.

[GonzRon]

I believe this is because you are trying to login to your paper acct using your regular user id and password, and not the paper trading account userId and auto-generated password in the ib account portal. This happened to me as well, I was only specifying the one set of credentials but had the .env set to trading_mode = both, so when I tried to connect to the paper trading port, I got SMS based 2FA which I thought was odd because I have push client 2FA for regular account. In any event, make sure you are setting TWS_USERID_PAPER and TWS_PASSWORD_PAPER with the demo acct creds not your live acct creds.