Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

seeking to understand how to debug remote agent further - "No Agent slots available" / "No resources are available" #653

Open
5 tasks done
repudi8or opened this issue Nov 15, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@repudi8or
Copy link

repudi8or commented Nov 15, 2024

Existing Resources

  • Please search the existing issues for related problems
  • Consult the product documentation : Docs
  • Consult the FAQ : FAQ
  • Consult the Troubleshooting Guide : Guide
  • Reviewed existing training videos: Youtube

Describe the bug
Maybe misleading messaging??? anyhow when I try to start a workspace/terminal I get back a "no resources are available" in the UI.

To Reproduce
Steps to reproduce the behavior:

  1. After clean restart of both Manager and agent (no existing sessions)
  2. in Dashboard, Go to 'workspaces'
  3. Click on 'terminal'
  4. See error "no resources are available"
  5. go to admin UI and infrastructure=>docker agents
  6. click edit on the only enabled agent
  7. see plenty of free resources (see attached screenshot)

Expected behavior
A terminal session starts in browser

Screenshots
Screenshot 2024-11-15 at 12 53 07 PM.

Workspaces Version
e.g Version 1.16

Workspaces Installation Method
manager was installed as single server (initial PoC) but has local agent (which works fine) currently disabled
Agent has been installed following the Multi-Server agent install process (though in a slightly non-standard way in DinD)

Client Browser (please complete the following information):

  • OS: iOS
  • Browser firefox
  • Version 132.0.2

Workspace Server Information (please provide the output of the following commands):

  • uname -a
Linux ip-10-9-174-54 6.8.0-1018-aws #20-Ubuntu SMP Thu Oct 10 18:14:42 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
  • cat /etc/os-release
PRETTY_NAME="Ubuntu 24.04.1 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.1 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo
  • sudo docker info
Client: Docker Engine - Community
Version:    27.3.1
Context:    default
Debug Mode: false
Plugins:
 buildx: Docker Buildx (Docker Inc.)
   Version:  v0.17.1
   Path:     /usr/libexec/docker/cli-plugins/docker-buildx
 compose: Docker Compose (Docker Inc.)
   Version:  v2.29.7
   Path:     /usr/libexec/docker/cli-plugins/docker-compose

Server:
Containers: 10
 Running: 10
 Paused: 0
 Stopped: 0
Images: 12
Server Version: 27.3.1
Storage Driver: overlay2
 Backing Filesystem: extfs
 Supports d_type: true
 Using metacopy: false
 Native Overlay Diff: true
 userxattr: false
Logging Driver: json-file
Cgroup Driver: systemd
Cgroup Version: 2
Plugins:
 Volume: local
 Network: bridge host ipvlan kasmweb/sidecar:1.0 macvlan null overlay
 Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
runc version: v1.1.14-0-g2c9f560
init version: de40ad0
Security Options:
 apparmor
 seccomp
  Profile: builtin
 cgroupns
Kernel Version: 6.8.0-1018-aws
Operating System: Ubuntu 24.04.1 LTS
OSType: linux
Architecture: x86_64
CPUs: 16
Total Memory: 30.98GiB
Name: ip-10-9-174-54
ID: 6a945648-eec6-4895-a99c-2f5e6cc2e931
Docker Root Dir: /var/lib/docker
Debug Mode: false
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false

WARNING: bridge-nf-call-iptables is disabled
WARNING: bridge-nf-call-ip6tables is disabled
  • sudo docker ps | grep kasm
5f0283d67025   kasmweb/proxy:1.16.0               "/docker-entrypoint.…"   6 days ago   Up About an hour             80/tcp, 0.0.0.0:443->443/tcp, :::443->443/tcp   kasm_proxy
5254523b5551   kasmweb/rdp-https-gateway:1.16.0   "/opt/rdpgw/rdpgw"       6 days ago   Up About an hour (healthy)                                                   kasm_rdp_https_gateway
3a6fb1d47210   kasmweb/share:1.16.0               "/bin/sh -c '/usr/bi…"   6 days ago   Up About an hour (healthy)   8182/tcp                                        kasm_share
058e021a51fe   kasmweb/rdp-gateway:1.16.0         "/start.sh"              6 days ago   Up About an hour (healthy)   0.0.0.0:3389->3389/tcp, :::3389->3389/tcp       kasm_rdp_gateway
038f9c7feae9   kasmweb/agent:1.16.0               "/bin/sh -c '/usr/bi…"   6 days ago   Up About an hour (healthy)   4444/tcp                                        kasm_agent
c8c97df61c7a   kasmweb/api:1.16.0                 "/bin/sh -c '/usr/bi…"   6 days ago   Up About an hour (healthy)   8080/tcp                                        kasm_api
cee22c5e4624   kasmweb/kasm-guac:1.16.0           "/dockerentrypoint.sh"   6 days ago   Up About an hour (healthy)                                                   kasm_guac
b6494307109e   kasmweb/manager:1.16.0             "/usr/bin/startup.sh…"   6 days ago   Up About an hour (healthy)   8181/tcp                                        kasm_manager
2a39f69bcfa1   redis:5-alpine                     "docker-entrypoint.s…"   6 days ago   Up About an hour             6379/tcp                                        kasm_redis
9cb2f82702bf   postgres:14-alpine                 "docker-entrypoint.s…"   6 days ago   Up About an hour (healthy)   5432/tcp

Additional context
Several things of note.

  1. When i try starting terminal in UI, I see no traffic to backend agent container via docker logs -f
  2. I can curl from management host to agent host on 443 with a dummy path, I DO see logging at backend agent docker logs
    like 2024-11-14 23:35:00,818 [WARNING] tornado.access: 404 GET /test_path_to_agent (172.19.0.3) 0.31ms
  3. when i get docker logs of the kasmweb/api container on management host and try to start a terminal session I see:
2024-11-14 23:53:56,015 [DEBUG] client_api_server: Successfully authenticated request (wrapper_function) for user ([email protected]) at (10.229.154.198)
2024-11-14 23:53:56,022 [DEBUG] client_api_server: License Check: Current Kasms (0) , License Limit (5) , Remaining (5)
2024-11-14 23:53:56,041 [DEBUG] client_api_server: Using group-level keepalive_expiration of (3600)
2024-11-14 23:53:56,041 [INFO] client_api_server: No existing containers with image (Terminal) exist to assign user ([email protected])
2024-11-14 23:53:56,042 [DEBUG] client_api_server: Function (provider_manager.assign_container) executed in (0.0067403316497802734) seconds
2024-11-14 23:53:56,043 [DEBUG] client_api_server: Getting existing available containers
2024-11-14 23:53:56,043 [DEBUG] client_api_server: Getting available slots for image: (kasmweb/terminal:1.16.0)
2024-11-14 23:53:56,050 [DEBUG] client_api_server: Processing Server: (f1682ddf-4a10-4e06-bc62-ab655f31d341)
2024-11-14 23:53:56,051 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,051 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,052 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,052 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,053 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,053 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,054 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,055 [DEBUG] client_api_server: Server (f1682ddf-4a10-4e06-bc62-ab655f31d341) can support this container. Adding slot
2024-11-14 23:53:56,055 [DEBUG] client_api_server: Server f1682ddf-4a10-4e06-bc62-ab655f31d341 does not have required cores remaining (0.0 remaining)
2024-11-14 23:53:56,056 [DEBUG] client_api_server: No more slots available for server : (f1682ddf-4a10-4e06-bc62-ab655f31d341)
2024-11-14 23:53:56,056 [DEBUG] client_api_server: Function (provider_manager.get_available_slots) executed in (0.01248025894165039) seconds
2024-11-14 23:53:56,057 [DEBUG] client_api_server: Prioritized slots ([None, None, None, None, None, None, None, None])
2024-11-14 23:53:56,058 [DEBUG] client_api_server: Server limited prioritized slots ([None])
2024-11-14 23:53:56,058 [DEBUG] client_api_server: Function (provider_manager.prioritize_slots) executed in (0.0016200542449951172) seconds
2024-11-14 23:53:56,067 [INFO] client_api_server: User groups: [<data.model.Group object at 0x7478a80a2370>, <data.model.Group object at 0x7478a1bd1a30>]
2024-11-14 23:53:56,067 [DEBUG] client_api_server: User-based storage mappings defined but not allowed via group settings
2024-11-14 23:53:56,110 [DEBUG] client_api_server: Function (provider_manager.is_host_alive) executed in (5.7220458984375e-06) seconds
2024-11-14 23:53:56,110 [DEBUG] client_api_server: Function (provider_manager.get_container) executed in (0.06757664680480957) seconds
2024-11-14 23:53:56,111 [ERROR] client_api_server: No resources are available to create the requested Kasm. Please try again later or contact an Administrator : No Agent slots available. No Agent can be contacted with enough available resources to provision the image

Some Questions relating to the above logs

  1. it seems like 8 slots are being created before the message No more slots available for server : (f1682ddf-4a10-4e06-bc62-ab655f31d341) . is this correct?
  2. if there are 8 slots, are these only abstractions on the management host side of how many sessions can be created on the agent side before resources are exhausted?
  3. How can I drill more deeply into the error about no resources available to understand what, specifically, Kasm thinks is not available that is required on the agent side, when the screenshot (supported by validation on the agent side) indicates plenty of resource?
@repudi8or repudi8or added the bug Something isn't working label Nov 15, 2024
@mmcclaskey
Copy link

The following line is misleading

Server f1682ddf-4a10-4e06-bc62-ab655f31d341 does not have required cores remaining (0.0 remaining)

It just means that the provisioning loop stopped making 'slots' on that server because it has no more cores to make empty slots from. It is meant to help you identify what was the limiting factor on the server for creating empty slots. It could have also stopped due to RAM or GPUs.

Something is wrong on the following two lines, there should be values none None.

2024-11-14 23:53:56,057 [DEBUG] client_api_server: Prioritized slots ([None, None, None, None, None, None, None, None])
2024-11-14 23:53:56,058 [DEBUG] client_api_server: Server limited prioritized slots ([None])

I suspect your agent does not belong to a Zone. Can you validate that your agent belongs to a zone and if it does, what is the Zone name?

@repudi8or
Copy link
Author

repudi8or commented Nov 18, 2024

root@eab6318e5e55:/# grep zone_name /opt/kasm/current/conf/app/api.app.config.yaml
  zone_name: default
root@eab6318e5e55:/#

and

Screenshot 2024-11-18 at 4 31 35 PM

the "2" agents are the single_node install / local agent on the manager host (currently disabled) and my muti-server agent which is misbehaving (as described in this issue)

the grep is from inside the multi-server agent docker container

@mmcclaskey
Copy link

Can you provide logs from your working agent and manager?

@repudi8or
Copy link
Author

repudi8or commented Nov 25, 2024

api logs for successful terminal session open on the single_server agent implementation herein :

2024-11-25 03:47:51,687 [DEBUG] client_api_server: Successfully authenticated request (wrapper_function) for user ([email protected]) at (10.229.154.198)
2024-11-25 03:47:51,696 [DEBUG] client_api_server: License Check: Current Kasms (2) , License Limit (5) , Remaining (3)
2024-11-25 03:47:51,718 [DEBUG] client_api_server: Using group-level keepalive_expiration of (3600)
2024-11-25 03:47:51,719 [INFO] client_api_server: No existing containers with image (Terminal) exist to assign user ([email protected])
2024-11-25 03:47:51,719 [DEBUG] client_api_server: Function (provider_manager.assign_container) executed in (0.007352352142333984) seconds
2024-11-25 03:47:51,720 [DEBUG] client_api_server: Getting existing available containers
2024-11-25 03:47:51,721 [DEBUG] client_api_server: Getting available slots for image: (kasmweb/terminal:1.16.0)
2024-11-25 03:47:51,727 [DEBUG] client_api_server: Processing Server: (62712899-1435-4e30-b5a3-06fafd561e5e)
2024-11-25 03:47:51,729 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) can support this container. Adding slot
2024-11-25 03:47:51,729 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) can support this container. Adding slot
2024-11-25 03:47:51,730 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) can support this container. Adding slot
2024-11-25 03:47:51,730 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) can support this container. Adding slot
2024-11-25 03:47:51,731 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) can support this container. Adding slot
2024-11-25 03:47:51,731 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) can support this container. Adding slot
2024-11-25 03:47:51,732 [DEBUG] client_api_server: Server 62712899-1435-4e30-b5a3-06fafd561e5e does not have required cores remaining (0.0 remaining)
2024-11-25 03:47:51,732 [DEBUG] client_api_server: No more slots available for server : (62712899-1435-4e30-b5a3-06fafd561e5e)
2024-11-25 03:47:51,733 [DEBUG] client_api_server: Function (provider_manager.get_available_slots) executed in (0.011753559112548828) seconds
2024-11-25 03:47:51,734 [DEBUG] client_api_server: Prioritized slots (['proxy', 'proxy', 'proxy', 'proxy', 'proxy', 'proxy'])
2024-11-25 03:47:51,736 [DEBUG] client_api_server: Server limited prioritized slots (['proxy'])
2024-11-25 03:47:51,736 [DEBUG] client_api_server: Function (provider_manager.prioritize_slots) executed in (0.0029556751251220703) seconds
2024-11-25 03:47:51,745 [INFO] client_api_server: User groups: [<data.model.Group object at 0x78c60412f220>, <data.model.Group object at 0x78c60415ffa0>]
2024-11-25 03:47:51,746 [DEBUG] client_api_server: User-based storage mappings defined but not allowed via group settings
2024-11-25 03:47:51,789 [DEBUG] client_api_server: Requesting Hello for Server(62712899-1435-4e30-b5a3-06fafd561e5e) via URL: (https://proxy:443/agent/api/v1/hello/)
2024-11-25 03:47:51,795 [DEBUG] client_api_server: Server(62712899-1435-4e30-b5a3-06fafd561e5e) is alive
2024-11-25 03:47:51,796 [DEBUG] client_api_server: Function (provider_manager.is_host_alive) executed in (0.007401466369628906) seconds
2024-11-25 03:47:51,796 [DEBUG] client_api_server: Found existing server capacity: (62712899-1435-4e30-b5a3-06fafd561e5e).
2024-11-25 03:47:51,797 [DEBUG] client_api_server: Server (62712899-1435-4e30-b5a3-06fafd561e5e) has the requested image (kasmweb/terminal:1.16.0)
2024-11-25 03:47:51,797 [DEBUG] client_api_server: Requesting Hello for Server(62712899-1435-4e30-b5a3-06fafd561e5e) via URL: (https://proxy:443/agent/api/v1/hello/)
2024-11-25 03:47:51,804 [DEBUG] client_api_server: Server(62712899-1435-4e30-b5a3-06fafd561e5e) is alive
2024-11-25 03:47:51,805 [DEBUG] client_api_server: Function (provider_manager.is_host_alive) executed in (0.007483243942260742) seconds
2024-11-25 03:47:51,805 [INFO] client_api_server: Creating Kasm on Server: (62712899-1435-4e30-b5a3-06fafd561e5e)
2024-11-25 03:47:51,806 [DEBUG] client_api_server: Requesting Hello for Server(62712899-1435-4e30-b5a3-06fafd561e5e) via URL: (https://proxy:443/agent/api/v1/create_container/)
2024-11-25 03:47:52,193 [DEBUG] client_api_server: Unauthenticated user made authorized API call to (healthcheck) from IP address (127.0.0.1).
2024-11-25 03:47:52,195 [INFO] cherrypy.access.132792002184384: 127.0.0.1 - - [25/Nov/2024:03:47:52] "GET /api/__healthcheck HTTP/1.1" 200 12 "" "curl/7.68.0"
2024-11-25 03:47:52,281 [DEBUG] client_api_server: Function (provider_manager.create_kasm_from_slot) executed in (0.48369407653808594) seconds
2024-11-25 03:47:52,282 [DEBUG] client_api_server: Using group-level keepalive_expiration of (3600)
2024-11-25 03:47:52,284 [INFO] client_api_server: {"host": "898fb9fc-c06b-41cb-a6b1-e4c79269a0ce", "application": "Session", "ingest_date": "2024-11-25T03:47:52Z", "message": "Starting KasmVNC", "levelname": "DEBUG", "process": "vnc_startup.sh", "kasm_user_name": "", "kasm_id": "898fb9fc-c06b-41cb-a6b1-e4c79269a0ce"}
2024-11-25 03:47:52,284 [DEBUG] client_api_server: Creating new Kasm record for request
2024-11-25 03:47:52,285 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "POST /api/kasm_session_log?token=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJrYXNtX2lkIjoiODk4ZmI5ZmMtYzA2Yi00MWNiLWE2YjEtZTRjNzkyNjlhMGNlIiwicHJvZmlsZV9wYXRoIjoiIiwiZXhwIjoxODI3MTE0NDcxLCJhdXRob3JpemF0aW9ucyI6WzUwXX0.cfsF-li1TRoGrvVTt1wX977m50vy684L-gmNHm2weoUgkXsbQJ-U_Fd8fy4tJYTAG9ArUdo6qiFv2n2eptpS8gh9jqSBkBKBpf5diQOH-MXNq3_VKLUX-qrJYD9WwextNdD6jgF8S6OqqPCTFQWlXzn4UjOMWwSLSwuMhLNSoF-KzF15pTIRyLhs2lADmAzkSzYjZDP6ZAKK4jpm1XBzObUahQ-88R7YLQLK50KoFXlC5J4segkgBTQO3bRjtooSW_uZr3zekaKNQK6sES-1plyUKhtnxiRPkNPETNCxodPNTOF0z6NFyyJ-N8AXHlmhiFN_gAWF7gapOHNuof4bCg HTTP/1.1" 200 - "" "curl/7.68.0"
2024-11-25 03:47:52,307 [DEBUG] client_api_server: Created Accounting record for kasm_id (898fb9fc-c06b-41cb-a6b1-e4c79269a0ce)
2024-11-25 03:47:52,318 [DEBUG] client_api_server: Function (provider_manager.get_container) executed in (0.5982270240783691) seconds
2024-11-25 03:47:52,323 [INFO] client_api_server: Successfully provisioned kasm_id (898fb9fc-c06b-41cb-a6b1-e4c79269a0ce) with container_id (6ebff90ffd9bfe93905985b204de75eb445883c3c1164852c4670550ea1f3d6b) at (172.18.0.14) for user ([email protected]) at (10.229.154.198)
2024-11-25 03:47:52,323 [DEBUG] client_api_server: Function (client_api.request_kasm) executed in (0.6352205276489258) seconds
2024-11-25 03:47:52,324 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "POST /api/request_kasm HTTP/1.1" 200 73 "https://10.9.174.54/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:132.0) Gecko/20100101 Firefox/132.0"
2024-11-25 03:47:52,465 [DEBUG] client_api_server: Successfully authenticated request (get_user_kasms) for user ([email protected]) at (10.229.154.198)
2024-11-25 03:47:52,495 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "POST /api/get_user_kasms HTTP/1.1" 200 10923 "https://10.9.174.54/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:132.0) Gecko/20100101 Firefox/132.0"
2024-11-25 03:47:52,608 [DEBUG] client_api_server: Calling kasmvnc api (https://proxy:443/232eee4e-8576-42/dc26d205-c880-4483-84d7-57344399986f/api/get_screenshot?width=1000&height=1000)
2024-11-25 03:47:52,628 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "GET /api/internal_auth/ HTTP/1.1" 202 - "" "python-requests/2.31.0"
2024-11-25 03:47:52,630 [DEBUG] client_api_server: Function (client_api._kasmvnc_api) executed in (0.06495523452758789) seconds
2024-11-25 03:47:52,631 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "GET /api/get_kasm_screenshot?kasm_id=898fb9fcc06b41cba6b1e4c79269a0ce&width=1000&height=1000 HTTP/1.1" 200 150 "https://10.9.174.54/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:132.0) Gecko/20100101 Firefox/132.0"
2024-11-25 03:47:52,646 [DEBUG] client_api_server: Unauthenticated user made authorized API call to (healthcheck) from IP address (172.18.0.3).
2024-11-25 03:47:52,648 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "GET /api/__healthcheck HTTP/1.1" 200 12 "" "axios/1.7.7"
2024-11-25 03:47:52,660 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:52] "POST /api/guac_get_managers HTTP/1.1" 200 33 "" "axios/1.7.7"
2024-11-25 03:47:53,394 [INFO] client_api_server: {"host": "898fb9fc-c06b-41cb-a6b1-e4c79269a0ce", "application": "Session", "ingest_date": "2024-11-25T03:47:53Z", "message": "Starting audio websocket server", "levelname": "DEBUG", "process": "vnc_startup.sh", "kasm_user_name": "", "kasm_id": "898fb9fc-c06b-41cb-a6b1-e4c79269a0ce"}
2024-11-25 03:47:53,395 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:53] "POST /api/kasm_session_log?token=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJrYXNtX2lkIjoiODk4ZmI5ZmMtYzA2Yi00MWNiLWE2YjEtZTRjNzkyNjlhMGNlIiwicHJvZmlsZV9wYXRoIjoiIiwiZXhwIjoxODI3MTE0NDcxLCJhdXRob3JpemF0aW9ucyI6WzUwXX0.cfsF-li1TRoGrvVTt1wX977m50vy684L-gmNHm2weoUgkXsbQJ-U_Fd8fy4tJYTAG9ArUdo6qiFv2n2eptpS8gh9jqSBkBKBpf5diQOH-MXNq3_VKLUX-qrJYD9WwextNdD6jgF8S6OqqPCTFQWlXzn4UjOMWwSLSwuMhLNSoF-KzF15pTIRyLhs2lADmAzkSzYjZDP6ZAKK4jpm1XBzObUahQ-88R7YLQLK50KoFXlC5J4segkgBTQO3bRjtooSW_uZr3zekaKNQK6sES-1plyUKhtnxiRPkNPETNCxodPNTOF0z6NFyyJ-N8AXHlmhiFN_gAWF7gapOHNuof4bCg HTTP/1.1" 200 - "" "curl/7.68.0"
2024-11-25 03:47:53,421 [INFO] client_api_server: {"host": "898fb9fc-c06b-41cb-a6b1-e4c79269a0ce", "application": "Session", "ingest_date": "2024-11-25T03:47:53Z", "message": "Starting audio server", "levelname": "DEBUG", "process": "vnc_startup.sh", "kasm_user_name": "", "kasm_id": "898fb9fc-c06b-41cb-a6b1-e4c79269a0ce"}
2024-11-25 03:47:53,422 [INFO] cherrypy.access.132792002184384: 172.18.0.11 - - [25/Nov/2024:03:47:53] "POST /api/kasm_session_log?token=eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCJ9.eyJrYXNtX2lkIjoiODk4ZmI5ZmMtYzA2Yi00MWNiLWE2YjEtZTRjNzkyNjlhMGNlIiwicHJvZmlsZV9wYXRoIjoiIiwiZXhwIjoxODI3MTE0NDcxLCJhdXRob3JpemF0aW9ucyI6WzUwXX0.cfsF-li1TRoGrvVTt1wX977m50vy684L-gmNHm2weoUgkXsbQJ-U_Fd8fy4tJYTAG9ArUdo6qiFv2n2eptpS8gh9jqSBkBKBpf5diQOH-MXNq3_VKLUX-qrJYD9WwextNdD6jgF8S6OqqPCTFQWlXzn4UjOMWwSLSwuMhLNSoF-KzF15pTIRyLhs2lADmAzkSzYjZDP6ZAKK4jpm1XBzObUahQ-88R7YLQLK50KoFXlC5J4segkgBTQO3bRjtooSW_uZr3zekaKNQK6sES-1plyUKhtnxiRPkNPETNCxodPNTOF0z6NFyyJ-N8AXHlmhiFN_gAWF7gapOHNuof4bCg HTTP/1.1" 200 - "" "curl/7.68.0"

for clarity this is the same manager (from failing external-agent example) talking to agent on itself

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants