Web: Some pages return a 500 server error for a HEAD request

[m-i-l]

Some pages respond okay for a HEAD request, e.g. / , /pages/documentation/ , /pages/privacy/ , /admin/login/.

However /search/browse/ , /search/new/, /admin/add/ and /api/v1/feed/search/?q=indieweb respond to a HEAD request with the following errors respectively.

Not an issue as such because the system doesn't support HEAD requests, but better handling would keep the logs cleaner.

[Mon Jan 22 01:39:12.280657 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766] [2024-01-22 01:39:12,279] ERROR in app: Exception on /browse/ [HEAD]
[Mon Jan 22 01:39:12.280690 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766] Traceback (most recent call last):
[Mon Jan 22 01:39:12.280696 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 1455, in wsgi_app
[Mon Jan 22 01:39:12.280700 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]     response = self.full_dispatch_request()
[Mon Jan 22 01:39:12.280703 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 01:39:12.280706 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 869, in full_dispatch_request
[Mon Jan 22 01:39:12.280710 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]     rv = self.handle_user_exception(e)
[Mon Jan 22 01:39:12.280712 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 01:39:12.280715 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 867, in full_dispatch_request
[Mon Jan 22 01:39:12.280718 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]     rv = self.dispatch_request()
[Mon Jan 22 01:39:12.280721 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]          ^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 01:39:12.280724 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 852, in dispatch_request
[Mon Jan 22 01:39:12.280728 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]     return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
[Mon Jan 22 01:39:12.280731 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 01:39:12.280734 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/search/search.py", line 45, in browse
[Mon Jan 22 01:39:12.280737 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]     params = get_search_params(request, search_type)
[Mon Jan 22 01:39:12.280740 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 01:39:12.280742 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/searchutils.py", line 70, in get_search_params
[Mon Jan 22 01:39:12.280746 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]     for key in keys:
[Mon Jan 22 01:39:12.280748 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766]                ^^^^
[Mon Jan 22 01:39:12.280751 2024] [wsgi:error] [pid 10:tid 281473592258848] [client 172.18.0.1:55766] UnboundLocalError: cannot access local variable 'keys' where it is not associated with a value

[Mon Jan 22 02:39:06.229455 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328] [2024-01-22 02:39:06,228] ERROR in app: Exception on /new/ [HEAD]
[Mon Jan 22 02:39:06.229497 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328] Traceback (most recent call last):
[Mon Jan 22 02:39:06.229507 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 1455, in wsgi_app
[Mon Jan 22 02:39:06.229512 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]     response = self.full_dispatch_request()
[Mon Jan 22 02:39:06.229517 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:06.229521 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 869, in full_dispatch_request
[Mon Jan 22 02:39:06.229526 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]     rv = self.handle_user_exception(e)
[Mon Jan 22 02:39:06.229531 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:06.229536 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 867, in full_dispatch_request
[Mon Jan 22 02:39:06.229542 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]     rv = self.dispatch_request()
[Mon Jan 22 02:39:06.229546 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]          ^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:06.229552 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 852, in dispatch_request
[Mon Jan 22 02:39:06.229557 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]     return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
[Mon Jan 22 02:39:06.229561 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:06.229566 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/search/search.py", line 93, in newest
[Mon Jan 22 02:39:06.229570 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]     params = get_search_params(request, search_type)
[Mon Jan 22 02:39:06.229576 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:06.229581 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/searchutils.py", line 70, in get_search_params
[Mon Jan 22 02:39:06.229640 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]     for key in keys:
[Mon Jan 22 02:39:06.229649 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328]                ^^^^
[Mon Jan 22 02:39:06.229655 2024] [wsgi:error] [pid 8:tid 281473474949408] [client 172.18.0.1:38328] UnboundLocalError: cannot access local variable 'keys' where it is not associated with a value

[Mon Jan 22 02:39:04.827720 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242] [2024-01-22 02:39:04,825] ERROR in app: Exception on /add/ [HEAD]
[Mon Jan 22 02:39:04.827756 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242] Traceback (most recent call last):
[Mon Jan 22 02:39:04.827762 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 1455, in wsgi_app
[Mon Jan 22 02:39:04.827765 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]     response = self.full_dispatch_request()
[Mon Jan 22 02:39:04.827768 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:04.827771 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 869, in full_dispatch_request
[Mon Jan 22 02:39:04.827775 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]     rv = self.handle_user_exception(e)
[Mon Jan 22 02:39:04.827777 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:04.827780 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 867, in full_dispatch_request
[Mon Jan 22 02:39:04.827783 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]     rv = self.dispatch_request()
[Mon Jan 22 02:39:04.827786 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]          ^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:04.827789 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 852, in dispatch_request
[Mon Jan 22 02:39:04.827792 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]     return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
[Mon Jan 22 02:39:04.827795 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:04.827798 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/admin/add.py", line 38, in add
[Mon Jan 22 02:39:04.827801 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]     if home_page.endswith(domain):
[Mon Jan 22 02:39:04.827805 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242]        ^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:04.827808 2024] [wsgi:error] [pid 8:tid 281472912716064] [client 172.18.0.1:38242] AttributeError: 'NoneType' object has no attribute 'endswith'

[Mon Jan 22 02:39:05.576990 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286] [2024-01-22 02:39:05,574] ERROR in app: Exception on /v1/feed/search/ [HEAD]
[Mon Jan 22 02:39:05.577019 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286] Traceback (most recent call last):
[Mon Jan 22 02:39:05.577024 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 1455, in wsgi_app
[Mon Jan 22 02:39:05.577027 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]     response = self.full_dispatch_request()
[Mon Jan 22 02:39:05.577029 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:05.577033 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 869, in full_dispatch_request
[Mon Jan 22 02:39:05.577035 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]     rv = self.handle_user_exception(e)
[Mon Jan 22 02:39:05.577038 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:05.577040 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 867, in full_dispatch_request
[Mon Jan 22 02:39:05.577043 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]     rv = self.dispatch_request()
[Mon Jan 22 02:39:05.577045 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]          ^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:05.577047 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]   File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 852, in dispatch_request
[Mon Jan 22 02:39:05.577050 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]     return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
[Mon Jan 22 02:39:05.577053 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:05.577055 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/api/searchapi.py", line 141, in feed_search
[Mon Jan 22 02:39:05.577058 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]     params = get_search_params(request, search_type)
[Mon Jan 22 02:39:05.577060 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Mon Jan 22 02:39:05.577063 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]   File "/usr/local/apache2/htdocs/dynamic/searchmysite/searchutils.py", line 70, in get_search_params
[Mon Jan 22 02:39:05.577066 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]     for key in keys:
[Mon Jan 22 02:39:05.577068 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286]                ^^^^
[Mon Jan 22 02:39:05.577070 2024] [wsgi:error] [pid 9:tid 281473592258848] [client 172.18.0.1:38286] UnboundLocalError: cannot access local variable 'keys' where it is not associated with a value