Trouble setting up irony mode with company and json compilation database

[LefterisJP]

Hello,

First of all I would like to thank you for making irony-mode. It seems like a really nice package that greatly enhances the C/C++ editing experience.

I am an rtags user, but wanted to combine it with irony mode so as to get nice completions. Thus I tried to use company mode and company-irony. I obtained the packages from el-get. My setup is as follows:

init-irony-mode.el:

(add-hook 'c++-mode-hook 'irony-mode)
(add-hook 'c-mode-hook 'irony-mode)
(add-hook 'objc-mode-hook 'irony-mode)

;; replace the `completion-at-point' and `complete-symbol' bindings in
;; irony-mode's buffers by irony-mode's function
(defun my-irony-mode-hook ()
  (define-key irony-mode-map [remap completion-at-point]
    'irony-completion-at-point-async)
  (define-key irony-mode-map [remap complete-symbol]
    'irony-completion-at-point-async))
(add-hook 'irony-mode-hook 'my-irony-mode-hook)
(add-hook 'irony-mode-hook 'irony-cdb-autosetup-compile-options)

init-company-irony.el

(eval-after-load 'company
  '(add-to-list 'company-backends 'company-irony))

;; (optional) adds CC special commands to `company-begin-commands' in order to
;; trigger completion at interesting places, such as after scope operator
;;     std::|
(add-hook 'irony-mode-hook 'company-irony-setup-begin-commands)

Nothing fancy. Just what the wikis say. I also got (add-hook 'after-init-hook 'global-company-mode) somewhere so that I activate company mode.

I am using json compilation databases for all of my projects. I use a package that I have created to act as a glue between other emacs packages and create the json compilation database. I know that the database is valid since rtags server gets it as input and correctly navigates the projects.

So I have this json compilation named compile_commands.json in the root of the project. I suspect that irony mode actually reads it since I see something that looks like the whole project's compile flags, include directories and files when I execute irony-cdb-menu.

But the problem is that whenever I try to use any autocomplete or anything at all, all I get is an error message:

error in process filter: irony-completion-at-point: Wrong type argument: sequencep, libclang:

I also tried to describe the current company backend variable and it seems to be nil. This is funny because company-backends list has company-irony as the first one in the list. I tried to insert company-irony as the only element of company-backends but I got the same result.

While debugging I tried to remove (add-hook 'irony-mode-hook 'irony-cdb-autosetup-compile-options) from the setup. Then completion popup actually appeared but it was totally random. Seemed to have no proper source. Could the issue be with the way that irony autodetects the compilation database?

Do you have any idea what may be happening? IF you need any more information about my setup I will gladly provide.

[Sarcasm]

Hi,

Great to have some reports on this new compilation database plugin, I'm expecting some issues as it is used in real-world. And also because it's not much documented yet.

I'm curious about where does this libclang in Wrong type argument: sequencep, libclang comes from.

A few things you can do that may help debugging the issue:

1. turn on debug on error: M-x toggle-debug-on-error RET
2. call explicitly M-x irony-cdb-autosetup-compile-options RET, it is an interactive command that will look in the irony compilation databases and will setup the compile options if one of the databases respond to the get-compile-options command. I suggested in the docs to add it to the irony-mode hooks so that the compile options are set automatically but for people who don't want it, it is possible to call it on demand.
3. you can see the effective compile options used for completion by displaying the following variables: C-h v irony--compile-options RET and C-h v irony--working-directory but that is what irony-cdb-menu shows already.
4. Can you show me the active flags detected by irony so that I can see if some of them you have been filtered or if some are badly escaped or so.
5. call explicitly M-x company-irony RET
6. It looks like the error comes from completion-at-point, can you try to call M-x irony-completion-at-point-async RET and see if you get the error.

If the compile_commands.json is in a separate build directory, know that you can tell irony-cdb-json about it by calling M-x irony-cdb-json-add-compile-commands-path RET, it will ask for the project root and the location of the compile_commands.json.

I am using json compilation databases for all of my projects. I use a package that I have created to act as a glue between other emacs packages and create the json compilation database. I know that the database is valid since rtags server gets it as input and correctly navigates the projects.

Note that if you have already a knowledge of the flags, it could be a nice idea to create a compilation database for irony, see C-h v irony-cdb-compilation-databases RET.

[LefterisJP]

1. Calling irony-cdb-autosetup-compile-options explicity does not seem to produce any error.
2. With debug-on-error I get the following backtrace when I try to execute irony completion at point.

Debugger entered--Lisp error: (wrong-type-argument sequencep libclang:)
  mapcar(#[(candidate) "\301�@\302�#\207" [candidate propertize irony-capf] 4] libclang:)
  irony-completion-at-point()
  completion--capf-wrapper(irony-completion-at-point all)
  run-hook-wrapped(completion--capf-wrapper irony-completion-at-point all)
  completion-at-point()
  irony-completion-candidates-async(completion-at-point)
  irony-completion-at-point-async()
  call-interactively(irony-completion-at-point-async nil nil)
  command-execute(irony-completion-at-point-async)

1. What do you mean by active flags? Do you mean the irony--compile-options? If so it's quite a big output. It's a big project.
2. I will take a look at irony-cdb-compilation-databases and see if I can do something that works there.

P.S: One small note about the project. It uses CMAKE as its build system. Its root directory, where the compilation database file is located, contains a build directory (for CMAKE) where the compile commands are given. So the actual working directory for the compile commands is the build directory. Could that affect anything?

I know that you have the option to make the compilation database with CMAKE, but I tried it and it is the same result as with the malinka generate compilation database. I tried to place the database both in the build and in the root directory and point irony mode to it but nothing seemed to work. Keep getting that irony-completion-at-point: Wrong type argument: sequencep, libclang error.

[LefterisJP]

New development:

I modified the project I had been using to create the compilation database to opt for using cmake itself to create the compilation database and save it in the build directory. At first I saw no differences, but I stopped getting the error.

After 30-40 seconds completions started appearing! Perhaps irony was indexing the project in the meantime? I got no notice for project indexing though so I assumed the error was persisting. That leads me to suspect that if it's a Cmake project and the compile_commands.json is not in the build directory there is a problem. Because the only difference with before is that I had the compile_commands.json file in the root directory.

before:

+ root
--  compile_commands.json
--+ src
--+ build

now:

+ root
--+ src
--+ build
  |-- compile_commands.json

[Sarcasm]

Okay so I think there are a few different issues (but I may be wrong).

First it looks like you get the error not from company-irony but from company-capf (which looks at the completion-at-point which irony sets to irony-completion-at-point).

You have the string/value libclang: in your error. I believe this may comes from a crash of libclang, in these cases returns a string such as: libclang: crash detected during xxx>. Somehow this string gets mixed-up in the return value for completion whereas it should be logged or printed to the user. I will take a look at this but this is not so much of an expected condition and

The fact that your project is complex and the completion takes so much time may come from the fact that the compile options are wrong. libclang is unable to find all the include files or to parse them, so it cannot generate a preamble file and everything get a little bit sluggish.

Irony shouldn't care much about the location of the compile_commands.json file location, in theory it could be moved as the path inside are absolute, and include directories or so, if relative, will depend on the directory member of the command.

I think the root of the issue is that either libclang cannot parse your project for some reasons or that the compile options are a little bit wrong.

Can you edit the following code:

irony-mode/irony.el

Line 581 in b0923fd

"-i"

From:

            (start-process "Irony" irony--server-buffer
                           irony--server-executable
                           "-i"
+                          "-d"
                           "--log-file"

The addition of -d will add more debugging information to the log file. You can then look for errors in the log file located in /tmp/irony-*.

[Sarcasm]

When doing C-h e after your error, do you see a message such as irony process stopped!?

[LefterisJP]

Hello and sorry for answering so late. Real life working week got to me.

I just tried the things you asked at my work computer. At there I am not getting those errors but I have another more major problem. Irony-server does not even seem to start at all here.

I run emacs as a server with systemd and this is how systemctl status --user emacs output looks like when working on C++ code even when I have irony configured according to the wiki

● emacs.service - Emacs: the extensible, self-documenting text editor
   Loaded: loaded (/home/lefteris/.config/systemd/user/emacs.service; enabled)
   Active: active (running) since Sat 2014-12-13 04:19:34 CET; 7min ago
  Process: 20879 ExecStop=/usr/bin/emacsclient --eval (progn (setq kill-emacs-hook 'nil) (kill-emacs)) (code=exited, status=0/SUCCESS)
  Process: 20882 ExecStart=/usr/bin/emacs --daemon (code=exited, status=0/SUCCESS)
 Main PID: 20883 (emacs)
   CGroup: /user.slice/user-1000.slice/[email protected]/emacs.service
           ├─20883 /usr/bin/emacs --daemon
           └─20961 /usr/sbin/idn --quiet --idna-to-ascii --usestd3asciirules

After looking at the code I saw that calling this function (irony--initial-check-compile) would attempt to start the server. Sure enough, I got warnings for the current file since no cdb is actually loaded. After that the irony-server seems to be running under emacs in interactive mode.

   CGroup: /user.slice/user-1000.slice/[email protected]/emacs.service
           ├─20883 /usr/bin/emacs --daemon
           ├─20961 /usr/sbin/idn --quiet --idna-to-ascii --usestd3asciirules
           └─21478 /home/lefteris/.emacs.d/irony/bin/irony-server -i --log-file /tmp/irony.2014-12-13_04h-27m-12s.log

So the problem now is that no matter what I do the compilation database can not be found. As I said it is located under the build directory but using neither (irony-cdb-autosetup-compile-options) or M-x irony-cdb-json-add-compile-commands-path RET did anything. My cdb-menu is empty.

And for some reason the server does not start automatically but instead I had to explicity start it as I mentioned above.

I realize this is quite probably a different issue. If you would like I could open another ticket, and here we can continue discussion on the original issue which I will try to reproduce when I am back at my home computer where it first occured. Whatever you would like.

[Sarcasm]

After looking at the code I saw that calling this function (irony--initial-check-compile) would attempt to start the server. Sure enough, I got warnings for the current file since no cdb is actually loaded. After that the irony-server seems to be running under emacs in interactive mode.

irony--initial-check-compile is not used and will be removed in future version.

And for some reason the server does not start automatically but instead I had to explicity start it as I mentioned above.

The server starts only when needed. Right now it will start only you start asking for completion.

[LefterisJP]

So as I said I have to investigate further about what I mentioned in my last post. It's a totally different thing on a different computer.

Back to the original issue. I tried it in a different project which gets the compilation database the same way, by the Malinka package. I got the same results. If I use a project with cmake > 2.85 which has CMake generate the compilation database, then completions do work. If I use the malinka generated database then I get the libclang error.

This should be a strong hint that the generated database may be flawed. I always assumed it was correct since it works when it is fed to the RTAGS daemon. If that is indeed the case and since I am the author of malinka I would really like to see why so that I can fix and improve it.

For the things you asked. After setting the debug mode on for the server and getting the error I see the following in the log: (Warning, it's big)

execute: Command{action=Command::Complete, file='/home/lefteris/w/refu/lang/src/front_ctx.c', line=62, column=5, flags=['-x', 'c', '-working-directory', '/home/lefteris/w/refu/', '-static-libgcc', '-std=gnu99', '-Wall', '-fomit-frame-pointer', '-fPIC', '-g', '-O0', 'lang/src/compiler_args.c', 'lang/src/inpfile.c', 'lang/src/inpstr.c', 'lang/src/inplocation.c', 'lang/src/inpoffset.c', 'lang/src/parser/parser.c', 'lang/src/info/info.c', 'lang/src/info/msg.c', 'lang/src/lexer/lexer.c', 'lang/src/lexer/tokens.c', 'lang/src/ast/ast.c', 'lang/src/ast/block.c', 'lang/src/ast/identifier.c', 'lang/src/ast/string_literal.c', 'lang/src/ast/constant_num.c', 'lang/src/ast/type.c', 'lang/src/ast/typeclass.c', 'lang/src/ast/vardecl.c', 'lang/src/ast/function.c', 'lang/src/ast/arrayref.c', 'lang/src/ast/generics.c', 'lang/src/ast/operators.c', 'lang/src/ast/ifexpr.c', 'lang/src/ast/ast_utils.c', 'lang/src/analyzer/analyzer.c', 'lang/src/analyzer/symbol_table.c', 'lang/src/analyzer/analyzer_pass1.c', 'lang/src/analyzer/typecheck.c', 'lang/src/analyzer/types.c', 'lang/src/analyzer/string_table.c', 'lang/src/serializer/serializer.c', 'lang/src/parser/recursive_descent/core.c', 'lang/src/parser/recursive_descent/identifier.c', 'lang/src/parser/recursive_descent/function.c', 'lang/src/parser/recursive_descent/generics.c', 'lang/src/parser/recursive_descent/type.c', 'lang/src/parser/recursive_descent/typeclass.c', 'lang/src/parser/recursive_descent/expression.c', 'lang/src/parser/recursive_descent/arrayref.c', 'lang/src/parser/recursive_descent/block.c', 'lang/src/parser/recursive_descent/vardecl.c', 'lang/src/parser/recursive_descent/ifexpr.c', 'lang/src/backend/llvm.c', 'lang/src/backend/llvm_ast.c', 'lang/src/main.c', 'clib/src/refu.c', 'clib/src/Utils/endianess.c', 'clib/src/Utils/log.c', 'clib/src/Utils/math.c', 'clib/src/Persistent/buffers.c', 'clib/src/Utils/buffer.c', 'clib/src/Utils/array.c', 'clib/src/Utils/rf_unicode.c', 'clib/src/Utils/hash.c', 'clib/src/Numeric/Integer/conversion.c', 'clib/src/String/rf_str_common.c', 'clib/src/String/rf_str_commonp.c', 'clib/src/String/rf_str_conversion.c', 'clib/src/String/rf_str_conversionp.c', 'clib/src/String/rf_str_core.c', 'clib/src/String/rf_str_corex.c', 'clib/src/String/rf_str_files.c', 'clib/src/String/rf_str_filesx.c', 'clib/src/String/rf_str_module.c', 'clib/src/String/rf_str_manipulation.c', 'clib/src/String/rf_str_manipulationx.c', 'clib/src/String/rf_str_retrieval.c', 'clib/src/String/rf_str_traversalx.c', 'clib/src/Parallel/rf_threading.c', 'clib/src/Parallel/rf_worker_pool_linux.c', 'clib/src/Parallel/rf_threading_linux.c', 'clib/src/IO/rf_file.c', 'clib/src/IO/rf_textfile.c', 'clib/src/Data_Structures/intrusive_list.c', 'clib/src/Data_Structures/htable.c', 'clib/src/Utils/fixed_memory_pool.c', 'clib/src/Data_Structures/binaryarray.c', 'clib/src/Time/time_linux.c', 'clib/src/System/rf_system_linux.c', 'clib/src/System/rf_system_info_linux.c', '-static-libgcc', '-std=gnu99', '-Wall', '-fomit-frame-pointer', '-fPIC', '-g', '-O0', 'lang/src/compiler_args.c', 'lang/src/inpfile.c', 'lang/src/inpstr.c', 'lang/src/inplocation.c', 'lang/src/inpoffset.c', 'lang/src/parser/parser.c', 'lang/src/info/info.c', 'lang/src/info/msg.c', 'lang/src/lexer/lexer.c', 'lang/src/lexer/tokens.c', 'lang/src/ast/ast.c', 'lang/src/ast/block.c', 'lang/src/ast/identifier.c', 'lang/src/ast/string_literal.c', 'lang/src/ast/constant_num.c', 'lang/src/ast/type.c', 'lang/src/ast/typeclass.c', 'lang/src/ast/vardecl.c', 'lang/src/ast/function.c', 'lang/src/ast/arrayref.c', 'lang/src/ast/generics.c', 'lang/src/ast/operators.c', 'lang/src/ast/ifexpr.c', 'lang/src/ast/ast_utils.c', 'lang/src/analyzer/analyzer.c', 'lang/src/analyzer/symbol_table.c', 'lang/src/analyzer/analyzer_pass1.c', 'lang/src/analyzer/typecheck.c', 'lang/src/analyzer/types.c', 'lang/src/analyzer/string_table.c', 'lang/src/serializer/serializer.c', 'lang/src/parser/recursive_descent/core.c', 'lang/src/parser/recursive_descent/identifier.c', 'lang/src/parser/recursive_descent/function.c', 'lang/src/parser/recursive_descent/generics.c', 'lang/src/parser/recursive_descent/type.c', 'lang/src/parser/recursive_descent/typeclass.c', 'lang/src/parser/recursive_descent/expression.c', 'lang/src/parser/recursive_descent/arrayref.c', 'lang/src/parser/recursive_descent/block.c', 'lang/src/parser/recursive_descent/vardecl.c', 'lang/src/parser/recursive_descent/ifexpr.c', 'lang/src/backend/llvm.c', 'lang/src/backend/llvm_ast.c', 'lang/src/main.c', 'clib/src/refu.c', 'clib/src/Utils/endianess.c', 'clib/src/Utils/log.c', 'clib/src/Utils/math.c', 'clib/src/Persistent/buffers.c', 'clib/src/Utils/buffer.c', 'clib/src/Utils/array.c', 'clib/src/Utils/rf_unicode.c', 'clib/src/Utils/hash.c', 'clib/src/Numeric/Integer/conversion.c', 'clib/src/String/rf_str_common.c', 'clib/src/String/rf_str_commonp.c', 'clib/src/String/rf_str_conversion.c', 'clib/src/String/rf_str_conversionp.c', 'clib/src/String/rf_str_core.c', 'clib/src/String/rf_str_corex.c', 'clib/src/String/rf_str_files.c', 'clib/src/String/rf_str_filesx.c', 'clib/src/String/rf_str_module.c', 'clib/src/String/rf_str_manipulation.c', 'clib/src/String/rf_str_manipulationx.c', 'clib/src/String/rf_str_retrieval.c', 'clib/src/String/rf_str_traversalx.c', 'clib/src/Parallel/rf_threading.c', 'clib/src/Parallel/rf_worker_pool_linux.c', 'clib/src/Parallel/rf_threading_linux.c', 'clib/src/IO/rf_file.c', 'clib/src/IO/rf_textfile.c', 'clib/src/Data_Structures/intrusive_list.c', 'clib/src/Data_Structures/htable.c', 'clib/src/Utils/fixed_memory_pool.c', 'clib/src/Data_Structures/binaryarray.c', 'clib/src/Time/time_linux.c', 'clib/src/System/rf_system_linux.c', 'clib/src/System/rf_system_info_linux.c', '-static-libgcc', '-std=gnu99', '-Wall', '-fomit-frame-pointer', '-fPIC', '-g', '-O0', 'lang/src/compiler_args.c', 'lang/src/inpfile.c', 'lang/src/inpstr.c', 'lang/src/inplocation.c', 'lang/src/inpoffset.c', 'lang/src/parser/parser.c', 'lang/src/info/info.c', 'lang/src/info/msg.c', 'lang/src/lexer/lexer.c', 'lang/src/lexer/tokens.c', 'lang/src/ast/ast.c', 'lang/src/ast/block.c', 'lang/src/ast/identifier.c', 'lang/src/ast/string_literal.c', 'lang/src/ast/constant_num.c', 'lang/src/ast/type.c', 'lang/src/ast/typeclass.c', 'lang/src/ast/vardecl.c', 'lang/src/ast/function.c', 'lang/src/ast/arrayref.c', 'lang/src/ast/generics.c', 'lang/src/ast/operators.c', 'lang/src/ast/ifexpr.c', 'lang/src/ast/ast_utils.c', 'lang/src/analyzer/analyzer.c', 'lang/src/analyzer/symbol_table.c', 'lang/src/analyzer/analyzer_pass1.c', 'lang/src/analyzer/typecheck.c', 'lang/src/analyzer/types.c', 'lang/src/analyzer/string_table.c', 'lang/src/serializer/serializer.c', 'lang/src/parser/recursive_descent/core.c', 'lang/src/parser/recursive_descent/identifier.c', 'lang/src/parser/recursive_descent/function.c', 'lang/src/parser/recursive_descent/generics.c', 'lang/src/parser/recursive_descent/type.c', 'lang/src/parser/recursive_descent/typeclass.c', 'lang/src/parser/recursive_descent/expression.c', 'lang/src/parser/recursive_descent/arrayref.c', 'lang/src/parser/recursive_descent/block.c', 'lang/src/parser/recursive_descent/vardecl.c', 'lang/src/parser/recursive_descent/ifexpr.c', 'lang/src/backend/llvm.c', 'lang/src/backend/llvm_ast.c', 'lang/src/main.c', 'clib/src/refu.c', 'clib/src/Utils/endianess.c', 'clib/src/Utils/log.c', 'clib/src/Utils/math.c', 'clib/src/Persistent/buffers.c', 'clib/src/Utils/buffer.c', 'clib/src/Utils/array.c', 'clib/src/Utils/rf_unicode.c', 'clib/src/Utils/hash.c', 'clib/src/Numeric/Integer/conversion.c', 'clib/src/String/rf_str_common.c', 'clib/src/String/rf_str_commonp.c', 'clib/src/String/rf_str_conversion.c', 'clib/src/String/rf_str_conversionp.c', 'clib/src/String/rf_str_core.c', 'clib/src/String/rf_str_corex.c', 'clib/src/String/rf_str_files.c', 'clib/src/String/rf_str_filesx.c', 'clib/src/String/rf_str_module.c', 'clib/src/String/rf_str_manipulation.c', 'clib/src/String/rf_str_manipulationx.c', 'clib/src/String/rf_str_retrieval.c', 'clib/src/String/rf_str_traversalx.c', 'clib/src/Parallel/rf_threading.c', 'clib/src/Parallel/rf_worker_pool_linux.c', 'clib/src/Parallel/rf_threading_linux.c', 'clib/src/IO/rf_file.c', 'clib/src/IO/rf_textfile.c', 'clib/src/Data_Structures/intrusive_list.c', 'clib/src/Data_Structures/htable.c', 'clib/src/Utils/fixed_memory_pool.c', 'clib/src/Data_Structures/binaryarray.c', 'clib/src/Time/time_linux.c', 'clib/src/System/rf_system_linux.c', 'clib/src/System/rf_system_info_linux.c', '-static-libgcc', '-std=gnu99', '-Wall', '-fomit-frame-pointer', '-fPIC', '-g', '-O0', 'lang/src/compiler_args.c', 'lang/src/inpfile.c', 'lang/src/inpstr.c', 'lang/src/inplocation.c', 'lang/src/inpoffset.c', 'lang/src/parser/parser.c', 'lang/src/info/info.c', 'lang/src/info/msg.c', 'lang/src/lexer/lexer.c', 'lang/src/lexer/tokens.c', 'lang/src/ast/ast.c', 'lang/src/ast/block.c', 'lang/src/ast/identifier.c', 'lang/src/ast/string_literal.c', 'lang/src/ast/constant_num.c', 'lang/src/ast/type.c', 'lang/src/ast/typeclass.c', 'lang/src/ast/vardecl.c', 'lang/src/ast/function.c', 'lang/src/ast/arrayref.c', 'lang/src/ast/generics.c', 'lang/src/ast/operators.c', 'lang/src/ast/ifexpr.c', 'lang/src/ast/ast_utils.c', 'lang/src/analyzer/analyzer.c', 'lang/src/analyzer/symbol_table.c', 'lang/src/analyzer/analyzer_pass1.c', 'lang/src/analyzer/typecheck.c', 'lang/src/analyzer/types.c', 'lang/src/analyzer/string_table.c', 'lang/src/serializer/serializer.c', 'lang/src/parser/recursive_descent/core.c', 'lang/src/parser/recursive_descent/identifier.c', 'lang/src/parser/recursive_descent/function.c', 'lang/src/parser/recursive_descent/generics.c', 'lang/src/parser/recursive_descent/type.c', 'lang/src/parser/recursive_descent/typeclass.c', 'lang/src/parser/recursive_descent/expression.c', 'lang/src/parser/recursive_descent/arrayref.c', 'lang/src/parser/recursive_descent/block.c', 'lang/src/parser/recursive_descent/vardecl.c', 'lang/src/parser/recursive_descent/ifexpr.c', 'lang/src/backend/llvm.c', 'lang/src/backend/llvm_ast.c', 'lang/src/main.c', 'clib/src/refu.c', 'clib/src/Utils/endianess.c', 'clib/src/Utils/log.c', 'clib/src/Utils/math.c', 'clib/src/Persistent/buffers.c', 'clib/src/Utils/buffer.c', 'clib/src/Utils/array.c', 'clib/src/Utils/rf_unicode.c', 'clib/src/Utils/hash.c', 'clib/src/Numeric/Integer/conversion.c', 'clib/src/String/rf_str_common.c', 'clib/src/String/rf_str_commonp.c', 'clib/src/String/rf_str_conversion.c', 'clib/src/String/rf_str_conversionp.c', 'clib/src/String/rf_str_core.c', 'clib/src/String/rf_str_corex.c', 'clib/src/String/rf_str_files.c', 'clib/src/String/rf_str_filesx.c', 'clib/src/String/rf_str_module.c', 'clib/src/String/rf_str_manipulation.c', 'clib/src/String/rf_str_manipulationx.c', 'clib/src/String/rf_str_retrieval.c', 'clib/src/String/rf_str_traversalx.c', 'clib/src/Parallel/rf_threading.c', 'clib/src/Parallel/rf_worker_pool_linux.c', 'clib/src/Parallel/rf_threading_linux.c', 'clib/src/IO/rf_file.c', 'clib/src/IO/rf_textfile.c', 'clib/src/Data_Structures/intrusive_list.c', 'clib/src/Data_Structures/htable.c', 'clib/src/Utils/fixed_memory_pool.c', 'clib/src/Data_Structures/binaryarray.c', 'clib/src/Time/time_linux.c', 'clib/src/System/rf_system_linux.c', 'clib/src/System/rf_system_info_linux.c', '-DRF_HAVE_STATEMENT_EXPR', '-DRF_HAVE_TYPEOF', '-DREFU_LINUX_VERSION', '-D_LARGEFILE64_SOURCE', '-D_GNU_SOURCE', '-D_FILE_OFFSET_BITS=64', '-DRFATTR_COLD=__attribute__\(\(cold\)\)', '-DRF_HAVE_LITTLE_ENDIAN', '-DREFU_COMPILING', '-DRF_OPTION_NULLPTR_CHECKS', '-DRF_OPTION_TEXTFILE_ADD_BOM', '-DRF_OPTION_FGETS_READ_BYTESN=512', '-DRF_OPTION_STRINGX_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_DYNAMICARRAY_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_LOCALSTACK_MEMORY_SIZE=1048576', '-DRF_OPTION_THREADX_MSGQUEUE_SIZE=10', '-DRF_OPTION_HASHMAP_LOAD_FACTOR=0.7', '-DRF_OPTION_LOG_LEVEL_DEFAULT=LOG_ERROR', '-DRF_OPTION_LOG_BUFFER_SIZE=4096', '-DRF_OPTION_WORKER_SLEEP_MICROSECONDS=1000', '-DRF_OPTION_MAX_WORKER_THREADS=32', '-DRF_MODULE_STRINGS', '-DRF_MODULE_INTRUSIVE_LIST', '-DRF_MODULE_HTABLE', '-DRF_MODULE_MEMORY_POOL', '-DRF_MODULE_SYSTEM', '-DRF_MODULE_IO', '-DRF_MODULE_IO_TEXTFILE', '-DVERBOSE_LEVEL_DEFAULT=1', '-D__STDC_CONSTANT_MACROS', '-D__STDC_FORMAT_MACROS', '-D__STDC_LIMIT_MACROS', '-DRF_OPTION_DEBUG', '-DRF_MODULE_PARALLEL', '-DRF_MODULE_BINARYARRAY', '-DRF_MODULE_TIME_TIMER', '-DREFU_STATIC_LIB', '-DRF_HAVE_STATEMENT_EXPR', '-DRF_HAVE_TYPEOF', '-DREFU_LINUX_VERSION', '-D_LARGEFILE64_SOURCE', '-D_GNU_SOURCE', '-D_FILE_OFFSET_BITS=64', '-DRFATTR_COLD=__attribute__\(\(cold\)\)', '-DRF_HAVE_LITTLE_ENDIAN', '-DREFU_COMPILING', '-DRF_OPTION_NULLPTR_CHECKS', '-DRF_OPTION_TEXTFILE_ADD_BOM', '-DRF_OPTION_FGETS_READ_BYTESN=512', '-DRF_OPTION_STRINGX_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_DYNAMICARRAY_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_LOCALSTACK_MEMORY_SIZE=1048576', '-DRF_OPTION_THREADX_MSGQUEUE_SIZE=10', '-DRF_OPTION_HASHMAP_LOAD_FACTOR=0.7', '-DRF_OPTION_LOG_LEVEL_DEFAULT=LOG_ERROR', '-DRF_OPTION_LOG_BUFFER_SIZE=4096', '-DRF_OPTION_WORKER_SLEEP_MICROSECONDS=1000', '-DRF_OPTION_MAX_WORKER_THREADS=32', '-DRF_MODULE_STRINGS', '-DRF_MODULE_INTRUSIVE_LIST', '-DRF_MODULE_HTABLE', '-DRF_MODULE_MEMORY_POOL', '-DRF_MODULE_SYSTEM', '-DRF_MODULE_IO', '-DRF_MODULE_IO_TEXTFILE', '-DVERBOSE_LEVEL_DEFAULT=1', '-D__STDC_CONSTANT_MACROS', '-D__STDC_FORMAT_MACROS', '-D__STDC_LIMIT_MACROS', '-DRF_OPTION_DEBUG', '-DRF_MODULE_PARALLEL', '-DRF_MODULE_BINARYARRAY', '-DRF_MODULE_TIME_TIMER', '-DREFU_STATIC_LIB', '-DRF_HAVE_STATEMENT_EXPR', '-DRF_HAVE_TYPEOF', '-DREFU_LINUX_VERSION', '-D_LARGEFILE64_SOURCE', '-D_GNU_SOURCE', '-D_FILE_OFFSET_BITS=64', '-DRFATTR_COLD=__attribute__\(\(cold\)\)', '-DRF_HAVE_LITTLE_ENDIAN', '-DREFU_COMPILING', '-DRF_OPTION_NULLPTR_CHECKS', '-DRF_OPTION_TEXTFILE_ADD_BOM', '-DRF_OPTION_FGETS_READ_BYTESN=512', '-DRF_OPTION_STRINGX_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_DYNAMICARRAY_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_LOCALSTACK_MEMORY_SIZE=1048576', '-DRF_OPTION_THREADX_MSGQUEUE_SIZE=10', '-DRF_OPTION_HASHMAP_LOAD_FACTOR=0.7', '-DRF_OPTION_LOG_LEVEL_DEFAULT=LOG_ERROR', '-DRF_OPTION_LOG_BUFFER_SIZE=4096', '-DRF_OPTION_WORKER_SLEEP_MICROSECONDS=1000', '-DRF_OPTION_MAX_WORKER_THREADS=32', '-DRF_MODULE_STRINGS', '-DRF_MODULE_INTRUSIVE_LIST', '-DRF_MODULE_HTABLE', '-DRF_MODULE_MEMORY_POOL', '-DRF_MODULE_SYSTEM', '-DRF_MODULE_IO', '-DRF_MODULE_IO_TEXTFILE', '-DVERBOSE_LEVEL_DEFAULT=1', '-D__STDC_CONSTANT_MACROS', '-D__STDC_FORMAT_MACROS', '-D__STDC_LIMIT_MACROS', '-DRF_OPTION_DEBUG', '-DRF_MODULE_PARALLEL', '-DRF_MODULE_BINARYARRAY', '-DRF_MODULE_TIME_TIMER', '-DREFU_STATIC_LIB', '-DRF_HAVE_STATEMENT_EXPR', '-DRF_HAVE_TYPEOF', '-DREFU_LINUX_VERSION', '-D_LARGEFILE64_SOURCE', '-D_GNU_SOURCE', '-D_FILE_OFFSET_BITS=64', '-DRFATTR_COLD=__attribute__\(\(cold\)\)', '-DRF_HAVE_LITTLE_ENDIAN', '-DREFU_COMPILING', '-DRF_OPTION_NULLPTR_CHECKS', '-DRF_OPTION_TEXTFILE_ADD_BOM', '-DRF_OPTION_FGETS_READ_BYTESN=512', '-DRF_OPTION_STRINGX_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_DYNAMICARRAY_CAPACITY_MULTIPLIER=2', '-DRF_OPTION_LOCALSTACK_MEMORY_SIZE=1048576', '-DRF_OPTION_THREADX_MSGQUEUE_SIZE=10', '-DRF_OPTION_HASHMAP_LOAD_FACTOR=0.7', '-DRF_OPTION_LOG_LEVEL_DEFAULT=LOG_ERROR', '-DRF_OPTION_LOG_BUFFER_SIZE=4096', '-DRF_OPTION_WORKER_SLEEP_MICROSECONDS=1000', '-DRF_OPTION_MAX_WORKER_THREADS=32', '-DRF_MODULE_STRINGS', '-DRF_MODULE_INTRUSIVE_LIST', '-DRF_MODULE_HTABLE', '-DRF_MODULE_MEMORY_POOL', '-DRF_MODULE_SYSTEM', '-DRF_MODULE_IO', '-DRF_MODULE_IO_TEXTFILE', '-DVERBOSE_LEVEL_DEFAULT=1', '-D__STDC_CONSTANT_MACROS', '-D__STDC_FORMAT_MACROS', '-D__STDC_LIMIT_MACROS', '-DRF_OPTION_DEBUG', '-DRF_MODULE_PARALLEL', '-DRF_MODULE_BINARYARRAY', '-DRF_MODULE_TIME_TIMER', '-DREFU_STATIC_LIB', '-Iclib/include', '-Ilang/include', '-I/usr/include', '-Iclib/include', '-Ilang/include', '-I/usr/include', '-Iclib/include', '-Ilang/include', '-I/usr/include', '-Iclib/include', '-Ilang/include', '-I/usr/include'], unsavedFiles.count=1, opt=off}
unsaved file 1: /home/lefteris/w/refu/lang/src/front_ctx.c
----
FILE SOURCE -- REMOVED FOR SIZE
----
error: libclang couldn't parse '/home/lefteris/w/refu/lang/src/front_ctx.c'

And from that alone I think I can spot what would confuse clang. For some reason the compilation database seems to contain every other source of the project for each file as compiler arguments. Let me try to address that on my side. I still wonder why it works with the Rtags daemon then though.

I guess that on irony's side a more graceful way of handling such a failure would be nice with maybe an error message like the above: `libclang couldn't parse '/home/lefteris/w/refu/lang/src/front_ctx.c'

[LefterisJP]

This weekend I will do a bit of reworking of how malinka generates the databases, and also pretty print it. For now I tried a dirty fix to not include the extra source files as arguments in the command. It worked but unfortunately completions still did not work.

Which lead me to finding the last incosistency between the 2 compilation databases. Relative paths. I was using relative paths to the build directory in the malinka compilation database. This is why irony mode could not find them.

This cdb entry did not work with irony:

{"directory":"/home/lefteris/w/refu/",
"command":"gcc -static-libgcc -std=gnu99 -Wall -fomit-frame-pointer -fPIC -g -O0 -DRF_HAVE_STATEMENT_EXPR -DRF_HAVE_TYPEOF -DREFU_LINUX_VERSION -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -DRFATTR_COLD=__attribute__\\(\\(cold\\)\\) -DRF_HAVE_LITTLE_ENDIAN -DREFU_COMPILING -DRF_OPTION_NULLPTR_CHECKS -DRF_OPTION_TEXTFILE_ADD_BOM -DRF_OPTION_FGETS_READ_BYTESN=512 -DRF_OPTION_STRINGX_CAPACITY_MULTIPLIER=2 -DRF_OPTION_DYNAMICARRAY_CAPACITY_MULTIPLIER=2 -DRF_OPTION_LOCALSTACK_MEMORY_SIZE=1048576 -DRF_OPTION_THREADX_MSGQUEUE_SIZE=10 -DRF_OPTION_HASHMAP_LOAD_FACTOR=0.7 -DRF_OPTION_LOG_LEVEL_DEFAULT=LOG_ERROR -DRF_OPTION_LOG_BUFFER_SIZE=4096 -DRF_OPTION_WORKER_SLEEP_MICROSECONDS=1000 -DRF_OPTION_MAX_WORKER_THREADS=32 -DRF_MODULE_STRINGS -DRF_MODULE_INTRUSIVE_LIST -DRF_MODULE_HTABLE -DRF_MODULE_MEMORY_POOL -DRF_MODULE_SYSTEM -DRF_MODULE_IO -DRF_MODULE_IO_TEXTFILE -DVERBOSE_LEVEL_DEFAULT=1 -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -DRF_OPTION_DEBUG -DRF_MODULE_PARALLEL -DRF_MODULE_BINARYARRAY -DRF_MODULE_TIME_TIMER -DREFU_STATIC_LIB -Iclib/include -I/home/lefteris/w/refu/lang/include -I/usr/include -c -o lang/src/compiler_args.o lang/src/compiler_args.c",
"file":"lang/src/compiler_args.c"},

This cdb entry worked:

{"directory":"/home/lefteris/w/refu/",
"command":"gcc -static-libgcc -std=gnu99 -Wall -fomit-frame-pointer -fPIC -g -O0 -DRF_HAVE_STATEMENT_EXPR -DRF_HAVE_TYPEOF -DREFU_LINUX_VERSION -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -DRFATTR_COLD=__attribute__\\(\\(cold\\)\\) -DRF_HAVE_LITTLE_ENDIAN -DREFU_COMPILING -DRF_OPTION_NULLPTR_CHECKS -DRF_OPTION_TEXTFILE_ADD_BOM -DRF_OPTION_FGETS_READ_BYTESN=512 -DRF_OPTION_STRINGX_CAPACITY_MULTIPLIER=2 -DRF_OPTION_DYNAMICARRAY_CAPACITY_MULTIPLIER=2 -DRF_OPTION_LOCALSTACK_MEMORY_SIZE=1048576 -DRF_OPTION_THREADX_MSGQUEUE_SIZE=10 -DRF_OPTION_HASHMAP_LOAD_FACTOR=0.7 -DRF_OPTION_LOG_LEVEL_DEFAULT=LOG_ERROR -DRF_OPTION_LOG_BUFFER_SIZE=4096 -DRF_OPTION_WORKER_SLEEP_MICROSECONDS=1000 -DRF_OPTION_MAX_WORKER_THREADS=32 -DRF_MODULE_STRINGS -DRF_MODULE_INTRUSIVE_LIST -DRF_MODULE_HTABLE -DRF_MODULE_MEMORY_POOL -DRF_MODULE_SYSTEM -DRF_MODULE_IO -DRF_MODULE_IO_TEXTFILE -DVERBOSE_LEVEL_DEFAULT=1 -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -DRF_OPTION_DEBUG -DRF_MODULE_PARALLEL -DRF_MODULE_BINARYARRAY -DRF_MODULE_TIME_TIMER -DREFU_STATIC_LIB -Iclib/include -I/home/lefteris/w/refu/lang/include -I/usr/include -c -o /home/lefteris/w/refu/lang/src/compiler_args.o /home/lefteris/w/refu/lang/src/compiler_args.c",
"file":"/home/lefteris/w/refu/lang/src/compiler_args.c"},

I think that relative paths to the build directory should be working as the example contained in clang's own page actually is one with relative paths.

If you need any help to figure out why relative paths don't work feel free to ask me anything.

[Sarcasm]

I will have to look more clearly but paths should normally be expanded, see this code:

irony-mode/irony-cdb-json.el

Lines 207 to 208 in e5aea72

	(path (expand-file-name
	(irony-cdb-json--compile-command-file compile-command) directory))

Will check your issue more clearly during the week.

edit: oh you are probably not talking about the "file" entry but the include paths and things like that. There might be some errors on this side.

[pronobis]

I receive the same problem as mentioned in the original post above:

list: Wrong type argument: sequencep, libclang:

This happens when I try to run irony-completion-at-point-async to complete an unfinished symbol name. However, everything works as expected if I'm completing after "->" or "." as in:

foo->s|

Also, I am using company-irony and do not get any completions in the middle of a symbol, while I do get them perfectly after "->" or ".".

Same bug?

[Sarcasm]

@pronobis: not necessarily the same bug.

list: Wrong type argument: sequencep, libclang:

This message is just due to an internal error of libclang while parsing your file. It usually comes from the code that Clang for some reasons is unable to handle (it has become a rare occurence with recent versions of Clang IMHO).

If you could open another issue that would be better to keep track of the problem.

[pronobis]

Sounds good.
#144

[Sarcasm]

@LefterisJP: Thinking about it, the path should be handle properly by Clang I think, because I'm adding the working directory as shown in irony-cdb-menu to the compile options for the buffer, so the effective command line is more along the line of

-working-directory /home/lefteris/w/refu/ -std=gnu99 -Wall -fomit-frame-pointer -fPIC ...

[LefterisJP]

After some changes to my setup I can't reproduce it properly anymore. I still have issues with irony not picking the compilation database sometimes but it may be that it's a bit slower than I would have wanted because it does pick completions up after some time.

When I find the time I will need to debug it more and see if I still get any libclang crushes under any circumstances. If not then this issue may no longer be an issue.

[Sarcasm]

After some changes to my setup I can't reproduce it properly anymore. I still have issues with irony not picking the compilation database sometimes but it may be that it's a bit slower than I would have wanted because it does pick completions up after some time.

irony-mode may take some time to load the completion database when you open the buffer but this is not something done in background so you would notice it if it's too long (and you wouldn't be able to perform code-completion or things like that until it's done anyway). So in theory, either the compile options are right or they aren't but it is not something that should change after some time. The issue may be somewhere else, let me know of your findings if it happens (potentially in another issue if this one is closed).

[LefterisJP]

Definitely. Thanks for your responsiveness. I really appreciate irony as a tool and want to see it improve :)

[DanSchoppe]

Sarcasm,

I'm running into a similar issue as LefterisJP was describing. It sounds like LefterisJP was unable to recreate the issue any longer so maybe I can help track down the issue. If my problem turns out to be unrelated I can just create a new thread.

Installation: I installed company, company-irony, and irony-mode packages from Melpa. I updated my init.el to include the suggested entries for the three packages, exactly how LefterisJP listed in his first post. I built and installed irony server pointing to my homebrew installation of llvm 3.5.1 by adding the -DCMAKE_PREFIX_PATH=[path/to/llvm/3.5.1] to the cmake args.

Project: Makefile project, so I used bear to generate a JSON database containing compile flags. The compile_commands.json file looks like it has a list of flags for each object as I would expect. Just like LefterisJP, I am successfully using this JSON database with RTags.

When I run irony-completion-at-point-async in a project file, I get back "Wrong type argument: sequencep, libclang:" After toggling on debug on error I get a backtrace with the same contents as LefterisJP listed earlier.

Here's where I start to get suspicious... When I inspect irony--compile-options (after running irony-completion-at-point-async), only the first entry from the compile_commands.json file is listed in the variable. Perhaps LefterisJP's compile_commands.json file changed due to another generation tool or from changes to his project that fixed the irony--compile-options issue.

I also tested the irony-server in a bash terminal (not sure if this is relevant or helpful):
./irony-server -d complete [path/to/source/file.cpp] 100 7 RET RET

execute: Command{action=Command::Complete, file='[path/to/source/file.cpp]', line=100, column=7, flags=[], unsavedFiles.count=0, opt=off}
Assertion failed: (!T->isBeingDefined() && "Cannot serialize in the middle of a type definition"), function VisitTagType, file ASTWriter.cpp, line 277.
libclang: crash detected during reparsing
Assertion failed: (OutputFiles.empty() && "Still output files in flight?"), function ~CompilerInstance, file CompilerInstance.cpp, line 62.
Abort trap: 6

Any thoughts or help is appreciated. Thanks.

[Sarcasm]

@DanSchoppe: for now I don't think it's the same issue, let us continue here: #191

[fehmud]

Thanks for sharing this package. My understanding is that irony-cdb-autosetup-compile-options is not available in Irony 0.1.2, the stable version of Irony. I am writing this to let other newcomers know.

[Sarcasm]

I'm closing this issue.

@egarrulo you are right, the compilation database stuff isn't ready yet to have a proper release, I need to rework it.