[Question][sonar] sonar plugin can only collect a small percentage of the configured project data

[blackholll]

Question

I configured a project and select about 900 sonar project as connections. then run the collection task, after task finish, there is only several sonar project's issue data.
I configured another devlake project with one of the missing sonar project, then can collect the data successfully.

There is no error log in task log, and I found the table '_raw_sonnarqube_api_issues' has no related record for those missing projects.
I tried reduce the connection calling frequency from the default value 10000 to 3000, also can not get more result.
I also write a script calling the issue list api with the same sonar token hundreds of times, all success.

Screenshots

Additional context

[dosubot]

Hey @blackholll! I'm here to help you with any bugs, questions, or contributions. Let's get to the bottom of this together!

I found a similar closed issue that might be relevant to your situation: [Bug][SonarQube] failed to collect over 10000 data for issue](#4592). This issue was resolved by a pull request that addressed the problem by dividing the issues into smaller groups to avoid exceeding the SonarQube API's result limit of 10,000 issues ^[1].

The SonarQube plugin has certain limitations and configurations that might affect data collection for a large number of projects. Specifically, the plugin must divide issues into smaller groups based on "severity", "status", "type", "createdBefore", "createdAfter", and the file to which the issue belongs to manage within the API limits ^[2].

Additionally, the default setting for connection calling frequency is 10,000 requests per hour, which can be adjusted to change the collection speed ^[3]. However, reducing the frequency might not necessarily increase the amount of data collected if the issue is related to API limits or data classification.

If you haven't already, you might want to ensure that the issues are being classified and collected according to these parameters to see if it resolves the problem.

To continue talking to Dosu, mention @dosu.

[blackholll]

I am using v1.0.2-beta2
the projects' issue record all less than 10000
I already set the request frequency to 3000,