Analysis stuck at a single query for a long time

[kakashiUc]

I am analyzing a collection of Python files using python-lgtm-full.qls codeql suite. The collection has around 74749 files within various directories. The analysis is stuck at the first query for around a day now. Is this normal? How to resolve this?

[hmakholm]

75k files is rather large, but taking more than a day for the analysis still doesn't sound right.

Is the analysis process using CPU? Does it keep writing to its log file -- usually <database_directory>/log/execute-queries-<timestamp>.log? Can you show the last several dozen lines of the log?

EDIT [adityasharad]: marking #5759 (reply in thread) as the answer.

[kakashiUc]

@RasmusWL @hmakholm I am using Codeql cli, and I using this release: -
https://github.com/github/codeql-cli-binaries/releases/tag/v2.5.0
And I used this command to analyze the database: -

codeql database analyze <database> <queries> --format=<format> --output=<output>

I am using tutorial from here to create and analyze database.

[RasmusWL]

Hi @kakashiUc, thanks for that additional info. Version 2.5.0 should be all good 👍

However, I still need to know what version of the CodeQL queries you are using. That is, what commit SHA do you have https://github.com/github/codeql checked out from? (that checkout folder should contain whatever it is you specified for <queries>).

[kakashiUc]

@RasmusWL The commit id for this repository, which I used is

4cf0b8e725d01210da5a045df67802865f166f62

[RasmusWL]

Thanks @kakashiUc, can you try and see if it reproduces with 310baab73f933dec72d9b915e6b3b09ec86ed4db? (which is the most recent commit to main as of writing) We've recently made some improvements to the performance of our Python queries, which might solve this problem 😊

[kakashiUc]

@RasmusWL Sure I'll let you know