[Python] Tracking the status of python script execution

That's a bit tricky. More useful would probably be to explicitly
pepper your code with calls to some "still active" function, but it's
going to be nearly impossible to get any sort of viable percent-done
based on lines of code. There might be one primary loop that takes 80%
of the execution time or more.


You mention SQL queries. Can you wrap up the query handler in
something that effectively treats _those_ as your fundamental
divisions of "job-done-ness"? I'm not sure how (in either case,
actually) you'd automatically figure out how many there are to do
(either lines or queries), so you may still have to have something
externally count them up - which would still not work if there's a
loop, though with queries it's less sane to have a loop executing them
than lines of code.


ChrisA

Long ago, I saw a C program that took another C program as input. It would
output a copy of the original C program, interspersed with fprintf's that
would display the text of the line current being executed.


You might write something similar for Python, perhaps outputting the line
being executed and/or the line number. You could have it open a file in
/tmp or something.

Using sys.settrace, you could write a tool to track the lines being
executed in any Python program. But your problem is different than that
in two ways:


1) You don't need to track any Python program, you need to track your
particular Python program.


2) You want the output to take into account the "total number of lines",
which means you have to somehow configure it ahead of time.


Both of these factors point to using a more specialized approach, by way
of modifying your program. I like Chris' idea of simply tracking the
progress of the SQL queries since they are taking the time.