[GitHub] Workflow runs with in_progress status are skipped and not collected after completion

[vasukiiyengar98]

Hi DevLake team,

We are using Apache DevLake v1.0.2 with the GitHub plugin to collect GitHub Actions workflow runs.

Our DevLake deployment is running on AWS ECS. We have created the required ECS containers/services using the official Apache DevLake Docker images.

We have some GitHub Actions workflows that run for several hours. During the "Collect Workflow Runs" task, DevLake logs messages like:

Skipping run{id: 3372***, number: 1158***} with status in_progress
Skipping run{id: 3372***, number: 303***} with status in_progress

Our concern is that these workflow runs are skipped while they are still in_progress.

Later, when the GitHub Actions workflow finishes and its status changes to completed, a subsequent incremental sync does not appear to collect or update the previously skipped workflow run.

Our expected behavior is:

1. Detect the workflow run while it is in_progress.
2. Keep it as an unfinished/in-progress run.
3. Re-check the run during subsequent syncs.
4. Once GitHub reports the run as completed, update the existing workflow run record.

Could you please confirm:

• Is this expected behavior in DevLake v1.0.2?
• Is there any configuration that makes DevLake re-check in_progress workflow runs during later syncs?
• Has this behavior been fixed or changed in a newer DevLake version?
• If not, what is the recommended approach for handling long-running GitHub Actions workflows?

Since our DevLake deployment is running on AWS ECS using the official DevLake Docker images, we would prefer to use a supported configuration or upgrade rather than maintain a custom DevLake code/image if possible.

Any guidance on the recommended approach would be greatly appreciated.

Thanks!

[tomm1990]

In backend/plugins/github/tasks/cicd_run_collector.go (tag v1.0.2) Collect Workflow Runs only keeps runs with status == "completed". Anything else (including in_progress) is logged as Skipping run{id: ..., number: ...} with status ... and discarded. Nothing is written for those IDs, so a later sync cannot “update the existing unfinished record.”

that skip is expected in v1.0.2, and there is no toggle to “keep in_progress and update later.”

Worse for multi-hour Actions: that collector is finalizable on created_at. Incremental sync advances since from collected completed runs. A long run that was skipped while in progress still has the old created_at. Once since moves past that timestamp, a later completed sync may never walk back far enough to see it again. That matches what you are seeing.

Current main still filters to completed only (it got quieter about the skip log and uses created=from..to windows). So upgrading the official image alone does not give you “store in_progress then patch on completion.”

Practical options without a custom image:

1. After long workflows finish (or on a schedule), run a full sync (or a collect with timeAfter / time range that covers those runs’ created_at), so the completed rows are listed again.
2. Keep incremental for day-to-day, and treat full/backfill sync as the safety net for hour-scale jobs.
3. If you need true in-progress tracking, that is a product change (persist non-completed + refresh by id/updated_at). Worth an issue against apache/devlake with your ECS image tag and the skip log lines.

If you can paste one skipped run id and whether a full sync afterward creates the _tool_github_runs row, that confirms the created_at window miss vs a different filter problem.

[tomm1990]

@vasukiiyengar98 you are right that there is no Config UI toggle for a recurring full/backfill sync. The cron you set (0 */2 * * *) always runs Collect Data (Default) = incremental. that is why a 2h schedule alone cannot recover a 3-4h run that was skipped while in_progress.

here is how to do the workaround on stock v1.0.2 (Config UI + API):

1. Time Filter (timeAfter) - blueprint Sync Policy

In Config UI: open the project / blueprint → Sync Policy (or edit policy).

• Time Filter is the blueprint timeAfter field (docs call it Time Filter).
• set it far enough back that a full refresh can still see those runs’ created_at (for 3-4h jobs, use at least several days, e.g. last 7 days / last month - not “today only”).

that bound applies to both default collect and full refresh. it does not by itself make incremental re-walk past the collector’s stored since.

2. One-shot full refresh from the UI

On the same blueprint detail page, use the collect control (not the cron):

• Collect Data = incremental (same as your schedule)
• Collect Data in Full Refresh Mode = delete/re-collect inside the Time Filter window (fullSync: true)

run Full Refresh Mode after a long workflow finishes (or on a schedule you own). that is the UI path that re-lists completed Actions runs whose created_at would otherwise sit behind incremental since.

3. Recurring full refresh via API (recommended on ECS)

Config UI has no “full sync every N hours” cron. trigger it yourself against the lake API:

curl -X POST "http://<devlake-api-host>/blueprints/<blueprintId>/trigger" \
  -H "Content-Type: application/json" \
  -d '{"skipCollectors": false, "fullSync": true}'

wire that to EventBridge / a small ECS scheduled task (e.g. every 6h or daily). keep your existing 2h blueprint cron for normal incremental, and use this as the safety net for hour-scale Actions.

blueprintId is in the Config UI URL / blueprint detail; API host is your DevLake API service (same network as Config UI).

4. Future version / planned fix

there is still no public release or roadmap item I can point to that will store in_progress and update on completion. I cannot honestly name a future version for that. filing an issue on apache/devlake (GitHub plugin, image tag v1.0.2, skip log lines, one run id missed by incremental but present after full refresh) is the path to get it on the official backlog.

practical combo for your 3-4h prod workflows: keep 0 */2 * * * + set Time Filter ≥ several days + schedule fullSync: true triggers after those jobs (or on a fixed cadence).

[vasukiiyengar98]

@tomm1990 , Thanks a lot for your detailed explanation and for taking the time to look into this. I really appreciate your help.
I’ll go through the steps and test the workaround on our setup. If I face any issues or have any questions while testing, I’ll update them here. Thanks again for your support!

[tomm1990]

@vasukiiyengar98 sounds good - once Full Refresh Mode / the fullSync: true trigger picks up a previously skipped run, please mark an answer on this thread so the next ECS + long Actions setup finds it. if something still misses after that, paste the run id + whether _tool_github_runs got the row and we can dig from there.

[vasukiiyengar98]

Hi @tomm1990, I tested the Full Refresh approach with the Time Filter set to 1 month. manually running the workflow

Our current DevLake version is v1.0.2.

The Full Refresh completed successfully, but after the refresh I noticed that a significant amount of data that was previously visible in our Grafana dashboard is now missing. I compared the dashboard before and after the Full Refresh, and the difference is quite noticeable.

I also checked the GitHub collector logs, and the Full Refresh is still skipping multiple workflow runs with in_progress status.

So it looks like the Full Refresh is re-collecting the data within the Time Filter, but it is still skipping in_progress runs, and it also doesn't seem to restore all of the data we previously had.

Could you please help me understand what might be happening here? Is there anything else I should check in the Time Filter or Full Refresh configuration before we proceed further?

Also, since we are currently using v1.0.2, is there any newer DevLake version that has resolved or improved this type of GitHub Actions workflow-run issue? If so, could you please let me know which version you recommend? I can test the newer version in our environment before going further with the workaround.

Thanks again for your help and for taking the time to look into this.

[klesh]

I don't recall this issue was fixed in newer version.