Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inflated workflow execution graph leads to increase resource consumption and delays #122

Closed
m4dcoder opened this issue Jan 29, 2019 · 0 comments

Comments

@m4dcoder
Copy link
Collaborator

Given the workflow definition at https://github.com/StackStorm/st2ci/blob/86655cb71ae0a1ff813b4bd0828399b54206e146/actions/workflows/st2_pkg_e2e_test.yaml, orquesta converts this workflow into an execution graph for runtime. Due to the number of conditional jumps, multiple references to common tasks, and common tasks having many steps, this leads to an inflated execution graph. This results in very high CPU and memory usage and long delayed when the conductor tries to load the workflow definition. The resource consumption and delay are likely occurring where the conductor is trying to identify start tasks for the graph.

@m4dcoder m4dcoder changed the title Inflated workflow execution graph leads to increase CPU and memory consumption Inflated workflow execution graph leads to increase resource consumption and delays Jan 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant