enable workers to poll only to specific workflow tasks

Is your feature request related to a problem? Please describe.

I am planning to have workers processes to register specific workflows based on service configuration (e.g. environment variables).

This would allow configuring pools of workers dedicated to specific workflows

For example:

one worker pool could be dedicated to a single critical workflow with high throughput and long running steps
another worker pool could handle the remaining, less frequent and not so critical, short workflows

Describe the solution you'd like

By default the worker should only poll workflows from the backend that match the task names defined on the instance.

Describe alternatives you've considered

The namespaceId could be abused for this, but it would not feel right and is very limited.

Additional context

none

Agreed.

Some prior art:

Absurd uses the queue nomenclature where OW uses namespaceId which feels a bit more explicit: https://github.com/earendil-works/absurd

Inngest uses environments with the env config key.

Switching from namespace (vague) to a combination of env and queue could be an option?

Navigation Menu