You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Only use a single runtime for the entire system. This would have us define a single Tokio runtime that is shared between IO and DataFusion. This does not seem like a good idea, since CPU intensive work during query planning could stall other parts of the system handling IO, e.g., serving API requests.
For now, we can roll with the two runtimes, and experiment with different configurations to see what works best.
Problem statement
Currently, the main Tokio runtime and Data fusion runtime are configured via code imported from
influxdb3_core
, i.e., IOx, and which are defined here.The former is not actually being used, i.e., the main Tokio runtime in
influxdb3
is currently using default settings, and cannot be configured.As part of #25646, we should add a set of clap blocks to
influxdb3
to enable configuration of these runtimes. This will:IOX
in the CLI docs defined in there (see Remove references to IOx in codebase #25662).Proposed solution
influxdb3_clap_blocks
cratetokio
configurations frominfluxdb3_core
, replacing references toIOX
withINFLUXDB3
Alternatives considered
Only use a single runtime for the entire system. This would have us define a single Tokio runtime that is shared between IO and DataFusion. This does not seem like a good idea, since CPU intensive work during query planning could stall other parts of the system handling IO, e.g., serving API requests.
For now, we can roll with the two runtimes, and experiment with different configurations to see what works best.
Additional context
The text was updated successfully, but these errors were encountered: