[engine] Optionally inline inlineable Nodes
Review Request #3931 — Created May 24, 2016 and submitted — Latest diff uploaded
|jsirois, kwlzn, nhoward_tw, wisechengyi|
This review adds support for inlining execution of Nodes, which skips storing them in the ProductGraph between execution, or involving them in the scheduling loop. The attached viz shows that only
FilesystemNode(and a root
DependenciesNode) are still stored in the ProductGraph... other nodes have been inlined.
It has fairly nice implications for performance... with caching disabled, cold
./pants list ::with the daemon is down to ~8 seconds on my machine, which puts it at around 5x of cold without the daemon. It also makes the remaining hotspots in the profiles significantly more obvious.
- Remove the
step(.., dependencies)argument by hiding it behind
Node.is_inlineable, to indicate that a Node runs cheaply enough to not be worth memoizing in the ProductGraph.
- Optionally inline inlineable dependencies in StepContext.
- Move the
Nodefactory to StepContext, which eliminates some unnecesary cross-module imports.
- Switch legacy.graph to consuming the addresses of the root LegacyTarget nodes, and back to
maybe_list(yep... sorry Yi).
ProductGraph.trace, and use it to log stacktraces.
- Lazily format
Noopmessages, since they are rarely used.
- Render cyclic/rejected dependencies as dotted lines in