Commit 2c7ec20
committed
docs: correct dynamic batching visualization and timings
Updated diagram PNGs to accurately reflect dynamic batching
behavior. Inference triggers immediately upon reaching
'max_batch_size', rather then waiting for the timeout
Ajusted launching time in the README to match the corrected
visual flow.1 parent 4fe2b90 commit 2c7ec20
3 files changed
Lines changed: 1 addition & 1 deletion
File tree
- Conceptual_Guide/Part_2-improving_resource_utilization
- img
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
79 | 79 | | |
80 | 80 | | |
81 | 81 | | |
82 | | - | |
| 82 | + | |
83 | 83 | | |
84 | 84 | | |
85 | 85 | | |
| |||
0 commit comments