Environment: TensorRT-LLM version: v1.0.0rc1 Hardware: H20-96G and IB network Description: I conducted experiments with PD deployment using DeepSeek-R1, and observed that the prefill node occasionally ...

There's a memory leak occurring when creating an inference session using the runtime in Node. Each time a new session is created and released, the memory usage grows a little. We're running inference ...

The nonlinear response of an optical microresonator is used in a time multiplexed reservoir computing neural network. Within a virtual node approach combined with an offline training through ridge ...