;fill-opacity:1'/%3e%3cpath%20fill='%23000'%20fill-rule='evenodd'%20d='M7.249%203.2c.469%200%20.85.38.85.85v3.893l1.873%201.874a.849.849%200%201%201-1.2%201.2L6.896%209.145A1.7%201.7%200%200%201%206.4%207.943V4.049c0-.469.38-.85.849-.85'%20clip-rule='evenodd'%20style='fill:%23000;fill-opacity:1'/%3e%3c/svg%3e)
;fill-opacity:1'/%3e%3c/svg%3e)
NVIDIA released a software update for the vLLM inference engine, improving performance for Jetson Thor with optimizations like FlashInfer support and Xformers integration.
Jetson Thor LLM Performance Gains - Up to 3.3x Faster!
Loading comments...
NVIDIA released a software update for the vLLM inference engine, improving performance for Jetson Thor with optimizations like FlashInfer support and Xformers integration.
;fill-opacity:1'/%3e%3cpath%20fill='%23fff'%20d='M30.21%2019.84A15.2%2015.2%200%200%200%2038.334%2028H30.21zM58.095%2028H49.97a15.2%2015.2%200%200%200%208.125-8.16zM38.335%200a15.2%2015.2%200%200%200-8.126%208.158V0zm19.76%208.158A15.2%2015.2%200%200%200%2049.97%200h8.125z'%20style='fill:%23fff;fill-opacity:1'/%3e%3c/svg%3e){kind=small}
