Follow
An exploration of the effect of quantisation on energy consumption and inference time of StarCoder2 https://arxiv.org/abs/2411.12758 #cs.CL #cs.AI #cs.SE
An exploration of the effect of quantisation on energy consumption and inference time of StarCoder2 https://arxiv.org/abs/2411.12758 #cs.CL #cs.AI #cs.SE