Follow

哈哈,石墨的公式精度问题当时是我处理的😆虽然有些tricky,但15位精度下没有再发现问题了😄当时测试发现精度选择17位及以上就不好处理了,我想Excel选择15位精度也是这个原因吧~具体原理还是研究下IEEE754 twitter.com/luinlee/status/127 twitter.com/shhider/status/127

t.me/private_channel_c14370a/4

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.