[Most Recent Entries] [Calendar View] [Friends View]
Sunday, June 4th, 2023
| Time | Event |
| 12:54a | The most ironic thing about LLMs LLMs know math really well, but fail to do basic arithmetics, even when the underlying token space allows doing "123"+"456" on the words embedding of "123" and "456", and if you unembed the result it will be "579". And even a transformer specifically trained to do addition is rather stupid. Although that could be due to using sin and cos for the coordinate system (that is a gimmick original paper suggested).   Current Mood:  amused |
| << Previous Day |
2023/06/04 [Calendar] |
Next Day >> |