sanitation@lemmy.today to Programmer Humor@programming.dev · 3 days agoNew compression techniquelemmy.todayimagemessage-square160linkfedilinkarrow-up11.2Karrow-down116file-text
arrow-up11.18Karrow-down1imageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 3 days agomessage-square160linkfedilinkfile-text
minus-squareMikina@programming.devlinkfedilinkarrow-up16arrow-down2·edit-23 days agoIs it a compression when you need presumably gigabites of a model to reconstruct the data? It’s basically the same as saying I can shatter compressions records by hashing the thing and using a rainbow table to decompress it.
minus-squareryannathans@aussie.zonelinkfedilinkarrow-up8·3 days agoA roughly 340MB model at fp16 is all it takes to beat xz and zstd by 2x compression on text
Is it a compression when you need presumably gigabites of a model to reconstruct the data?
It’s basically the same as saying I can shatter compressions records by hashing the thing and using a rainbow table to decompress it.
A roughly 340MB model at fp16 is all it takes to beat xz and zstd by 2x compression on text