Bro WTF i don't even have credits for Jobs because it rejects prepaid
🤝 Open to Collab
The Supreme GGUF-SafeTensors Guy
GGUFGuy
AI & ML interests
I like llms
Recent Activity
repliedto DedeProGames's post about 7 hours ago
how is this possible repliedto SeaWolf-AI's post about 8 hours ago
💻 Data-center AI, now on a laptop: POCKET-Darwin-180B
We're releasing a 4-bit GGUF build of Darwin-180B-RSI, #1 on seven official Hugging Face leaderboards (self-reported), that runs without a GPU.
📦 360 GB → 111 GB (4-bit GGUF, 4 files)
🖥️ No GPU: one server CPU (16 threads) at 18.4–21.0 tokens/s
💻 RTX 5060 laptop (8 GB VRAM) + 32 GB RAM: 4.17 tokens/s
🧊 128 GB mini PC: whole model in memory, no GPU needed
🎯 MMLU-Pro, 2,000 questions, paired: original 87.65% = 4-bit 87.65%
How?
· Only ~3B of 180B parameters are active per token (10 of 512 experts)
· llama.cpp streams just the needed experts from SSD, so 32 GB RAM is enough
· Graft quantization: we took the proven Unsloth UD-Q4_K_XL base build and swapped in only the 300 tensors our RSI training changed (300/300 verified)
Under the hood is Model-level Recursive Self-Improvement. The model solves verifiable problems, keeps only its own solutions that check out as correct, and trains on them. No human-written solutions or reasoning traces.
Built for teams that can't send data to an external cloud (defense, finance, public sector) to run a top-tier model fully offline.
📝 Article: https://huggingface.co/blog/FINAL-Bench/data-center-ai-now-on-a-laptop-pocket-darwin-180b
🤗 Model: https://huggingface.co/FINAL-Bench/POCKET-Darwin-180B-GGUF
🧬 Original: https://huggingface.co/FINAL-Bench/Darwin-180B-RSI
#Darwin #RSI #GGUF #llamacpp #OnDevice #MoE updated a model 1 day ago
Novi-AI/Novi-Pico-BaseOrganizations
replied to DedeProGames's post about 7 hours ago
replied to SeaWolf-AI's post about 8 hours ago
FSCK YOU MEAN "POCKET"??? CAN'T EVEN FIT ON ALL OF MY COMPUTERS COMBINED
reacted to NitrAI's post with ❤️ 4 days ago
Post
1852
My (really ugly) thoughts on NVIDIA acquiring Hugging Face
I don’t care if you love me or hate me – something about one of the most open community efforts ever to achieve the tagline “The community building the future“ getting gobbled up by a company that arguably is the biggest hardware monopoly that has ever existed strikes me as deeply unsettling. I don’t like monopolies, and that is that. The whole appeal of HF for me personally was always having a neutral location where anyone could develop, deploy, and test a model on their silicon of choice without being pushed into a single “official“ proprietary infrastructure stack.
I am not going to pretend that I would believe NVIDIA “open and independent“ is ever going to happen – hell we have all heard the same lines dozens of times from every corporation that has ever uttered them before.
When the single biggest producer of compute also is one of the primary locations where all open weights live, it becomes very hard not to imagine where all of this is going to end up soon enough if we continue to let companies dictate the narrative. It might be the hyperbole but it is an absolute truth for me – open-sourced AI cannot be a slave to the whims of a trillion dollar company. It is high time we realize that open AI cannot live and breathe only on the goodwill of corporate entities.
I don’t care if you love me or hate me – something about one of the most open community efforts ever to achieve the tagline “The community building the future“ getting gobbled up by a company that arguably is the biggest hardware monopoly that has ever existed strikes me as deeply unsettling. I don’t like monopolies, and that is that. The whole appeal of HF for me personally was always having a neutral location where anyone could develop, deploy, and test a model on their silicon of choice without being pushed into a single “official“ proprietary infrastructure stack.
I am not going to pretend that I would believe NVIDIA “open and independent“ is ever going to happen – hell we have all heard the same lines dozens of times from every corporation that has ever uttered them before.
When the single biggest producer of compute also is one of the primary locations where all open weights live, it becomes very hard not to imagine where all of this is going to end up soon enough if we continue to let companies dictate the narrative. It might be the hyperbole but it is an absolute truth for me – open-sourced AI cannot be a slave to the whims of a trillion dollar company. It is high time we realize that open AI cannot live and breathe only on the goodwill of corporate entities.
- 11 replies
replied to Banaxi-Tech's post 5 days ago
Just downloaded!
replied to Datdanboi25's post 6 days ago
me three
reacted to Banaxi-Tech's post with 🤯😔🤝👍🧠➕😎🤗❤️👀🚀🔥 7 days ago
Post
4857
We're excited to release BananaAll, our SLM Super App.
It allows you to do EVERYTHING you need to do to trains SLMs in a single app, no terminal, no 30 chrome tabs.
The train tab allows you to train models, select datasets from presets, and use other ones with auto mapping, model size slider, it automatically generates a training script for you.
Then after you've trained the model or want to compare it to competitors, the evaluation tab, run ARC EASY, ARC Challenge, Hellaswag, PIQA, Arithmark 3, BananaMind Base Bench and more! Simple Results screen.
And lastly the inference tab, run your trained models or others.
Normally you would need seperate apps or scripts for that, but the BananaAll Super App lets you do all of that in a single app.
We also trained a small 2.5M parameter model on 200M tokens of Fineweb edu, The results: BananaMind Base Bench 854 and 53% on PIQA. On only 200M tokens.
Check it out at https://github.com/BananaMind/BananaAll.
It allows you to do EVERYTHING you need to do to trains SLMs in a single app, no terminal, no 30 chrome tabs.
The train tab allows you to train models, select datasets from presets, and use other ones with auto mapping, model size slider, it automatically generates a training script for you.
Then after you've trained the model or want to compare it to competitors, the evaluation tab, run ARC EASY, ARC Challenge, Hellaswag, PIQA, Arithmark 3, BananaMind Base Bench and more! Simple Results screen.
And lastly the inference tab, run your trained models or others.
Normally you would need seperate apps or scripts for that, but the BananaAll Super App lets you do all of that in a single app.
We also trained a small 2.5M parameter model on 200M tokens of Fineweb edu, The results: BananaMind Base Bench 854 and 53% on PIQA. On only 200M tokens.
Check it out at https://github.com/BananaMind/BananaAll.
- 25 replies
replied to Banaxi-Tech's post 7 days ago
Also please make a colab/molab script for it
replied to Banaxi-Tech's post 7 days ago
It finally happened. The SLM frontier advances BIG today.
replied to Banaxi-Tech's post 8 days ago
Id like to see it but not sure if I want to give out my full legal name haha
I agree, same with the date of birth