Hugging Face's logo
The Supreme GGUF-SafeTensors Guy's picture
šŸ¤ Open to Collab

The Supreme GGUF-SafeTensors Guy

GGUFGuy
hugging-science
122 16 41
cmjskp5's profile picture mohkarage-7's profile picture hardhant's profile picture
Ā·

AI & ML interests

I like llms

Recent Activity

new activity about 4 hours ago
Compactbot/model-requests:New model request: ram-18m
repliedto DedeProGames's post 1 day ago
how is this possible
repliedto SeaWolf-AI's post 1 day ago
šŸ’» Data-center AI, now on a laptop: POCKET-Darwin-180B We're releasing a 4-bit GGUF build of Darwin-180B-RSI, #1 on seven official Hugging Face leaderboards (self-reported), that runs without a GPU. šŸ“¦ 360 GB ā†’ 111 GB (4-bit GGUF, 4 files) šŸ–„ļø No GPU: one server CPU (16 threads) at 18.4ā€“21.0 tokens/s šŸ’» RTX 5060 laptop (8 GB VRAM) + 32 GB RAM: 4.17 tokens/s šŸ§Š 128 GB mini PC: whole model in memory, no GPU needed šŸŽÆ MMLU-Pro, 2,000 questions, paired: original 87.65% = 4-bit 87.65% How? Ā· Only ~3B of 180B parameters are active per token (10 of 512 experts) Ā· llama.cpp streams just the needed experts from SSD, so 32 GB RAM is enough Ā· Graft quantization: we took the proven Unsloth UD-Q4_K_XL base build and swapped in only the 300 tensors our RSI training changed (300/300 verified) Under the hood is Model-level Recursive Self-Improvement. The model solves verifiable problems, keeps only its own solutions that check out as correct, and trains on them. No human-written solutions or reasoning traces. Built for teams that can't send data to an external cloud (defense, finance, public sector) to run a top-tier model fully offline. šŸ“ Article: https://huggingface.co/blog/FINAL-Bench/data-center-ai-now-on-a-laptop-pocket-darwin-180b šŸ¤— Model: https://huggingface.co/FINAL-Bench/POCKET-Darwin-180B-GGUF šŸ§¬ Original: https://huggingface.co/FINAL-Bench/Darwin-180B-RSI #Darwin #RSI #GGUF #llamacpp #OnDevice #MoE
View all activity

Organizations

Gradio-Blocks-Party's profile picture MLX Community's profile picture Hugging Face Discord Community's profile picture ONNX Community's profile picture None yet's profile picture open/ acc's profile picture LiteRT Community (FKA TFLite)'s profile picture Doge Face's profile picture Smilyai labs's profile picture Hugging Face Context Course's profile picture Join Secret x Hugging Face's profile picture Hugging Science's profile picture MCP-1st-Birthday's profile picture Test Organization Please Ignore's profile picture Unsloth Jobs Explorers's profile picture BananaMind Model Previewers's profile picture The Ultimate Testing Organization's profile picture AppleMind Archive's profile picture Smilyai-labs-beta-testers's profile picture BananaMind Research Community's profile picture the idiots's profile picture Small Language Model Consortium's profile picture Novi AI's profile picture Smilyai Project Prism's profile picture Refract AI Labs's profile picture Open SLM Archive's profile picture Test's profile picture