Hugging Face's logo
Sk md saad amin's picture
Open to Collab
44 4 53

Sk md saad amin

Reality123b
ducla's profile picture SarawinKumar's profile picture arady7's profile picture
·

AI & ML interests

None yet

Recent Activity

replied to Janady07's post about 3 hours ago
Here is one of the equations that make up the worlds first Artificial General Intelligence. Remember when building Artificial Intelligence or anything on a device it all starts out binary. Everything starts out with data flow physics and mathmatics
updated a Space about 6 hours ago
lap-quantum/README
reacted to mrs83's post with 🔥 1 day ago
In 2017, my RNNs were babbling. Today, they are hallucinating beautifully. 10 years ago, getting an LSTM to output coherent English was a struggle. 10 years later, after a "cure" based on FineWeb-EDU and a custom synthetic mix for causal conversation, the results are fascinating. We trained this on ~10B tokens on a single AMD GPU (ROCm). It is not a Transformer: Echo-DSRN (400M) is a novel recurrent architecture inspired by Hymba, RWKV, and xLSTM, designed to challenge the "Attention is All You Need" monopoly on the Edge. The ambitious goal is to build a small instruct model with RAG and tool usage capabilities (https://huggingface.co/ethicalabs/Kurtis-EON1) 📊 The Benchmarks (Size: 400M) For a model this size (trained on <10B tokens), the specialized performance is surprising: *SciQ*: 73.8% 🦄 (This rivals billion-parameter models in pure fact retrieval). *PIQA*: 62.3% (Solid physical intuition for a sub-1B model). The Reality Check: HellaSwag (29.3%) and Winogrande (50.2%) show the limits of 400M parameters and 10B tokens training. We are hitting the "Reasoning Wall" which confirms we need to scale to (hopefully) unlock deeper common sense. As you can see in the visualization (to be released soon on HF), the FineWeb-EDU bias is strong. The model is convinced it is in a classroom ("In this course, we explore..."). The Instruct Model is not ready yet and we are currently using curriculum learning to test model plasticity. Source code and weights will not be released yet. This is not a fork or a fine-tune: the base model is built in-house at https://www.ethicalabs.ai/, with novel components that do not exist in current open libraries. 🤝 Call for Collaboration: I am looking for Peer Reviewers interested in recurrent/hybrid architectures. If you want to explore what lies beyond Transformers, let’s connect! Training diary: https://huggingface.co/ethicalabs/Kurtis-EON1
View all activity

Organizations

Blog-explorers's profile picture Samanvay AI's profile picture Lap's profile picture lap's profile picture None yet's profile picture Hugging Face MCP Course's profile picture lorafrenzi's profile picture Hugging Science's profile picture Lap Quantum 's profile picture 25daysofagents's profile picture DataMuncher Labs's profile picture Org for people testing QPU-1's profile picture