Research
A paper is listed when one of its authors is affiliated with the lab. Data: OpenAlex.
Power Lines: Scaling laws for weight decay and batch size in LLM pre-trainingCerebras Systems · neural information processing systemsJan 1, 2025Demystifying Synthetic Data in LLM Pre-training: A Systematic Study of Scaling Laws, Benefits, and PitfallsCerebras Systems · Conference on Empirical Methods in Natural Language Processing (EMNLP)Jan 1, 2025MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language ModelsCerebras Systems · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)Jan 1, 2025