Published onDecember 18, 2024Scaling Laws for LLM PretrainingaillmclassicalA comparison of Scaling Laws for LLM Pretraining, from Kaplan, to Chinchilla, the Chinchilla Trap, covering compute-optimal training and inference.
Published onNovember 15, 2024Generating Synthetic Data for LLM Post-TrainingaillmclassicalAn overview of the motivations and techniques used for generating synthetic data for LLM post-training, as seen in the Llama 3.1, AFM, Qwen2 and Hunyuan-Large papers.
Published onOctober 20, 2024Scaling LLM Test Time ComputeaillmclassicalAn overview of recent research on scaling test-time compute in large language models (LLMs) including CoT, STaR, ReST, RISE, ORMs, PRMs and more.
Published onSeptember 3, 2024Running Deutsch's Algorithm on a Real Quantum ComputerquantumcodeLearn how to implement Deutsch's algorithm in Qiskit and run it on a real quantum computer in the IBM cloud.
Published onAugust 18, 2024Benchmarking Python and Rust web serverspythonrustcodeclassicalComparing the performance of a simple web server implemented in Python (FastAPI & SQLAlchemy) and Rust (Rocket, Axum and Diesel).
