Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

I combine training compute and GPU price-performance data to estimate the cost of compute in US dollars for the final training run of 124 machine learning systems published between 2009 and 2022, and find that the cost has grown by approximately 0.5 orders of magnitude per year.

Compute Trends Across Three eras of Machine Learning — LessWrong

JRFM, Free Full-Text

The Best GPUs for Deep Learning in 2023 — An In-depth Analysis

Deep Learning Trading and Hedge Funds

Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

Estimating 🌴PaLM's training cost

Large Language Models: A New Moore's Law?

Epoch vs Batch Size vs Iterations, by SAGAR SHARMA

Gradient Descent Optimization in Deep Learning Model Training

Computational Power and AI - AI Now Institute