Subscribe
Sign in
Home
Notes
Archive
About
Nvidia GPUs: Powering the Future of AI with the H100 and the upcoming B200
Exploring the Nvidia H100 and the soon to be released B200 GPU, their SXM form factors, and the specialized servers driving AI innovation.
Mar 6
•
Grok Mountain
1
1
Latest
Top
Discussions
Trump's Bargaining Chip: How AI GPUs Could Lead to Peace with Putin
Could AI GPUs be Trump’s key to peace with Putin? This theory explores how tech might stabilize Ukraine, end conflict, and shift global alliances.
Mar 4
•
Grok Mountain
Why Grok 10 Will Rely on Reinforcement Learning for 90% of Its Training
Following the trends of plateauing world knowledge and larger and larger AI data centers, it stands to reason that the future of AI model training will…
Mar 2
•
Grok Mountain
The Singularity Unveiled: A Leap Beyond Humanity and the Chips That Could Take Us There
Exploring the possibility of super-intelligent AI breaking through the plateau of Moore's Law by designing the next generation of microchips.
Feb 26
•
Grok Mountain
1
Inside the Colossus: How NVIDIA and xAI Teamed Up to Build a Supercomputer for Grok 3
NVIDIA provides technology beyond GPUs. In building Colossus, xAI partnered with NVIDIA to utilize their high-end networking and software solutions to…
Feb 26
•
Grok Mountain
The AI Arms Race: U.S., China, and the Path to Grok 3
History of the AI arms race, where control of Nvidia's H100 chips plays a major role in giving the US an advantage over China.
Feb 25
•
Grok Mountain
Origin of Grok 3 - the Colossus Data Center in Memphis
How Musk leapfrogged the LLM competition by procuring 200,000 NVIDIA H100 GPUs and building a cutting edge data center in Memphis
Feb 20
•
Grok Mountain
Understanding the Context Window: A Train Station Analogy
How training data must be broken into sequences of tokens, adhering to the size of the context window. These sequences are then processed in batches…
Feb 15
•
Grok Mountain
See all
Grok Mountain’s Substack
Grok model training and fine tuning.
Subscribe
Grok Mountain’s Substack
Subscribe
About
Archive
Sitemap
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts