Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Modern Computer Architecture and Organization
  • Table Of Contents Toc
Modern Computer Architecture and Organization

Modern Computer Architecture and Organization - Third Edition

By : Jim Ledin
5 (1)
close
close
Modern Computer Architecture and Organization

Modern Computer Architecture and Organization

5 (1)
By: Jim Ledin

Overview of this book

Computer architecture now extends far beyond CPUs, forming the foundation of cloud platforms, AI systems, cybersecurity solutions, and emerging computing technologies. Modern Computer Architecture and Organization, Third Edition, provides a clear, end-to-end understanding of how today’s computer systems are built and why architectural decisions matter more than ever. You’ll begin with the fundamentals of digital logic, processor elements, memory systems, and the hardware–software interface, building a strong grounding that remains essential for every architect and systems engineer. Next, the book explores modern processor and memory architectures, performance-enhancing techniques, virtualization, and mainstream instruction sets, including x86, ARM, and an in-depth treatment of RISC-V. New and significantly expanded chapters extend this foundation into modern computing domains, including AI and large language model (LLM) computing platforms, GPUs, cloud-scale systems, confidential and security-focused architectures, blockchain and Bitcoin mining systems, self-driving vehicle architectures, and future directions such as quantum computing. This edition reflects today’s AI-driven, cloud-centric, security-aware computing landscape while remaining true to the classical principles that continue to underpin modern computer systems.
Table of Contents (28 chapters)
close
close
Lock Free Chapter
1
Part 1: Fundamentals of Computer Architecture
8
Part 2: Processor Architectures and Instruction Sets
15
Part 3: Computer System Architectures
23
Part 4: Appendices
27
Index

LLM computer architecture

As a first step toward understanding the design of a computing system for LLM processing, we must identify the key drivers of LLM computing requirements.

When performing inference with GPT-2, most of the floating-point operations, ranging from 80 to 95% of the total, occur in matrix multiplications. These operations are concentrated at the following points:

  • Computing the attention B34347_15_049.png, B34347_15_050.png, and B34347_15_051.png matrices
  • The multiplication of the B34347_15_052.png matrix by the linear projection matrix B34347_15_053.png at the attention block output
  • The two dense matrix multiplications in the MLP

We will work through an example to estimate the number of multiplication operations performed by GPT-2. If we assume the maximum context length, the input to each transformer block is a 1,024 x 768 matrix. This matrix is multiplied by the 768 x 768 matrix B34347_15_054.png to produce the 1,024 x 768 B34347_15_055.png matrix. The number of elements inB34347_15_056.png is 786,432 (1,024 multiplied by 768). Computing each element of B34347_15_057.png involves multiplying each of the 768 elements...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Modern Computer Architecture and Organization
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon