The Art of 64-Bit Assembly, Volume 1: x86-64 Machine Organization and Programming

Brief Contents
Contents in Detail
Foreword
Acknowledgments
Introduction
A Note About the Source Code in This Book
Part I: Machine Organization
Chapter 1: Hello, World of Assembly Language
1.1 What You’ll Need
1.2 Setting Up MASM on Your Machine
1.3 Setting Up a Text Editor on Your Machine
1.4 The Anatomy of a MASM Program
1.5 Running Your First MASM Program
1.6 Running Your First MASM/C++ Hybrid Program
1.7 An Introduction to the Intel x86-64 CPU Family
1.8 The Memory Subsystem
1.9 Declaring Memory Variables in MASM
1.9.1 Associating Memory Addresses with Variables
1.9.2 Associating Data Types with Variables
1.10 Declaring (Named) Constants in MASM
1.11 Some Basic Machine Instructions
1.11.1 The mov Instruction
1.11.2 Type Checking on Instruction Operands
1.11.3 The add and sub Instructions
1.11.4 The lea Instruction
1.11.5 The call and ret Instructions and MASM Procedures
1.12 Calling C/C++ Procedures
1.13 Hello, World!
1.14 Returning Function Results in Assembly Language
1.15 Automating the Build Process
1.16 Microsoft ABI Notes
1.16.1 Variable Size
1.16.2 Register Usage
1.16.3 Stack Alignment
1.17 For More Information
1.18 Test Yourself
Chapter 2: Computer Data Representation and Operations
2.1 Numbering Systems
2.1.1 A Review of the Decimal System
2.1.2 The Binary Numbering System
2.1.3 Binary Conventions
2.2 The Hexadecimal Numbering System
2.3 A Note About Numbers vs. Representation
2.4 Data Organization
2.4.1 Bits
2.4.2 Nibbles
2.4.3 Bytes
2.4.4 Words
2.4.5 Double Words
2.4.6 Quad Words and Octal Words
2.5 Logical Operations on Bits
2.5.1 The AND Operation
2.5.2 The OR Operation
2.5.3 The XOR Operation
2.5.4 The NOT Operation
2.6 Logical Operations on Binary Numbers and Bit Strings
2.7 Signed and Unsigned Numbers
2.8 Sign Extension and Zero Extension
2.9 Sign Contraction and Saturation
2.10 Brief Detour: An Introduction to Control Transfer Instructions
2.10.1 The jmp Instruction
2.10.2 The Conditional Jump Instructions
2.10.3 The cmp Instruction and Corresponding Conditional Jumps
2.10.4 Conditional Jump Synonyms
2.11 Shifts and Rotates
2.12 Bit Fields and Packed Data
2.13 IEEE Floating-Point Formats
2.13.1 Single-Precision Format
2.13.2 Double-Precision Format
2.13.3 Extended-Precision Format
2.13.4 Normalized Floating-Point Values
2.13.5 Non-Numeric Values
2.13.6 MASM Support for Floating-Point Values
2.14 Binary-Coded Decimal Representation
2.15 Characters
2.15.1 The ASCII Character Encoding
2.15.2 MASM Support for ASCII Characters
2.16 The Unicode Character Set
2.16.1 Unicode Code Points
2.16.2 Unicode Code Planes
2.16.3 Unicode Encodings
2.17 MASM Support for Unicode
2.18 For More Information
2.19 Test Yourself
Chapter 3: Memory Access and Organization
3.1 Runtime Memory Organization
3.1.1 The .code Section
3.1.2 The .data Section
3.1.3 The .const Section
3.1.4 The .data? Section
3.1.5 Organization of Declaration Sections Within Your Programs
3.1.6 Memory Access and 4K Memory Management Unit Pages
3.2 How MASM Allocates Memory for Variables
3.3 The Label Declaration
3.4 Little-Endian and Big-Endian Data Organization
3.5 Memory Access
3.6 MASM Support for Data Alignment
3.7 The x86-64 Addressing Modes
3.7.1 x86-64 Register Addressing Modes
3.7.2 x86-64 64-Bit Memory Addressing Modes
3.7.3 Large Address Unaware Applications
3.8 Address Expressions
3.9 The Stack Segment and the push and pop Instructions
3.9.1 The Basic push Instruction
3.9.2 The Basic pop Instruction
3.9.3 Preserving Registers with the push and pop Instructions
3.10 The Stack Is a LIFO Data Structure
3.11 Other push and pop Instructions
3.12 Removing Data from the Stack Without Popping It
3.13 Accessing Data You’ve Pushed onto the Stack Without Popping It
3.14 Microsoft ABI Notes
3.15 For More Information
3.16 Test Yourself
Chapter 4: Constants, Variables, and Data Types
4.1 The imul Instruction
4.2 The inc and dec Instructions
4.3 MASM Constant Declarations
4.3.1 Constant Expressions
4.3.2 this and $ Operators
4.3.3 Constant Expression Evaluation
4.4 The MASM typedef Statement
4.5 Type Coercion
4.6 Pointer Data Types
4.6.1 Using Pointers in Assembly Language
4.6.2 Declaring Pointers in MASM
4.6.3 Pointer Constants and Pointer Constant Expressions
4.6.4 Pointer Variables and Dynamic Memory Allocation
4.6.5 Common Pointer Problems
4.7 Composite Data Types
4.8 Character Strings
4.8.1 Zero-Terminated Strings
4.8.2 Length-Prefixed Strings
4.8.3 String Descriptors
4.8.4 Pointers to Strings
4.8.5 String Functions
4.9 Arrays
4.9.1 Declaring Arrays in Your MASM Programs
4.9.2 Accessing Elements of a Single-Dimensional Array
4.9.3 Sorting an Array of Values
4.10 Multidimensional Arrays
4.10.1 Row-Major Ordering
4.10.2 Column-Major Ordering
4.10.3 Allocating Storage for Multidimensional Arrays
4.10.4 Accessing Multidimensional Array Elements in Assembly Language
4.11 Records/Structs
4.11.1 MASM Struct Declarations
4.11.2 Accessing Record/Struct Fields
4.11.3 Nesting MASM Structs
4.11.4 Initializing Struct Fields
4.11.5 Arrays of Structs
4.11.6 Aligning Fields Within a Record
4.12 Unions
4.12.1 Anonymous Unions
4.12.2 Variant Types
4.13 Microsoft ABI Notes
4.14 For More Information
4.15 Test Yourself
Part II: Assembly Language Programming
Chapter 5: Procedures
5.1 Implementing Procedures
5.1.1 The call and ret Instructions
5.1.2 Labels in a Procedure
5.2 Saving the State of the Machine
5.3 Procedures and the Stack
5.3.1 Activation Records
5.3.2 The Assembly Language Standard Entry Sequence
5.3.3 The Assembly Language Standard Exit Sequence
5.4 Local (Automatic) Variables
5.4.1 Low-Level Implementation of Automatic (Local) Variables
5.4.2 The MASM Local Directive
5.4.3 Automatic Allocation
5.5 Parameters
5.5.1 Pass by Value
5.5.2 Pass by Reference
5.5.3 Low-Level Parameter Implementation
5.5.4 Declaring Parameters with the proc Directive
5.5.5 Accessing Reference Parameters on the Stack
5.6 Calling Conventions and the Microsoft ABI
5.7 The Microsoft ABI and Microsoft Calling Convention
5.7.1 Data Types and the Microsoft ABI
5.7.2 Parameter Locations
5.7.3 Volatile and Nonvolatile Registers
5.7.4 Stack Alignment
5.7.5 Parameter Setup and Cleanup (or “What’s with These Magic Instructions?”)
5.8 Functions and Function Results
5.9 Recursion
5.10 Procedure Pointers
5.11 Procedural Parameters
5.12 Saving the State of the Machine, Part II
5.13 Microsoft ABI Notes
5.14 For More Information
5.15 Test Yourself
Chapter 6: Arithmetic
6.1 x86-64 Integer Arithmetic Instructions
6.1.1 Sign- and Zero-Extension Instructions
6.1.2 The mul and imul Instructions
6.1.3 The div and idiv Instructions
6.1.4 The cmp Instruction, Revisited
6.1.5 The setcc Instructions
6.1.6 The test Instruction
6.2 Arithmetic Expressions
6.2.1 Simple Assignments
6.2.2 Simple Expressions
6.2.3 Complex Expressions
6.2.4 Commutative Operators
6.3 Logical (Boolean) Expressions
6.4 Machine and Arithmetic Idioms
6.4.1 Multiplying Without mul or imul
6.4.2 Dividing Without div or idiv
6.4.3 Implementing Modulo-N Counters with AND
6.5 Floating-Point Arithmetic
6.5.1 Floating-Point on the x86-64
6.5.2 FPU Registers
6.5.3 FPU Data Types
6.5.4 The FPU Instruction Set
6.5.5 FPU Data Movement Instructions
6.5.6 Conversions
6.5.7 Arithmetic Instructions
6.5.8 Comparison Instructions
6.5.9 Constant Instructions
6.5.10 Transcendental Instructions
6.5.11 Miscellaneous Instructions
6.6 Converting Floating-Point Expressions to Assembly Language
6.6.1 Converting Arithmetic Expressions to Postfix Notation
6.6.2 Converting Postfix Notation to Assembly Language
6.7 SSE Floating-Point Arithmetic
6.7.1 SSE MXCSR Register
6.7.2 SSE Floating-Point Move Instructions
6.7.3 SSE Floating-Point Arithmetic Instructions
6.7.4 SSE Floating-Point Comparisons
6.7.5 SSE Floating-Point Conversions
6.8 For More Information
6.9 Test Yourself
Chapter 7: Low-Level Control Structures
7.1 Statement Labels
7.1.1 Using Local Symbols in Procedures
7.1.2 Initializing Arrays with Label Addresses
7.2 Unconditional Transfer of Control (jmp)
7.2.1 Register-Indirect Jumps
7.2.2 Memory-Indirect Jumps
7.3 Conditional Jump Instructions
7.4 Trampolines
7.5 Conditional Move Instructions
7.6 Implementing Common Control Structures in Assembly Language
7.6.1 Decisions
7.6.2 if/then/else Sequences
7.6.3 Complex if Statements Using Complete Boolean Evaluation
7.6.4 Short-Circuit Boolean Evaluation
7.6.5 Short-Circuit vs. Complete Boolean Evaluation
7.6.6 Efficient Implementation of if Statements in Assembly Language
7.6.7 switch/case Statements
7.7 State Machines and Indirect Jumps
7.8 Loops
7.8.1 while Loops
7.8.2 repeat/until Loops
7.8.3 forever/endfor Loops
7.8.4 for Loops
7.8.5 The break and continue Statements
7.8.6 Register Usage and Loops
7.9 Loop Performance Improvements
7.9.1 Moving the Termination Condition to the End of a Loop
7.9.2 Executing the Loop Backward
7.9.3 Using Loop-Invariant Computations
7.9.4 Unraveling Loops
7.9.5 Using Induction Variables
7.10 For More Information
7.11 Test Yourself
Chapter 8: Advanced Arithmetic
8.1 Extended-Precision Operations
8.1.1 Extended-Precision Addition
8.1.2 Extended-Precision Subtraction
8.1.3 Extended-Precision Comparisons
8.1.4 Extended-Precision Multiplication
8.1.5 Extended-Precision Division
8.1.6 Extended-Precision Negation Operations
8.1.7 Extended-Precision AND Operations
8.1.8 Extended-Precision OR Operations
8.1.9 Extended-Precision XOR Operations
8.1.10 Extended-Precision NOT Operations
8.1.11 Extended-Precision Shift Operations
8.1.12 Extended-Precision Rotate Operations
8.2 Operating on Different-Size Operands
8.3 Decimal Arithmetic
8.3.1 Literal BCD Constants
8.3.2 Packed Decimal Arithmetic Using the FPU
8.4 For More Information
8.5 Test Yourself
Chapter 9: Numeric Conversion
9.1 Converting Numeric Values to Strings
9.1.1 Converting Numeric Values to Hexadecimal Strings
9.1.2 Converting Extended-Precision Hexadecimal Values to Strings
9.1.3 Converting Unsigned Decimal Values to Strings
9.1.4 Converting Signed Integer Values to Strings
9.1.5 Converting Extended-Precision Unsigned Integers to Strings
9.1.6 Converting Extended-Precision Signed Decimal Values to Strings
9.1.7 Formatted Conversions
9.1.8 Converting Floating-Point Values to Strings
9.2 String-to-Numeric Conversion Routines
9.2.1 Converting Decimal Strings to Integers
9.2.2 Converting Hexadecimal Strings to Numeric Form
9.2.3 Converting Unsigned Decimal Strings to Integers
9.2.4 Conversion of Extended-Precision String to Unsigned Integer
9.2.5 Conversion of Extended-Precision Signed Decimal String to Integer
9.2.6 Conversion of Real String to Floating-Point
9.3 For More Information
9.4 Test Yourself
Chapter 10: Table Lookups
10.1 Tables
10.1.1 Function Computation via Table Lookup
10.1.2 Generating Tables
10.1.3 Table-Lookup Performance
10.2 For More Information
10.3 Test Yourself
Chapter 11: SIMD Instructions
11.1 The SSE/AVX Architectures
11.2 Streaming Data Types
11.3 Using cpuid to Differentiate Instruction Sets
11.4 Full-Segment Syntax and Segment Alignment
11.5 SSE, AVX, and AVX2 Memory Operand Alignment
11.6 SIMD Data Movement Instructions
11.6.1 The (v)movd and (v)movq Instructions
11.6.2 The (v)movaps, (v)movapd, and (v)movdqa Instructions
11.6.3 The (v)movups, (v)movupd, and (v)movdqu Instructions
11.6.4 Performance of Aligned and Unaligned Moves
11.6.5 The (v)movlps and (v)movlpd Instructions
11.6.6 The movhps and movhpd Instructions
11.6.7 The vmovhps and vmovhpd Instructions
11.6.8 The movlhps and vmovlhps Instructions
11.6.9 The movhlps and vmovhlps Instructions
11.6.10 The (v)movshdup and (v)movsldup Instructions
11.6.11 The (v)movddup Instruction
11.6.12 The (v)lddqu Instruction
11.6.13 Performance Issues and the SIMD Move Instructions
11.6.14 Some Final Comments on the SIMD Move Instructions
11.7 The Shuffle and Unpack Instructions
11.7.1 The (v)pshufb Instructions
11.7.2 The (v)pshufd Instructions
11.7.3 The (v)pshuflw and (v)pshufhw Instructions
11.7.4 The shufps and shufpd Instructions
11.7.5 The vshufps and vshufpd Instructions
11.7.6 The (v)unpcklps, (v)unpckhps, (v)unpcklpd, and (v)unpckhpd Instructions
11.7.7 The Integer Unpack Instructions
11.7.8 The (v)pextrb, (v)pextrw, (v)pextrd, and (v)pextrq Instructions
11.7.9 The (v)pinsrb, (v)pinsrw, (v)pinsrd, and (v)pinsrq Instructions
11.7.10 The (v)extractps and (v)insertps Instructions
11.8 SIMD Arithmetic and Logical Operations
11.9 The SIMD Logical (Bitwise) Instructions
11.9.1 The (v)ptest Instructions
11.9.2 The Byte Shift Instructions
11.9.3 The Bit Shift Instructions
11.10 The SIMD Integer Arithmetic Instructions
11.10.1 SIMD Integer Addition
11.10.2 Horizontal Additions
11.10.3 Double-Word–Sized Horizontal Additions
11.10.4 SIMD Integer Subtraction
11.10.5 SIMD Integer Multiplication
11.10.6 SIMD Integer Averages
11.10.7 SIMD Integer Minimum and Maximum
11.10.8 SIMD Integer Absolute Value
11.10.9 SIMD Integer Sign Adjustment Instructions
11.10.10 SIMD Integer Comparison Instructions
11.10.11 Integer Conversions
11.11 SIMD Floating-Point Arithmetic Operations
11.12 SIMD Floating-Point Comparison Instructions
11.12.1 SSE and AVX Comparisons
11.12.2 Unordered vs. Ordered Comparisons
11.12.3 Signaling and Quiet Comparisons
11.12.4 Instruction Synonyms
11.12.5 AVX Extended Comparisons
11.12.6 Using SIMD Comparison Instructions
11.12.7 The (v)movmskps, (v)movmskpd Instructions
11.13 Floating-Point Conversion Instructions
11.14 Aligning SIMD Memory Accesses
11.15 Aligning Word, Dword, and Qword Object Addresses
11.16 Filling an XMM Register with Several Copies of the Same Value
11.17 Loading Some Common Constants Into XMM and YMM Registers
11.18 Setting, Clearing, Inverting, and Testing a Single Bit in an SSE Register
11.19 Processing Two Vectors by Using a Single Incremented Index
11.20 Aligning Two Addresses to a Boundary
11.21 Working with Blocks of Data Whose Length Is Not a Multiple of the SSE/AVX Register Size
11.22 Dynamically Testing for a CPU Feature
11.23 The MASM Include Directive
11.24 And a Whole Lot More
11.25 For More Information
11.26 Test Yourself
Chapter 12: Bit Manipulation
12.1 What Is Bit Data, Anyway?
12.2 Instructions That Manipulate Bits
12.2.1 The and Instruction
12.2.2 The or Instruction
12.2.3 The xor Instruction
12.2.4 Flag Modification by Logical Instructions
12.2.5 The Bit Test Instructions
12.2.6 Manipulating Bits with Shift and Rotate Instructions
12.3 The Carry Flag as a Bit Accumulator
12.4 Packing and Unpacking Bit Strings
12.5 BMI1 Instructions to Extract Bits and Create Bit Masks
12.6 Coalescing Bit Sets and Distributing Bit Strings
12.7 Coalescing and Distributing Bit Strings Using BMI2 Instructions
12.8 Packed Arrays of Bit Strings
12.9 Searching for a Bit
12.10 Counting Bits
12.11 Reversing a Bit String
12.12 Merging Bit Strings
12.13 Extracting Bit Strings
12.14 Searching for a Bit Pattern
12.15 For More Information
12.16 Test Yourself
Chapter 13: Macros and the MASM Compile-Time Language
13.1 Introduction to the Compile-Time Language
13.2 The echo and .err Directives
13.3 Compile-Time Constants and Variables
13.4 Compile-Time Expressions and Operators
13.4.1 The MASM Escape (!) Operator
13.4.2 The MASM Evaluation (%) Operator
13.4.3 The catstr Directive
13.4.4 The instr Directive
13.4.5 The sizestr Directive
13.4.6 The substr Directive
13.5 Conditional Assembly (Compile-Time Decisions)
13.6 Repetitive Assembly (Compile-Time Loops)
13.7 Macros (Compile-Time Procedures)
13.8 Standard Macros
13.9 Macro Parameters
13.9.1 Standard Macro Parameter Expansion
13.9.2 Optional and Required Macro Parameters
13.9.3 Default Macro Parameter Values
13.9.4 Macros with a Variable Number of Parameters
13.9.5 The Macro Expansion (&) Operator
13.10 Local Symbols in a Macro
13.11 The exitm Directive
13.12 MASM Macro Function Syntax
13.13 Macros as Compile-Time Procedures and Functions
13.14 Writing Compile-Time “Programs”
13.14.1 Constructing Data Tables at Compile Time
13.14.2 Unrolling Loops
13.15 Simulating HLL Procedure Calls
13.15.1 HLL-Like Calls with No Parameters
13.15.2 HLL-Like Calls with One Parameter
13.15.3 Using opattr to Determine Argument Types
13.15.4 HLL-Like Calls with a Fixed Number of Parameters
13.15.5 HLL-Like Calls with a Varying Parameter List
13.16 The invoke Macro
13.17 Advanced Macro Parameter Parsing
13.17.1 Checking for String Literal Constants
13.17.2 Checking for Real Constants
13.17.3 Checking for Registers
13.17.4 Compile-Time Arrays
13.18 Using Macros to Write Macros
13.19 Compile-Time Program Performance
13.20 For More Information
13.21 Test Yourself
Chapter 14: The String Instructions
14.1 The x86-64 String Instructions
14.1.1 The rep, repe, repz, and the repnz and repne Prefixes
14.1.2 The Direction Flag
14.1.3 The movs Instruction
14.1.4 The cmps Instruction
14.1.5 The scas Instruction
14.1.6 The stos Instruction
14.1.7 The lods Instruction
14.1.8 Building Complex String Functions from lods and stos
14.2 Performance of the x86-64 String Instructions
14.3 SIMD String Instructions
14.3.1 Packed Compare Operand Sizes
14.3.2 Type of Comparison
14.3.3 Result Polarity
14.3.4 Output Processing
14.3.5 Packed String Compare Lengths
14.3.6 Packed String Comparison Results
14.4 Alignment and Memory Management Unit Pages
14.5 For More Information
14.6 Test Yourself
Chapter 15: Managing Complex Projects
15.1 The include Directive
15.2 Ignoring Duplicate Include Operations
15.3 Assembly Units and External Directives
15.4 Header Files in MASM
15.5 The externdef Directive
15.6 Separate Compilation
15.7 An Introduction to Makefiles
15.7.1 Basic Makefile Syntax
15.7.2 Make Dependencies
15.7.3 Make Clean and Touch
15.8 The Microsoft Linker and Library Code
15.9 Object File and Library Impact on Program Size
15.10 For More Information
15.11 Test Yourself
Chapter 16: Stand-Alone Assembly Language Programs
16.1 Hello World, by Itself
16.2 Header Files and the Windows Interface
16.3 The Win32 API and the Windows ABI
16.4 Building a Stand-Alone Console Application
16.5 Building a Stand-Alone GUI Application
16.6 A Brief Look at the MessageBox Windows API Function
16.7 Windows File I/O
16.8 Windows Applications
16.9 For More Information
16.10 Test Yourself
Part III: Reference Material
Appendix A: ASCII Character Set
Appendix B: Glossary
Appendix C: Installing and Using Visual Studio
C.1 Installing Visual Studio Community
C.2 Creating a Command Line Prompt for MASM
C.3 Editing, Assembling, and Running a MASM Source File
Appendix D: The Windows Command Line Interpreter
D.1 Command Line Syntax
D.2 Directory Names and Drive Letters
D.3 Some Useful Built-in Commands
D.3.1 The cd and chdir Commands
D.3.2 The cls Command
D.3.3 The copy Command
D.3.4 The date Command
D.3.5 The del (erase) Command
D.3.6 The dir Command
D.3.7 The more Command
D.3.8 The move Command
D.3.9 The ren and rename Commands
D.3.10 The rd and rmdir Commands
D.3.11 The time Command
D.4 For More Information
Appendix E: Answers to Questions
E.1 Answers to Questions in Chapter 1
E.2 Answers to Questions in Chapter 2
E.3 Answers to Questions in Chapter 3
E.4 Answers to Questions in Chapter 4
E.5 Answers to Questions in Chapter 5
E.6 Answers to Questions in Chapter 6
E.7 Answers to Questions in Chapter 7
E.8 Answers to Questions in Chapter 8
E.9 Answers to Questions in Chapter 9
E.10 Answers to Questions in Chapter 10
E.11 Answers to Questions in Chapter 11
E.12 Answers to Questions in Chapter 12
E.13 Answers to Questions in Chapter 13
E.14 Answers to Questions in Chapter 14
E.15 Answers to Questions in Chapter 15
E.16 Answers to Questions in Chapter 16
Index