Systems Programming in Unix/Linux

Preface
Contents
About the Author
Chapter 1: Introduction
	1.1 About This Book
	1.2 Roles of Systems Programming
	1.3 Objectives of This Book
		1.3.1 Strengthen Students Programming Background
		1.3.2 Applications of Dynamic Data Structures
		1.3.3 Process Concept and Process Management
		1.3.4 Concurrent Programming
		1.3.5 Timer and Time Functions
		1.3.6 Signals, Signal Processing and IPC
		1.3.7 File system
		1.3.8 TCP/IP and Network Programming
	1.4 Intended Audience
	1.5 Unique Features of This Book
	1.6 Use This Book As Textbook in Systems Programming Courses
	1.7 Other Reference Books
	1.8 Introduction to Unix
		1.8.1 ATandT Unix
		1.8.2 Berkeley Unix
		1.8.3 HP Unix
		1.8.4 IBM Unix
		1.8.5 Sun Unix
	1.9 Introduction to Linux
	1.10 Linux Versions
		1.10.1 Debian Linux
		1.10.2 Ubuntu Linux
		1.10.3 Linux Mint
		1.10.4 RPM-Based Linux
		1.10.5 Slackware Linux
	1.11 Linux Hardware Platforms
	1.12 Linux on Virtual Machines
		1.12.1 VirtualBox
		1.12.2 VMware
		1.12.3 Dual Boot Slackware and Ubuntu Linux
	1.13 Use Linux
		1.13.1 Linux kernel image
		1.13.2 Linux Booters
		1.13.3 Linux Booting
		1.13.4 Linux Run-levels
		1.13.5 Login Process
		1.13.6 Command Executions
	1.14 Use Ubuntu Linux
		1.14.1 Ubuntu Versions
		1.14.2 Special Features of Ubuntu Linux
	1.15 Unix/Linux File System Organization
		1.15.1 File Types
		1.15.2 File Pathnames
		1.15.3 Unix/Linux Commands
		1.15.4 Linux Man Pages
	1.16 Ubuntu Linux System Administration
		1.16.1 User Accounts
		1.16.2 Add New User
		1.16.3 The sudo Command
	1.17 Summary
	References
Chapter 2: Programming Background
	2.1 Text Editors in Linux
		2.1.1 Vim
		2.1.2 Gedit
		2.1.3 Emacs
	2.2 Use Text Editors
		2.2.1 Use Emacs
		2.2.2 Emacs Menus
		2.2.3 IDE of Emacs
	2.3 Program Development
		2.3.1 Program Development Steps
		2.3.2 Variables in C
		2.3.3 Compile-Link in GCC
		2.3.4 Static vs. Dynamic Linking
		2.3.5 Executable File Format
		2.3.6 Contents of a.out File
		2.3.7 Program Execution
		2.3.8 Program Termination
	2.4 Function Call in C
		2.4.1 Run-Time Stack Usage in 32-Bit GCC
		2.4.2 Stack Frames
		2.4.3 Return From Function Call
		2.4.4 Long Jump
		2.4.5 Run-Time Stack Usage in 64-Bit GCC
	2.5 Link C Program with Assembly Code
		2.5.1 Programming in Assembly
		2.5.2 Implement Functions in Assembly
		2.5.3 Call C functions from Assembly
	2.6 Link Library
		2.6.1 Static Link Library
		2.6.2 Dynamic Link Library
	2.7 Makefile
		2.7.1 Makefile Format
		2.7.2 The make Program
		2.7.3 Makefile Examples
	2.8 The GDB Debugger
		2.8.1 Use GDB in Emacs IDE
		2.8.2 Advices on Using Debugging Tools
		2.8.3 Common Errors in C programs
	2.9 Structures in C
		2.9.1 Structure and Pointers
		2.9.2 Typecast in C
	2.10 Link List Processing
		2.10.1 Link Lists
		2.10.2 Link List Operations
		2.10.3 Build Link List
			2.10.3.1 Link List in Data Area
			2.10.3.2 Link List in Heap Area
		2.10.4 Link List Traversal
		2.10.5 Search Link List
		2.10.6 Insert Operation
		2.10.7 Priority Queue
		2.10.8 Delete Operation
		2.10.9 Circular Link List
		2.10.10 Open-Ended C Structures
		2.10.11 Doubly Link Lists
		2.10.12 Doubly Link Lists Example Programs
	2.11 Trees
	2.12 Binary Tree
		2.12.1 Binary Search Tree
		2.12.2 Build a Binary Search Tree (BST)
		2.12.3 Binary Tree Traversal Algorithms
		2.12.4 Depth-First Traversal Algorithms
		2.12.5 Breadth-First Traversal Algorithms
	2.13 Programming Project: Unix/Linux File System Tree Simulator
		2.13.1 Unix/Linux File System Tree
		2.13.2 Implement General Tree by Binary Tree
		2.13.3 Project Specification and Requirements
		2.13.4 Commands Specification
		2.13.5 Program Organization
		2.13.6 Command Algorithms
		2.13.7 Sample Solution
	2.14 Summary
	References
Chapter 3: Process Management in Unix/Linux
	3.1 Multitasking
	3.2 The Process Concept
	3.3 A Multitasking System
		3.3.1 type.h file
		3.3.2 The ts.s file
		3.3.3 The queue.c file
		3.3.4 The t.c file
		3.3.5 Explanations of the Multitasking System Code
	3.4 Process Synchronization
		3.4.1 Sleep Operation
		3.4.2 Wakeup Operation
	3.5 Process Termination
		3.5.1 Algorithm of kexit()
		3.5.2 Process Family Tree
		3.5.3 Wait for Child Process Termination
	3.6 Process Management in the MT Multitasking System
	3.7 Processes in Unix/Linux
		3.7.1 Process Origin
		3.7.2 INIT and Daemon Processes
		3.7.3 Login Processes
		3.7.4 Sh Process
		3.7.5 Process Execution Modes
	3.8 System Calls for Process Management
		3.8.1 fork()
		3.8.2 Process Execution Order
		3.8.3 Process Termination
		3.8.4 Wait for Child Process Termination
		3.8.5 Subreaper Process in Linux
		3.8.6 exec(): Change Process Execution Image
		3.8.7 Environment Variables
	3.9 I/O Redirection
		3.9.1 FILE Streams and File Descriptors
		3.9.2 FILE Stream I/O and System Call
		3.9.3 Redirect stdin
		3.9.4 Redirect stdout
	3.10 Pipes
		3.10.1 Pipe Programming in Unix/Linux
		3.10.2 Pipe Command Processing
		3.10.3 Connect PIPE writer to PIPE reader
		3.10.4 Named pipes
	3.11 Programming Project: sh Simulator
		3.11.1 Single Command with I/O Redirection
		3.11.2 Commands with Pipes
		3.11.3 ELF executable vs. sh script files
		3.11.4 Sample Solution
	3.12 Summary
	References
Chapter 4: Concurrent Programming
	4.1 Introduction to Parallel Computing
		4.1.1 Sequential Algorithms vs. Parallel Algorithms
		4.1.2 Parallelism vs. Concurrency
	4.2 Threads
		4.2.1 Principle of Threads
		4.2.2 Advantages of Threads
		4.2.3 Disadvantages of Threads
	4.3 Threads Operations
	4.4 Threads Management Functions
		4.4.1 Create Thread
		4.4.2 Thread ID
		4.4.3 Thread Termination
		4.4.4 Thread Join
	4.5 Threads Example Programs
		4.5.1 Sum of Matrix by Threads
		4.5.2 Quicksort by Threads
	4.6 Threads Synchronization
		4.6.1 Mutex Locks
		4.6.2 Deadlock Prevention
		4.6.3 Condition Variables
		4.6.4 Producer-Consumer Problem
		4.6.5 Semaphores
		4.6.6 Barriers
		4.6.7 Solve System of Linear Equations by Concurrent Threads
		4.6.8 Threads in Linux
	4.7 Programming Project: User-Level Threads
		4.7.1 Project Base Code: A Multitasking System
		4.7.2 User-Level Threads
		4.7.3 Implementation of Thread Join Operation
		4.7.4 Implementation of Mutex Operations
		4.7.5 Test Project with Mutex by Concurrent Programs
		4.7.6 Implementation of Semaphores
		4.7.7 Producer-Consumer Problem using Semaphores
	4.8 Summary
	References
Chapter 5: Timers and Time Service
	5.1 Hardware Timer
	5.2 PC Timers
	5.3 CPU Operations
	5.4 Interrupt Processing
	5.5 Time Service Functions
		5.5.1 Gettimeofday-Settimeofday
		5.5.2 The Time System Call
		5.5.3 The Times System Call
		5.5.4 Time and Date Commands
	5.6 Interval Timers
	5.7 REAL Mode Interval Timer
	5.8 Programming Project
		5.8.1 System Base Code
		5.8.2 Timer Interrupts
		5.8.3 Timer Queue
		5.8.4 Critical Regions
		5.8.5 Advanced Topics
	5.9 Summary
	References
Chapter 6: Signals and Signal Processing
	6.1 Signals and Interrupts
	6.2 Examples of Unix/Linux Signals
	6.3 Signal Processing in Unix/Linux
		6.3.1 Signal Types
		6.3.2 Origin of Signals
		6.3.3 Signals in Process PROC Structure:
		6.3.4 Signal Handlers
		6.3.5 Install Signal Catchers
	6.4 Signal Processing Steps
	6.5 Signals and Exceptions
	6.6 Signals as IPC
	6.7 IPC in Linux
		6.7.1 Pipes and FIFOs
		6.7.2 Signals
		6.7.3 System V IPC
		6.7.4 POSIX Message Queues
		6.7.5 Threads Synchronization Mechanisms
		6.7.6 Sockets
	6.8 Programming Project: Implement an IPC for Messages
	6.9 Summary
	References
Chapter 7: File Operations
	7.1 File Operation Levels
	7.2 File I/O Operations
	7.3 Low Level File Operations
		7.3.1 Partitions
		7.3.2 Format Partitions
		7.3.3 Mount Partitions
	7.4 Introduction to EXT2 File System
		7.4.1 EXT2 File System Data Structures
		7.4.2 Superblock
		7.4.3 Group Descriptor
		7.4.4 Bitmaps
		7.4.5 Inodes
		7.4.6 Directory Entries
	7.5 Programming Examples
		7.5.1 Display Superblock
		7.5.2 Display Bitmaps
		7.5.3 Display root Inode
		7.5.4 Display Directory Entries
	7.6 Programming Project: Convert File Pathname to Inode
	7.7 Summary
	References
Chapter 8: System Calls for File Operations
	8.1 Systems Calls
	8.2 System Call Man Pages
	8.3 System Calls for File Operations
	8.4 Commonly used system Calls
	8.5 Link Files
		8.5.1 Hard Link Files
		8.5.2 Symbolic Link Files
	8.6 The stat Systen Call
		8.6.1 Stat File Status
			8.6.1.1 STAT(2) Linux Programmer´s Manual STAT(2)
		8.6.2 The stat Structure
		8.6.3 Stat and File Inode
		8.6.4 File Type and Permissions
		8.6.5 Opendir-Readdir Functions
		8.6.6 Readlink Function
		8.6.7 The ls Program
	8.7 open-close-lseek System Calls
		8.7.1 Open File and File Descriptor
		8.7.2 Close File Descriptor
		8.7.3 lseek File Descriptor
	8.8 Read() System Call
	8.9 Write() System Call
	8.10 File Operation Example Programs
		8.10.1 Display File Contents
		8.10.2 Copy Files
		8.10.3 Selective File Copy
	8.11 Programming Project: Recursive Copy Files using System Calls
		8.11.1 Hints and Helps
		8.11.2 Sample Solution
	8.12 Summary
	References
Chapter 9: Library I/O Functions
	9.1 Library I/O Functions
	9.2 Library I/O Functions vs. System Calls
	9.3 Algorithms of Library I/O Functions
		9.3.1 Algorithm of fread
		9.3.2 Algorithm of fwrite
		9.3.3 Algorithm of fclose
	9.4 Use Library I/O Function or System Call
	9.5 Library I/O Modes
		9.5.1 Char Mode I/O
		9.5.2 Line mode I/O
		9.5.3 Formatted I/O
		9.5.4 In-memory Conversion Functions
		9.5.5 Other Library I/O Functions
		9.5.6 Restriction on Mixed fread-fwrite
	9.6 File Stream Buffering
	9.7 Functions with Varying Parameters
	9.8 Programming Project: Printf-like Function
		9.8.1 Project Specification
		9.8.2 Base Code of Project
		9.8.3 Algorithm of myprintf()
		9.8.4 Project Refinements
		9.8.5 Project Demonstration and Sample Solutions
	9.9 Summary
	References
Chapter 10: Sh Programming
	10.1 sh Scripts
	10.2 sh Scripts vs. C Programs
	10.3 Command-line parameters
	10.4 Sh Variables
	10.5 Quotes in sh
	10.6 sh Statements
	10.7 sh Commands
		10.7.1 Built-in Commands
		10.7.2 Linux Commands
	10.8 Command Substitution
	10.9 Sh Control Statements
		10.9.1 if-else-fi statement
		10.9.2 for Statement
		10.9.3 while Statement
		10.9.4 until-do Statement
		10.9.5 case Statement
		10.9.6 continue and break Statements
	10.10 I/O Redirection
	10.11 Here Documents
	10.12 sh Functions
	10.13 Wild Cards in sh
	10.14 Command Grouping
	10.15 eval Statement
	10.16 Debugging sh Scripts
	10.17 Applications of sh scripts
	10.18 Programming Project: Recursive File Copy by sh Script
	10.19 Summary
	References
Chapter 11: EXT2 File System
	11.1 EXT2 File System
	11.2 EXT2 File System Data Structures
		11.2.1 Create Virtual Disk by mkfs
		11.2.2 Virtual Disk Layout
		11.2.3 Superblock
		11.2.4 Group Descriptors
		11.2.5 Block and Inode Bitmaps
		11.2.6 Inodes
		11.2.7 Data Blocks
		11.2.8 Directory Entries
	11.3 Mailman´s Algorithm
		11.3.1 Test-Set-Clear Bits in C
		11.3.2 Convert INODE Number to INODE on Disk
	11.4 Programming Examples
		11.4.1 Display Superblock
		11.4.2 Display Bitmaps
		11.4.3 Display Root Inode
		11.4.4 Display Directory Entries
	11.5 Traverse EXT2 File System Tree
		11.5.1 Traversal Algorithm
		11.5.2 Convert Pathname to INODE
		11.5.3 Display INODE Disk Blocks
	11.6 Implementation of EXT2 File System
		11.6.1 File System Organization
		11.6.2 Files System Levels
	11.7 Base File System
		11.7.1 type.h file
		11.7.2 Utility Functions
		11.7.3 Mount-Root
		11.7.4 Implementation of Base File System
	11.8 File System Level-1 Functions
		11.8.1 Algorithm of mkdir
		11.8.2 Algorithm of creat
		11.8.3 Implementation of mkdir-creat
		11.8.4 Algorithm of rmdir
		11.8.5 Implementation of rmdir
		11.8.6 Algorithm of link
		11.8.7 Algorithm of unlink
		11.8.8 Algorithm of symlink
		11.8.9 Algorithm of readlink
		11.8.10 Other Level-1 Functions
		11.8.11 Programming Project #1: Implementation of File System Level-1
	11.9 File System Level-2 Functions
		11.9.1 Algorithm of open
		11.9.2 lseek
		11.9.3 Algorithm of close
		11.9.4 Read Regular Files
		11.9.5 Write Regular Files
		11.9.6 Opendir-Readdir
		11.9.7 Programming Project #2: Implementation of File System Level-2
	11.10 File System Level-3
		11.10.1 Algorithm of mount
		11.10.2 Algorithm of umount
		11.10.3 Cross Mounting Points
		11.10.4 File Protection
		11.10.5 Real and Effective uid
		11.10.6 File Locking
		11.10.7 Programming Project #3: Implementation of Complete File System
	11.11 Extensions of File System Project
	11.12 Summary
	References
Chapter 12: Block Device I/O and Buffer Management
	12.1 Block Device I/O Buffers
	12.2 Unix I/O Buffer Management Algorithm
		12.2.1 Shortcomings of Unix Algorithm
	12.3 New I/O Buffer Management Algorithm
		12.3.1 Buffer Management Algorithm using Semaphores
	12.4 PV Algorithm
	12.5 Programming Project: Comparison of I/O Buffer Management Algorithms
		12.5.1 System Organization
		12.5.2 Multitasking System
		12.5.3 Buffer Manager
		12.5.4 Disk Driver
		12.5.5 Disk Controller
		12.5.6 Disk Interrupts
		12.5.7 Virtual Disks
		12.5.8 Project Requirements
		12.5.9 Sample Base Code
		12.5.10 Sample Solutions
	12.6 Refinements of Simulation System
	12.7 Refinements of PV Algorithm
	12.8 Summary
	References
Chapter 13: TCP/IP and Network Programming
	13.1 Introduction to Network Programming
	13.2 TCP/IP Protocol
	13.3 IP Host and IP address
	13.4 IP Protocol
	13.5 IP Packet Format
	13.6 Routers
	13.7 UDP User Datagram Protocol
	13.8 TCP Transmission Control Protocol
	13.9 Port Number
	13.10 Network and Host Byte Orders
	13.11 Data Flow in TCP/IP Networks
	13.12 Network Programming
		13.12.1 Network Programming Platforms
		13.12.2 Server-Client Computing Model
	13.13 Socket Programming
		13.13.1 Socket Address
		13.13.2 The Socket API
	13.14 UDP Echo Server-Client Program
	13.15 TCP Echo Server-Client Program
	13.16 Hostname and IP Address
	13.17 TCP Programming Project: File Server on Internet
		13.17.1 Project Specification
		13.17.2 Helps and Hints
		13.17.3 Multi-threaded TCP Server
	13.18 Web and CGI Programming
		13.18.1 HTTP Programming Model
		13.18.2 Web Pages
		13.18.3 Hosting Web Pages
		13.18.4 Configure HTTPD for Web Pages
		13.18.5 Dynamic Web Pages
		13.18.6 PHP
		13.18.7 CGI Programming
		13.18.8 Configure HTTPD for CGI
	13.19 CGI Programming Project: Dynamic Webpage by CGI
	13.20 Summary
	References
Chapter 14: MySQL Database System
	14.1 Introduction to MySQL
	14.2 Install MySQL
		14.2.1 Ubuntu Linux
		14.2.2 Slackware Linux
	14.3 Use MySQL
		14.3.1 Connect to MySQL Server
		14.3.2 Show Databases
		14.3.3 Create New database
		14.3.4 Drop Database
		14.3.5 Choose Database
		14.3.6 Create Tables
		14.3.7 Drop Tables
		14.3.8 Data Types in MySQL
		14.3.9 Insert Rows
		14.3.10 Delete Rows
		14.3.11 Update Table
		14.3.12 Alter Table
		14.3.13 Related Tables
		14.3.14 Join Operations
		14.3.15 MySQL Database Diagram
		14.3.16 MySQL Scripts
	14.4 MySQL Programming in C
		14.4.1 Build MySQL Client Program in C
		14.4.2 Connect to MySQL Server in C
		14.4.3 Build MySQL Database in C
		14.4.4 Retrieve Results of MySQL Queries in C
	14.5 MySQL Programming in PHP
		14.5.1 Connect to MySQL Server in PHP
		14.5.2 Create Database Tables in PHP
		14.5.3 Insert Records into Table in PHP
		14.5.4 Retrieve Results of MySQL Queries in PHP
		14.5.5 Update Operation in PHP
		14.5.6 Delete Rows in PHP
	14.6 Summary
	References
Index