Facial action coding system ; the manual

Contents
Preface to the CD ROM Version
Chapter 1: Introduction to Facial Measurement
	Purpose and Overview
	Terminology
		Table 1-1: Terms that name areas and features of the face
		Figure 1-1: Names and locations of facial areas and parts.
		Table 1-2: Terms that describe appearance changes in the lip and other features
		Table 1-3: Terms that describe transient excrescences of the skin
		Table 1-4: Terms that describe marks in the skin
	Learning Procedure
	How to Interpret the Illustrations of Muscles
	How to Read the AU Sections
		Section A - Appearance Changes
		Section B - How to do the AU
		Section C - Intensity Scoring
			Figure 1-2: Relation between the Scale of Evidence and Intensity Scores
	Introduction to the Reference Sections
Chapter 2: Upper Face Action Units
	Figure 2-1. Muscles underlying upper face Action Units.
	Action Unit 4 – Brow Lowerer
		A. Appearance Changes due to AU 4
		B. How to do AU 4
		C. Intensity Scoring for AU 4
		Reference: AU 4
	Action Unit 1 – Inner Brow Raiser
		A. Appearance Changes due to AU 1
		B. How to do AU 1
		C. Intensity Scoring for AU 1
		Reference: AU 1
	Action Unit 2 – Outer Brow Raiser
		A. Appearance Changes due to AU 2
		B. How to do AU 2
		C. Intensity Scoring for AU 2
		Reference: AU 2
	Action Unit 5 – Upper Lid Raiser
		A. Appearance Changes due to AU 5
		B. How to do AU 5
		C. Intensity Scoring for AU 5
		Reference: AU 5
	Action Unit 7 – Lid Tightener
		A. Appearance Changes due to AU 7
		B. How to do AU 7
		C. Intensity Scoring for AU 7
		Reference: AU 7
	Action Unit 6 – Cheek Raiser and Lid Compressor
		A. Appearance Changes due to AU 6
		B. How to do AU 6
		C. Intensity Scoring for AU 6
		Reference: AU 6
	Introduction to AUs 43, 45, 46
	Action Unit 43 – Eye Closure - Optional
		A. Appearance Changes due to AU 43
		B. How to do AU 43
		C. Intensity Scoring for AU 43
		Reference: AU 43
	Action Unit 45 – Blink - Optional
		A. Appearance Changes due to AU 45
		B. How to do AU 45
		C. Intensity Scoring for AU 45
	Action Unit 46 – Wink – Optional
		A. Appearance Changes due to AU 46
		B. How to do AU 46
		C. Intensity Scoring for AU 46
	Subtle Differences Among Single Action Units in the Upper Face
		Table 2-1 Subtle Differences Among Single Upper Face Action Units
	Action Unit Combinations in the Upper Face
		Descriptions of Combinations Involving Upper Face Actions
	Action Unit Combination 4+5
		A. Appearance Changes due to AU Combination 4+5
		B. How to do AU Combination 4+5
		C. Intensity Scoring for AU Combination 4+5
	Action Unit Combination 5+7
		A. Appearance Changes due to AU Combination 5+7
		B. How to do AU Combination 5+7
		C. Intensity Scoring for AU Combination 5+7
	Action Unit Combination 1+4
		A. Appearance Changes due to AU Combination 1+4
		B. How to do AU Combination 1+4
		C. Intensity Scoring for AU Combination 1+4
	Action Unit Combination 1+2
		A. Appearance Changes due to AU Combination 1+2
		B. How to do AU Combination 1+2
		C. Intensity Scoring for AU Combination 1+2
	Action Unit Combination 1+2+4
		A. Appearance Changes due to AU Combination 1+2+4
		B. How to do AU Combination 1+2+4
		C. Intensity Scoring for AU Combination 1+2+4
	Action Unit Combination 1+2+5
		A. Appearance Changes due to AU Combination 1+2+5
		B. How to do AU Combination 1+2+5
		C. Intensity Scoring for AU Combination 1+2+5
	Action Unit Combinations 6+43E, 7+43E
		A. Appearance Changes due to AU Combinations 6+43E, 7+43E
		B. How to do AU Combinations 6+43E and 7+43E
		C. Intensity Scoring for AU Combinations 6+43E and 7+43E
		Unilaterally of 6+43E and 7+43E
	Other Action Unit Combinations in the Upper Face
		Figure 2-2 Action Unit combination 1+2+4+5
	Subtle Differences Involving Action Units in the Upper Face
		Table 2-2: Subtle Differences for Action Units in the Upper Face
	Alternative Rules Involving Upper Face Actions
		Table 2-3: Alternative rules for upper face actions
Chapter 3: Scoring Upper Face Action Units
	Notation
	Score Sheet
	Scoring Procedure
		Scoring Step I. Initial Scoring
		Scoring Step II. Checking for Omissions
		Scoring Step III. Reorganizing the Initial Scores
		Scoring Step IV. Checking Rules About Alternative AUs and the Reference Sections
			Score Sheet #1: Scoring Steps Example
		Scoring Step V. Verifying Intensity Criteria and Unilaterality Questions
		Scoring Step VI. Final Decisions
	Summary of Scoring Steps
	Interrelationship Among Scoring Steps
	A Warning
	Examples of Scoring
		Figure 3.1: Sample Scoring Images
		Score Sheet #2: Example Photo 1
		Scoring Example 1:
		Scoring Example 2:
			Score Sheet #3: Example Photo 2
	Final Advice Before Scoring
	Practice Scoring
		Table 3-1: Practice Scoring for Chapter 3
Chapter 4: Lower Face Action Units – Up/Down Actions
	Figure 4-1. Locations of lower face up/down action units
	Action Unit 9 – Nose Wrinkler
		A. Appearance Changes due to AU 9
		B. How to do AU 9
		C. Intensity Scoring for AU 9
	Action Unit 10 – Upper Lip Raiser
		A. Appearance Changes due to AU 10
		B. How to do AU 10
			Figure 4-2: Location of the AU 10 Pouch
		C. Intensity Scoring for AU 10
		Reference: AU 10
	Action Unit 17 – Chin Raiser
		A. Appearance Changes due to AU 17
		B. How to do AU 17
		C. Intensity Scoring for AU 17
		Reference: AU 17
	Action Unit 15 – Lip Corner Depressor
		A. Appearance Changes due to AU 15
		B. How to do AU 15
		C. Intensity Scoring for AU 15
		Reference: AU 15
	Action Units 25, 26, 27 – Lips Part, Jaw Drop, Mouth Stretch
		A. Appearance Changes due to AUs 25, 26, 27
		B. How to do AUs 25, 26 and 27
		C. Intensity Scoring for AUs 25, 26, and 27
			Figure 4-3A -Examples of the Intensity of AU 25 with the Jaw Closed
			Figure 4-3B. Examples of the Intensity of AU 25 with the Jaw Lowered by AU 26
			Figure 4-3C. Examples of the Intensity of AU 25 with the Jaw Lowered by AU 27
		Unilateral 25
			Figure 4-4. Examples of the Intensity of AU 26
			Figure 4-5. Examples of the Intensity of AU 27
		Reference: AUs 25, 26, 27
	Action Units 16 and 16+25 – Lower Lip Depressor
		A. Appearance Changes due to AUs 16 and 16+25
		B. How to do AU 16 and 16+25
		C. Intensity Scoring for AU 16
		Reference: AU 16
	Subtle Differences Among Single Up/Down Action Units in the Lower Face
		Table 4-1: Subtle Differences in Single Up/Down Lower Face Actions
	Action Unit Combinations Involving Up/Down Actions
		Descriptions of Combinations Involving Up/Down Lower Face Actions
	Action Unit Combination – 9+16+25
		A. Appearance Changes due to AU Combination 9+16+25
		B. How to do AU Combination 9+16+25
		C. Intensity Scoring for AU Combination 9+16+25
	Action Unit Combination – 10+16+25
		A. Appearance Changes due to AU Combination 10+16+25
		B. How to do AU Combination 10+16+25
		C. Intensity Scoring for AU Combination 10+16+25
	Action Unit Combination – 9+17
		A. Appearance Changes due to AU Combination 9+17
		B. How to do AU Combination 9+17
		C. Intensity Scoring for AU Combination 9+17
	Action Unit Combinations – 10+15, 10+17, 15+17, 10+15+17
		A. Appearance Changes due to AU Combinations 10+15, 10+17, 15+17, 10+15+17
		B. How to do AU Combinations 10+15, 10+17, 15+17 and 10+15+17
		C. Intensity Scoring for AU Combinations 10+15, 10+17, 15+17, 10+15+17
	Other Action Unit Combinations Involving Up/Down Actions
	Practice Scoring
		Table 4-2: Practice for Chapter 4
	Subtle Differences Involving Up/Down Actions in the Lower Face
		Table 4-3: Subtle Differences in AUs and AU Combinations for Lower Face Up/Down Actions
	Alternative Rules Involving Up/Down Actions
		Table 4-4 Summary of Alternative Rules
Chapter 5: Lower Face Action Units – Horizontal Actions
	Figure 5-1. Locations of lower face horizontal action units 14 and 20
	Action Unit 20 – Lip Stretcher
		A. Appearance Changes due to 20
		B. How to do AU 20
		C. Intensity Scoring for AU 20
	Action Unit 14 – Dimpler
		A. Appearance Changes due to AU 14
		B. How to do AU 14
		C. Intensity Scoring For AU 14
		Reference: AU 14
	Subtle Differences Among Single Horizontal Action Units in the Lower Face
		Table 5-1: Subtle Differences in Single Horizontal Lower Face Actions
	Action Unit Combinations Involving Horizontal and Up/Down Actions
		Descriptions of Combinations Involving Horizontal Lower Face Actions
	Action Unit Combinations – 20+26, 20+27
		A. Appearance Changes due to AU Combinations 20+26, 20+27
		B. How to do AU Combinations 20+26 and 20+27
		C. Intensity Scoring for AU Combinations 20+26, 20+27
	Action Unit Combination – 10+14
		A. Appearance Changes due to AU Combination 10+14
		B. How to do AU Combination 10+14
		C. Intensity Scoring for AU Combination 10+14
	Action Unit Combination – 14+17
		A. Appearance Changes due to AU Combination 14+17
		B. How to do AU Combination 14+17
		C. Intensity scoring for AU Combination 14+17
	Action Unit Combination – 10+20+25
		A. Appearance Changes due to AU Combination 10+20+25
		B. How to do AU Combination 10+20+25
		C. Intensity Scoring for AU Combination 10+20+25
	Practice Scoring
		Table 5-2: Practice for Chapter 5
	Subtle Differences Involving Horizontal Actions in the Lower Face
		Table 5-3: Subtle Differences among Lower Face Horizontal Action Units and Combinations
Chapter 6: Lower face Action Units – Oblique Actions
	Figure 6-1. Locations of lower face oblique action units
	Action Unit 11 – Nasolabial Furrow Deepener
		A. Appearance Changes due to 11
		B. How to do 11
		C. Intensity Scoring for AU 11
		Reference: AU 11
	Action Unit 12 – Lip Corner Puller
		A. Appearance Changes due to 12
		B. How to do AU 12
		C. Intensity Scoring for AU 12
		Reference: AU 12
	Action Unit 13 – Sharp Lip Puller
		A. Appearance Changes due to AU 13
		B. How to do AU 13
		C. Intensity Scoring for AU 13
		Reference: AU 13
	Subtle Differences Among Single Oblique Action Units in the Lower Face
		Table 6-1: Subtle Differences Among Single Oblique Action Units in the Lower Face
	Action Unit Combinations Involving Oblique Actions
		Descriptions of Combinations Involving Oblique Lower Face Actions
	Action Unit Combinations - 6+12, 7+12, 6+7+12
		A. Appearance Changes due to 6+12, 7+12, and 6+7+12
		B. How to do 6+12, 7+12, and 6+7+12
		C. Intensity scoring for AUs 6+12, 7+12, and 6+7+12
	Action Unit Combinations - 10+12+25, 12+16+25, 10+12+16+25
		A. Appearance Changes due to 10+12+25, 12+16+25, 10+12+16+25
		B. How to do 10+12+25, 12+16+25 and 10+12+16+25
		C. Intensity scoring for AUs 10+12+25, 12+16+25, 10+12+16+25
	Action Unit Combinations - 12+26, 12+27
		A. Appearance Changes due to 12+26, 12+27
		B. How to do 12+26 and 12+27
		C. Intensity Scoring for AU 12 in 12+26, 12+27
	Action Unit Combination - 12+17
		A. Appearance Changes due to 12+17
		B. How to do 12+17
		C. Intensity Scoring for AUs 12+17
	Action Unit Combinations - 12+15, 12+15+17, 6+12+15, 6+12+15+17
		A. Appearance Changes due to 12+15, 12+15+17, 6+12+15, 6+12+15+17
		B. How to do 12+15, 12+15+17, 6+12+15, 6+12+15+17
		C. Intensity scoring for 12+15, 12+15+17, 6+12+15, 6+12+15+17
			Chart 6-1: Criteria for the B Intensity Level of AUs Involved in Step IV
			Chart 6-2: Criteria for the B Intensity Level of AUs Involved in Step V
	Practice Scoring
		Table 6-2: Practice for Chapter 6
	Subtle Differences Involving Oblique Actions in the Lower Face
		Table 6-3: Subtle Differences Among AUs and Combinations Involving Oblique Actions
Chapter 7: Lower Face Action Units – Orbital Actions
	Figure 7-1. Locations of lower face orbital action units
	Action Unit 18 – Lip Pucker
		A. Appearance Changes due to AU 18
		B. How to do AU 18
		C. Intensity Scoring for AU 18
		Reference: AU 18
	Action Unit 22 and 22+25 – Lip Funneler
		A. Appearance Changes due to AUs 22+25
		B. How to do AUs 22+25
		C. Intensity Scoring for AUs 22+25
		Reference: AU 22
	Action Unit 23 – Lip Tightener
		A. Appearance Changes due to AU 23
		B. How to do AU 23
		C. Intensity Scoring for AU 23
		Reference: AU 23
	Action Unit 24 – Lip Presser
		A. Appearance Changes due to AU 24
		B. How to do AU 24
		C. Intensity Scoring for AU 24
		Reference: AU 24
	Action Unit 28 and 26+28 – Lips Suck
		A. Appearance Changes Due to AU 28
		B. How to do AU 28
		C. Intensity scoring for AU 28
	Subtle Differences Among Single Orbital Action Units in the Lower Face
		Table 7-1: Subtle Differences Among Single Orbital Action Units in the Lower Face
	Action Unit Combinations Involving Orbital Actions
		Descriptions of Combinations Involving Orbital Lower Face Actions
	Action Unit Combination – 10+23+25
		A. Appearance Changes due to AU Combination 10+23+25
		B. How to do 10+23+25
		C. Intensity Scoring for AU Combination 10+23+25
	Action Unit Combinations – 12+23, 12+24
		A. Appearance Changes due to AU Combinations 12+23, 12+24
		B. How to do AU Combinations 12+23 and 12+24
		C. Intensity Scoring for AU Combinations 12+23, 12+24
	Action Unit Combination – 14+23
		A. Appearance Changes due to AU Combination 14+23
		B. How to do AU Combination 14+23
		C. Intensity Scoring for AU Combination 14+23
	Action Unit Combinations – 17+23, 17+24
		A. Appearance Changes due to AU Combinations 17+23, 17+24
		B. How to do AU Combinations 17+23 and 17+24
		C. Intensity Scoring for AU Combinations 17+23, 17+24
		Reference: AU Combination 17+24
	Action Unit Combinations – 6+12+17+23 or 12+17+23
		A. Appearance Changes due to AU Combinations 6+12+17+23 or 12+17+23
		B. How to do AU Combinations 6+12+17+23 or 12+17+23
		C. Intensity Scoring for AU Combinations 6+12+17+23 or 12+17+23
	Action Unit Combination – 10+17+23
		A. Appearance Changes due to AU Combination 10+17+23
		B. How to do AU Combination 10+17+23
		C. Intensity Scoring for AU Combination 10+17+23
	Action Unit Combination – 18+23
		A. Appearance Changes due to AU Combination 18+23
		B. How to do AU Combination 18+23
		C. Intensity Scoring for AU Combination 18+23
	Action Unit Combination – 15+23
		A. Appearance Changes due to AU Combination 15+23
		B. How to do AU Combination 15+23
		C. Intensity Scoring for AU Combination 15+23
	Action Unit Combination – 23+25+26
		A. Appearance changes due to AU Combination 23+25+26
		B. How to do AU Combination 23+25+26
		C. Intensity Scoring for AU Combination 23+25+26
	Action Unit Combination – 22+23+25
		A. Appearance Changes due to AU Combination 22+23+25
		B. How to do AU Combination 22+23+25
		C. Intensity Scoring for AU Combination 22+23+25
	Action Unit Combination – 20+23+25
		A. Appearance Changes due to AU Combination 20+23+25
		B. How to do AU Combination 20+23+25
		C. Intensity Scoring for AU Combination 20+23+25
	Practice Scoring
		Table 7-2: Practice for Chapter 7
	Subtle Differences Involving Orbital Actions in the Lower Face
		Table 7-3: Subtle Differences in AUs and AU Combinations for Lower Face Orbital Actions
		Table 7-4: Alternative Rules Involving Orbital Action Units
Chapter 8: Miscellaneous Actions and Supplementary Codes
	Action Units 8+25 – Lips Toward Each Other
		A. Appearance Changes due to AUs 8+25
		B. How to do AUs 8+25
		C. Intensity Scoring for AUs 8+25
		Reference: AU 8+25
	Action Descriptor 19 – Tongue Show
		A. Appearance Changes due to AD 19
		B. How to do AD 19
		C. Intensity Scoring for AD 19
	Action Unit 21 – Neck Tightener
		A. Appearance Changes due to AU 21
		B. How to do AU 21
		C. Intensity Scoring for AU 21
		Reference: AU 21
	Action Descriptor 29 – Jaw Thrust
		A. Appearance Changes due to AD 29
		B. How to do AD 29
		C. Intensity Scoring for AD 29
		Reference: AD 29
	Action Descriptor 30 – Jaw Sideways
		A. Appearance Changes due to AD 30
		B. How to do AD 30
		C. Intensity Scoring for AD 30
		Reference: AD 30
	Action Unit 31 – Jaw Clencher
		A. Appearance Changes due to AU 31
		B. How to do AU 31
		C. Intensity Scoring for AU 31
		Reference: AU 31
	Action Descriptor 32 – Bite
		A. Appearance Changes due to AD 32
		B. How to do AD 32
		C. Intensity Scoring for AD 32
	Action Descriptor 33 – Blow
		A. Appearance Changes due to AD 33
		B. How to do 33
		C. Intensity Scoring for AD 33
	Action Descriptor 34 – Puff
		A. Appearance Changes due to AD 34.
		B. How to do 34
		C. Intensity Scoring for AD 34
	Action Descriptor 35 – Suck
		A. Appearance Changes due to AD 35
		B. How to do 35
		C. Intensity Scoring for AD 35
	Action Descriptor 36 – Bulge
		A. Appearance Changes due to AD 36
		B. How to do AD 36
		C. Intensity Scoring for AD 36
		Reference: AD 36
	Action Descriptor 37 – Lip Wipe
		A. Appearance Changes due to AD 37
		B. How to do AD 37
		C. Intensity Scoring for AD 37
	Action Unit 38 – Nostril Dilator
		A. Appearance Changes due to AU 38
		B. How to do 38
		C. Intensity Scoring for AU 38
		Reference: AU 38
	Action Unit 39 – Nostril Compressor
		A. Appearance Changes due to AU 39
		B. How to do 39
		C. Intensity Scoring for AU 39
		Reference: AU 39
	Eye Movement Codes M68, 69, and M69
		A. Appearance Changes due to M68, 69, and M69
		B. How to do M68, 69, and M69
		C. Intensity Scoring for M68, 69, and M69
	Visibility Codes 70, 71, 72, and 73
	Head Movement Code M83
		A. Appearance Changes due to M83
		B. How to do M83
		C. Intensity Scoring for M83
	Gross Behavior Codes 40, 50, 80, 81, 82, 84, 85, 91, 92
	Practice Scoring
		Table 8-1: Practice Videos and Images for Miscellaneous Actions
	Subtle Differences Involving the Miscellaneous Actions
		Table 8-2: Subtle Differences for Miscellaneous Action Units
		Table 8-3: Alternative Rules for Miscellaneous Actions
Chapter 9: Head and Eye Positions
	Figure 9-1: Guidelines for Scoring Head Turn Left (51) or Right (52)
	51 – Head Turn Left 52 – Head Turn Right
		Figure 9-2: Guidelines for Scoring Head Up (53)
	53 – Head Up
		Figure 9-3: Guidelines for Scoring Head Down (54) - eyes straight
	54 – Head Down
		Figure 9-4: Guidelines for Scoring Head Down (54) – eyes down
	55 – Head Tilt Left 56 – Head Tilt Right
		Figure 9-5: Guidelines for Scoring Head Tilt Left (55) or Right (56)
	Head movement codes M55 and M56
		A. Appearance Changes due to M55 and M56
		B. How to do M55 and M56
		C. Intensity Scoring for M55 and M56
	57 – Head Forward 58 – Head Back
		Fig. 9-6: Guidelines for Head Forward (57) or Back (58) (Cannot be scored unless head is observed...
	Head Movement Codes M57, M59, and M60
		A. Appearance Changes due to AUs M57, M59, and M60
		B. How to do M57, M59, and M60
		C. Intensity Scoring for AUs M57, M59, and M60
	61 – Eyes Turn Left 62 – Eyes Turn Right
		Figure 9-7: Guidelines for Scoring Eyes Left (61) and Right (62)
	Eye Movement Codes M61 and M62
		A. Appearance Changes due to AUs M61 and M62
		B. How to do M61 and M62
		C. Intensity Scoring for AUs M61 and M62
	63 – Eyes Up 64 – Eyes Down
		Figure 9-8: Guidelines for Scoring Eyes Up (63)
		Figure 9-9: Guidelines for Scoring Eyes Down (64)
	65 – Walleye
	66 – Cross-eye
		Table 9-1: Alternative Rules for Head and Eye Positions
Chapter 10: Scoring Procedure
	Notation
	Score Sheet
	Instructions for Scoring Lower Face and Upper Face
		Scoring Step I. Initial Scoring of the Lower or Upper Face
		Scoring Step II. Checking for Omissions
		Scoring Step III. Reorganizing the Initial Scores
		Scoring Step IV. Checking Alternative AUs and the Reference Sections
		Scoring Step V. Verifying Intensity Criteria, Unilaterality, and Top/Bottom Lip Questions
		Scoring Step VI. Final Decisions
		Scoring Step VII. Record Your Final Scoring in the Place Provided on the Score Sheet
		Scoring Step VIII. Lower Face Only:
		Scoring Step VIII. Upper Face Only:
		Scoring Step IX. Lower Face Only:
		Scoring Step IX. Upper Face Only:
		Scoring Step X. Head/Eye Check in lieu of Scoring Head and Eye Position
		Scoring Step XI. Applicability of Head and Eye Position Images
		Scoring Step XII. Scoring Head Position
		Scoring Step XIII. Scoring Eye Position
		Scoring Step XIV. Integrate Head and Eye Position Scores
		Scoring Step XV. Enter Your Head and Eye Position Scores on the Score Sheet
		Scoring Step XVI. Turn to Step I for the Instructions For Scoring The Upper Face
Chapter 11: Advanced Scoring Techniques
	Scoring AUs During Speech
	Identifying Facial Events
		Discrete events:
		Overlapping events scored as rapid sequential events:
		Events superimposed on background events: Additional AU(s):
		Intensity changes in background events: Increments
		Intensity changes in background events: Decrements
	Scoring Action Units as Unilateral or Asymmetrical
		Scoring Unilateral Actions
		Asymmetry Scoring
			Table 11-1: Asymmetry Scores and Their FACS Prefix Codes
			Table 11-2: Permissible Asymmetry Scores For Each Combination of Intensity Scores
			Table 11-3: Asymmetry Scoring in Example and Practice Images and Videos
			Table 11-4: Videos containing noteworthy examples of asymmetry
Appendix I: Index to Video Examples
Appendix II: Scores for Reference Example Images and Videos
Appendix III: Master Subtle Differences Table
Appendix IV: Master Table of Alternative AUs
Subject Index
	A
	B
	C
	D
	E
	F
	G
	H
	I
	L
	M
	N
	P
	R
	S
	T
	U
	V
	W
Reference Example Images
Practice Images
Facial Action Coding System: Score Sheet