Home Page Icon
Home Page
Table of Contents for
Index
Close
Index
by Massimo Fascinari, Clemente Giorio
Kinect in Motion – Audio and Visual Tracking by Example
Kinect in Motion – Audio and Visual Tracking by Example
Table of Contents
Kinect in Motion – Audio and Visual Tracking by Example
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers and more
Why Subscribe?
Free Access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Downloading the color images of this book
Errata
Piracy
Questions
1. Kinect for Windows – Hardware and SDK Overview
Motion computing and Kinect
Hardware overview
The IR projector
Depth camera
The RGB camera
Tilt motor and three-axis accelerometer
Microphone array
Software architecture
Video stream
Depth stream
Audio stream
Skeleton
Summary
2. Starting with Image Streams
Color stream
Editing the colored image
Image tuning
The color image formats
The Infrared color image format
The raw Bayer formats
YUV raw format
Depth stream
DepthRange – the default and near mode
Extended range
Mapping from the color frame to the depth frame
Summary
3. Skeletal Tracking
Tracking users
Copying the skeleton data
Default and Seated mode
Detecting simple actions
Joint rotations
Summary
4. Speech Recognition
Speech recognition
Grammars
A simple grammar sample
The Microsoft.Speech library
Tracking audio sources
Sound source angle
Beam angle
Summary
A. Kinect Studio and Audio Recording
Kinect Studio – capturing Kinect data
Audio stream data – recording and injecting
Summary
Index
Search in book...
Toggle Font Controls
Playlists
Add To
Create new playlist
Name your new playlist
Playlist description (optional)
Cancel
Create playlist
Sign In
Email address
Password
Forgot Password?
Create account
Login
or
Continue with Facebook
Continue with Google
Sign Up
Full Name
Email address
Confirm Email Address
Password
Login
Create account
or
Continue with Facebook
Continue with Google
Prev
Previous Chapter
Summary
Index
A
absolute rotation
about /
Joint rotations
Acoustic Echo Cancellation (AEC) /
Microphone array
,
Audio stream
Adaptive mode /
Sound source angle
Adaptive Template method /
Detecting simple actions
AllFramesReady event /
Tracking users
Analog to Digital Converter (ADC) /
Microphone array
audio sources
tracking /
Tracking audio sources
AudioSourceSoundSourceAngleChanged event handler /
Beam angle
audio stream /
Audio stream
audio stream data
injecting /
Audio stream data – recording and injecting
recording /
Audio stream data – recording and injecting
Automatic (default value) mode /
Sound source angle
B
BackgroundWorker.DoWork event /
Editing the colored image
BackgroundWorker.RunWorkerAsync() method /
Editing the colored image
BacklightCompensationMode property /
Image tuning
beam angle
about /
Beam angle
Brightness property /
Image tuning
C
CameraSettings class /
Image tuning
Check method /
Detecting simple actions
color frame
to depth frame, mapping from /
Mapping from the color frame to the depth frame
ColorFrameReady event /
Color stream
color image
editing /
Editing the colored image
formats /
The color image formats
ColorImageFrame.Format property /
The color image formats
,
The Infrared color image format
ColorImageFrame object /
Color stream
color stream
about /
Color stream
colored image, editing /
Editing the colored image
image, tuning /
Image tuning
color image, formats /
The color image formats
Infrared color image format /
The Infrared color image format
raw Bayer formats /
The raw Bayer formats
YUV raw format /
YUV raw format
Color Viewer window /
Kinect Studio – capturing Kinect data
Connect button /
Kinect Studio – capturing Kinect data
Contrast property /
Image tuning
D
3D Viewer window /
Kinect Studio – capturing Kinect data
default mode /
Default and Seated mode
depth camera, Kinect /
Depth camera
depth image frame
features /
Depth stream
DepthImageStream class /
DepthRange – the default and near mode
DepthRange.Default /
DepthRange – the default and near mode
DepthRange.Near /
DepthRange – the default and near mode
depth stream /
Depth stream
about /
Depth stream
DepthRange /
DepthRange – the default and near mode
Extended range /
Extended range
color frame to depth frame, mapping from /
Mapping from the color frame to the depth frame
Depth Viewer window /
Kinect Studio – capturing Kinect data
DictationGrammar /
The Microsoft.Speech library
DirectX Media Object (DMO) /
Software architecture
,
Audio stream
DrawingContext.DrawLine method /
Copying the skeleton data
DrawingGroup class /
Copying the skeleton data
DrawingGroup drawingGroup variable /
Copying the skeleton data
DrawingImage imageSource variable /
Copying the skeleton data
DTW /
Detecting simple actions
E
ExposureTime property /
Image tuning
Extended range /
Extended range
F
FrameInterval property /
Image tuning
G
<Grid.ColumnDefinitions> tag /
Color stream
<Grid.RowDefinitions> tag /
Color stream
gain property /
Image tuning
gamma property /
Image tuning
GestureManager class /
Detecting simple actions
gestureManager_GestureRecognized event /
Detecting simple actions
GetKinectRecognizer method /
The Microsoft.Speech library
grammars
about /
Grammars
sample /
A simple grammar sample
H
hardware, Kinect
about /
Hardware overview
hierarchical rotation
about /
Joint rotations
HMMs /
Detecting simple actions
hue property /
Image tuning
Hybrid approach /
Detecting simple actions
I
image
tuning /
Image tuning
Infrared color image format /
The Infrared color image format
InitializeColorImage method /
Color stream
InotifyPropertyChanged interface /
Image tuning
Int32 DepthRange Range property /
DepthRange – the default and near mode
Int32 Image.PixelDataLength property /
Color stream
IR-pass filter /
Depth camera
IR projector, Kinect /
The IR projector
J
joint /
Tracking users
joint rotation
about /
Joint rotations
JointType enumeration
URL /
Tracking users
K
Kinect
about /
Motion computing and Kinect
hardware overview /
Hardware overview
IR projector /
The IR projector
depth camera /
Depth camera
RGB camera /
The RGB camera
tilt motor /
Tilt motor and three-axis accelerometer
three-axis accelerometer /
Tilt motor and three-axis accelerometer
microphone array /
Microphone array
software architecture /
Software architecture
sensor /
Software architecture
drivers /
Software architecture
video stream /
Video stream
depth stream /
Depth stream
audio stream /
Audio stream
skeleton /
Skeleton
KinectAudioSource.BeamAngleMode property /
Sound source angle
KinectAudioSource.BeamAngle property /
Sound source angle
KinectAudiosource class /
Audio stream
KinectAudioSource class /
Sound source angle
KinectColorFrameReady event /
Editing the colored image
Kinect data
capturing /
Kinect Studio – capturing Kinect data
KinectSensor.AccelerometerGetCurrentReading method /
The Microsoft.Speech library
KinectSensor.AudioSource property /
Audio stream
KinectSensor.ColorStream.CameraSettings class /
Image tuning
KinectSensor.DepthFrameReady event /
Depth stream
KinectSensor.ElevationAngle property /
The Microsoft.Speech library
KinectSensor.KinectColorFrameReady event /
Color stream
KinectSensor.SkeletonStream.Enable() method /
Tracking users
KinectSensor.Start() method /
Kinect Studio – capturing Kinect data
Kinect sensor accelerometer /
The Microsoft.Speech library
KinectSensors_StatusChanged method /
Editing the colored image
Kinect Studio
about /
Kinect Studio – capturing Kinect data
M
MainWindows.xaml file /
Color stream
ManualBeamAngle value /
Beam angle
Manual mode /
Sound source angle
microphone array, Kinect /
Microphone array
Microsoft.Kinect.ColorCameraSettings class /
Video stream
Microsoft.Speech library
about /
The Microsoft.Speech library
Microsoft White Paper
URL /
Joint rotations
N
neural network /
Detecting simple actions
NUI
about /
Motion computing and Kinect
principles /
Motion computing and Kinect
NUI APIs header files /
Software architecture
O
Open() method /
Copying the skeleton data
Open graphical button (Ctrl + O by the keyboard) /
Kinect Studio – capturing Kinect data
P
Play/Pause graphical button (Shift + F5 on the keyboard) /
Kinect Studio – capturing Kinect data
PlayerIndex property /
Depth stream
polling approach /
Editing the colored image
posture /
Detecting simple actions
PowerLineFrequency property /
Image tuning
previousAccelerometerData /
The Microsoft.Speech library
PrimeSense
URL /
Motion computing and Kinect
private byte[] colorPixels variable /
Color stream
Pulse-Code Modulation (PCM) /
Microphone array
Pulse Code Modulation (PCM) /
The Microsoft.Speech library
R
raw Bayer formats /
The raw Bayer formats
RecognizeAysnc method /
The Microsoft.Speech library
Recognize method /
The Microsoft.Speech library
RecognizeMode enum value /
The Microsoft.Speech library
RecognizerInfo class /
The Microsoft.Speech library
RecognizerInfo class instance /
The Microsoft.Speech library
RecordAudio method /
Audio stream data – recording and injecting
Recorder class /
Audio stream data – recording and injecting
Record graphical button (Ctrl + R using the keyboard) /
Kinect Studio – capturing Kinect data
ResetToDefault() method /
Image tuning
RGB camera, Kinect /
The RGB camera
S
saturation property /
Image tuning
SDK
about /
Motion computing and Kinect
seated mode /
Default and Seated mode
section /
Detecting simple actions
SelectionHandLeft gesture /
Detecting simple actions
sensor /
Depth camera
sensor.SkeletonStream.TrackingMode property /
Default and Seated mode
sensor.SkeletonStream property /
Default and Seated mode
SensorColorFrameReady method /
Color stream
sensor_AllFramesReady event handler /
Tracking users
,
Beam angle
SetInputToWaveFile method /
Audio stream data – recording and injecting
sharpness property /
Image tuning
skeletal joint smoothing
about /
Joint rotations
skeletal tracking
users, tracking /
Tracking users
copying /
Copying the skeleton data
seated mode /
Default and Seated mode
default mode /
Default and Seated mode
simple actions, detecting /
Detecting simple actions
base class, for gestures /
Detecting simple actions
gesture manager, utilizing /
Detecting simple actions
joint rotation /
Joint rotations
skeleton
about /
Skeleton
SkeletonFrame.CopySkeletonDataTo method /
Copying the skeleton data
SkeletonFrame class /
Tracking users
SkeletonFrameReady event /
Tracking users
SkeletonStream.OpenNextFrame() method /
Tracking users
SkeletonStream class /
Copying the skeleton data
smoothing filters
about /
Joint rotations
sound source angle
about /
Sound source angle
SoundSourceAngle property /
Beam angle
speech recognition
about /
Speech recognition
SpeechRecognitionEngine.UnloadAllGrammar() method /
A simple grammar sample
SpeechRecognitionEngine class /
The Microsoft.Speech library
,
Audio stream data – recording and injecting
Speech Recognition Grammar Specification Version 1.0 (SRGS) /
Grammars
SpeechRecognized event /
The Microsoft.Speech library
SpeechRecognized event /
The Microsoft.Speech library
SpeechRecognizedEventArgs event /
The Microsoft.Speech library
SpeechRecognized event handler /
The Microsoft.Speech library
SpeechRecognizedRejected event /
The Microsoft.Speech library
SpeechRejected event handler /
The Microsoft.Speech library
START command /
Beam angle
Stop graphical button (Shift + F5 using the keyboard) /
Kinect Studio – capturing Kinect data
System.Windows.Media.DrawingContext class /
Copying the skeleton data
T
this.sensor instance /
Sound source angle
three-axis accelerometer, Kinect /
Tilt motor and three-axis accelerometer
tilt motor, Kinect /
Tilt motor and three-axis accelerometer
U
users
tracking /
Tracking users
using statement /
Color stream
V
video stream /
Video stream
W
WhiteBalance property /
Image tuning
Windows 7 standard APIs /
Software architecture
Windows Audio Session API (WASAPI) /
Audio stream
WriteableBitmap array /
Color stream
WriteWaveFile method /
Audio stream data – recording and injecting
WriteWavHeader method /
Audio stream data – recording and injecting
X
X8R8G8B8 format /
Video stream
Y
YUV raw format /
YUV raw format
YUV to RGB conversion algorithm /
YUV raw format
Add Highlight
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click
here
login for view all page.
Day Mode
Cloud Mode
Night Mode
Reset