Loading presentation...

Present Remotely

Send the link below via email or IM

Copy

Present to your audience

Start remote presentation

  • Invited audience members will follow you as you navigate and present
  • People invited to a presentation do not need a Prezi account
  • This link expires 10 minutes after you close the presentation
  • A maximum of 30 users can follow your presentation
  • Learn more about this feature in our knowledge base article

Do you really want to delete this prezi?

Neither you, nor the coeditors you shared it with will be able to recover it again.

DeleteCancel

Make your likes visible on Facebook?

Connect your Facebook account to Prezi and let your likes appear on your timeline.
You can change this under Settings & Account at any time.

No, thanks

Sonification GAC Workshop

Sonifikacja
by

Tomasz Sulej

on 19 September 2016

Comments (0)

Please log in to add your comment.

Report abuse

Transcript of Sonification GAC Workshop

Sonification
Organization
Pair work
Questions during workshop
Command helper on sheets
https://docs.google.com/document/d/1PZFcAAMkfemLz8luTwLYknx2Ohk_wQjWhw6NPlFB3Lk/edit?usp=sharing
What you need
Images (jpg, png)
Animated gif
Video file
or:
image as sound

Agenda
Image sonification
RAW
Audio
Filters
Command Line Tools
RAW again
Audio again
Animated GIF
Batch processing
Video
Signal processing in Processing
Part 1 - basics
Tools
Audacity
Image conversion tools (PS, Gimp, IrfanView)
Image
Audio
A-law
JPG
PNG
BMP
TGA

Image
RAW
Audio
Format
RGB
YUV
3/4 color channels
8/12/16/24/32 bits per pixel
2-8 bits per channel
3 channels: Luminocity (L) + 2 color channels (u i v)
Chroma sampling (less info about color):
YUV444 (12 bytes for 4 pixels)
YUV422 (8 bytes for 4 pixels)
YUV411 (8 bytes for 4 pixels)
YUV420 (6 bytes for 4 pixels)
Data arrangement
Interleaved/Interlaced - RGBRGBRGB
Planar/Plane - RRR...GGG...BBB...
Line - Planar per line
Bayer patterns
Permutations: GBR, BRG, etc.
YUV422p, NV21, NV12, YUV440p10le etc.
Color spaces
(s)RGB, CMY(K), XYZ, xyY, OHTA
HSB, HSL, HSV, HCL, HSW
LAB, LUV, YUV, YCbCr, YDbDr, YPbPr, YIQ, YCC
Sample rate: from 1 to 200k+ Hz
Channels
1 (mono)
2 (stereo)
4 (quadrophony)
5.1, 7.1 etc
RAW data interpretation
8, 16, 24 bits
signed or unsigned
A-law, u-law (8 bits)
big endian / little endian
Sample is a floating point number within range [-1,1]
R
G
B
R
G
B
R
G
B
...
Coding Luv in RGB format
Convert to Luv
save: L as R, u as G, v as B

8bit, stereo:
R -> left
G -> right
B -> left
R -> right
16bit, mono, LE:
RG -> sample
BR -> sample
16bit, mono, BE:
GR -> sample
RB -> sample
GR -> sample
Filters / effects
Built in Audacity
Ladspa
Nyquist
L2
VST
Echo
Reverb
Equalizer
Phaser
Wahwah
Delay
etc.
Action!
Convert image to RAW (IrfanView)
Import to Audacity
Select and apply filter(s):
Notch
Echo
Bass and Treble
Phaser
Wahwah
Reverb
Rember to experiment with parameters!
Export from Audacity
Import RAW (IrfanView)
Save the result
Options
operate on selected audio regions
sound generation
noise generation
mix / images mix
normalization
fade in / fade out
Part 2 - command line tools
Terminal - basics
Tools:
convert - images
sox - audio
ffmpeg - video
other:
less - display text
cd - folder change
mkdir - folder creation

Proces
convert - image to RAW
[3]-[8]
sox - RAW to WAV
[9]-[14]
Audacity - sonification
sox - WAV to RAW
[18]-[19]
convert - RAW to image
[20]
Part 3 - Animation and video
Animated GIF - process
GIF
Frames
WAVs
Batch processing
in Audacity
Frames
[16]
[26]
RAWs
[26]*
WAVs
RAWs
[27]*
[27]
[17]
Video
VIDEO
RAWVIDEO
(WAV)
AUDACITY
(WAV)
RAWVIDEO
[24]
[25]
[19]
[20]
Part 4 - Parameter automation
DAW
Processing

Thank you!
tomeksul@gmail.com
http://generateme.tumblr.com
GAC | Sonic Art Guild
Process and sonification factors
Full transcript