Performance (Network and MP) with AE

i've read through lot of threads, , seem remember seeing i've not been able find again, i'm hoping can pointers overall , contribute back.

 

i'm using ae process lot of footage feature. other tool sets include nuke , modo, ae useful because it's scriptable , dark energy plug in works it. i'm having use fix camera hardware issues too. it's been me. when dealing 10,000s frames performance tweaks can make big difference me

 

my observations/questions are:

 

i'm running few different workstations , dedicated render nodes around shared storage. @ moment shared storage around synology 1812+ , 513 nas on gigabit ethernet, can't quite run fibre san, looking @ bigger nas (the 3612xs offers 4xgige , 2x10gige).

 

one observation have processing split different ae projects , each project links 50-100 source prores , avchd files, each project takes around 10 minutes open , think that's slow. project , source files on nas. render results local disc, sped things about 20% network storage reading. question ae doing these source qt movies takes long open, scanning them through or something?

 

one output of pipeline 2k openexr files, , remember reading big caveats rendering file based mp in ae creates storm of reads/writes. haven't been able find thread again?

 

my cpu utilisation seems quite low , network around 12%. in other words i'm not sure bottle necks or how go finding them. whether there tools out there anaylse network traffic - bandwidth? latency? i've tweaked many mp settings, each thread has lots of ram, running 2 4 cpus never managed saturate aspect of processing. don't know taking time. in first stage files being written qt , know qt has huge overhead in terms of writing (compared avi example). again, techniques understanding , troubleshooting useful hear?

 

so pointers greatfully receieved!

 

cheers

paul

not sure expect. call bottlenecks normal behavior. file i/o clip-based formats linear , while may take resources keep 100 files open , decode them prores, retrieving single frame processed single clip out of 100 minor in terms of network usage , processor usage. sure, mediacaches , disk cache figure in, @ least avchd stuff , yes, ae verifies file integrity, it's normal , expected. likewise, there's enough threads here on forum explaining when use mp , when not, when revert single processes , when not, effects , features work , ones not , on. that's how ae or of other stuff works. you'll have live it. there no way enforce anything. once have converted footage image sequences, of improve, though.

 

mylenium

More discussions in After Effects

adobe