Sponsors
Sponsor Products
zfs record sizes for vfx work flows and other zfs optimisations
posted by Brian Krusic  on Jan. 2, 2018, 1:40 p.m. (2 years, 6 months, 12 days ago)
2 Responses     0 Plus One's     0 Comments  
Hi,
Ive had very good results with 1M record size and 1M NFS r/w size.
Well, I mean as good as it can be.  All in all nothing is ever really fast enough :)
- Brian
Every day is a gift Thats why they call it the present"
On Jan 2, 2018, at 1:35 PM, greg whynott <greg.whynott@gmail.com> wrote:
default/choose..  words.  ;)

On Tue, Jan 2, 2018 at 12:05 PM, Ben De Luca <bdeluca@gmail.com> wrote:
zfs doesnt choose, its set on the file system and defaults to 128k 
On 2 January 2018 at 17:24, greg whynott <greg.whynott@gmail.com> wrote:
No R&D but for what it is worth...

Do your own IO profile.  What you guys are doing in your shop may not be the same elsewhere and certainly not everyone is in the same boat or uses storage verbatim.  Best bet is to monitor for a period of time and build your shops own profile. 

It is also a good idea if possible to build FS's for different use cases.   Example,  a FS for your database servers might have a record size of 8k,  whereas a FS with big files on it (over 1 megabyte) may be set at 128k. 

My final thought would be in most cases with VFX related work,  you are dealing with big files,  a 128k record size may be the best bet, or let ZFS choose itself.

greg





On Mon, Jan 1, 2018 at 7:16 PM, Ben De Luca <bdeluca@gmail.com> wrote:
Hi,     I wondered if any one had done the RND on record size for VFX workflows? I was looking at optimising one particular workflow with backups and virtual tapes and record size was hugely significant. I am guessing it will be for vfx work flows also, but wondered if any one had actually RND'd it. 


To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


Thread Tags:
  discuss-at-studiosysadmins 

Response from Brian Krusic @ Jan. 3, 2018, 4:55 p.m.
Hi,
Well Ive disabled sync as in my experience it's not needed.  I imagine that you are cringing about now :)
However Ive tested my servers live by unplugging power to actually see what happens and playing dumb about it.  Of course during times of non delivery and at the beginning of a shows.
I also have replicated hosts and test disaster every few months w/o telling any one about it.
ZFS is COW (copy on write) so the only thing lost during this condition is data in ARC that hasn't committed to disk.
I believe one can loose the FS only if sufficient disks in RAIDZ# are not avalyaibe.
Ive even run them 100% w/o reliability issues or too much slow down in IO.
At any rate to your question, I have no idea.
- Brian
Every day is a gift Thats why they call it the present"
On Jan 3, 2018, at 4:21 PM, greg whynott <greg.whynott@gmail.com> wrote:
Thank you -  

I wonder how much the different sizes would contribute when you have a sufficient amount of safe ZIL configured with sync=always (asynchronous) set..

-g
 

On Wed, Jan 3, 2018 at 8:07 AM, Brian Krusic <brian@krusic.com> wrote:
Hi,
Ive kept it default with my VMs which range from DB, web, mail to lic servers.  Ive read that 8K sizes are good for EXSI and 4K for KVM but I have't run any tests.
The 1M runs very well in VFX workflows.
- Brian
Every day is a gift Thats why they call it the present"
On Jan 2, 2018, at 10:13 PM, greg whynott <greg.whynott@gmail.com> wrote:
Hi Brian and Dan,  are you using ZFS for VM storage with those settings too or are you speaking VFX pipeline related workloads?  I assume you are addressing the original question but just curious if that is the default you use. 

On Tue, Jan 2, 2018 at 8:39 PM, Dan Mons <dmons@cuttingedge.com.au> wrote:
On 3 January 2018 at 04:38, Brian Krusic <brian@krusic.com> wrote:
Ive had very good results with 1M record size and 1M NFS r/w size.

Ditto.

-Dan

This email is confidential and solely for the use of the intended recipient.  If you have received this email in error please notify the author and delete it immediately. This email is not to be distributed without the author's written consent. Unauthorised forwarding, printing, copying or use is strictly prohibited and may be a breach of copyright. Any views expressed in this email are those of the individual sender unless specifically stated to be the views of Cutting Edge Post Pty Ltd (Cutting Edge). Although this email has been sent in the belief that it is virus-free, it is the responsibility of the recipient to ensure that it is virus free. No responsibility is accepted by Cutting Edge for any loss or damage arising in any way from receipt or use of this email.  This email may contain legally privileged information and privilege is not waived if you have received this email in error.

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


0 Plus One's     0 Comments  
   

Response from Brian Krusic @ Jan. 3, 2018, 8:10 a.m.
Hi,
Ive kept it default with my VMs which range from DB, web, mail to lic servers.  Ive read that 8K sizes are good for EXSI and 4K for KVM but I have't run any tests.
The 1M runs very well in VFX workflows.
- Brian
Every day is a gift Thats why they call it the present"
On Jan 2, 2018, at 10:13 PM, greg whynott <greg.whynott@gmail.com> wrote:
Hi Brian and Dan,  are you using ZFS for VM storage with those settings too or are you speaking VFX pipeline related workloads?  I assume you are addressing the original question but just curious if that is the default you use. 

On Tue, Jan 2, 2018 at 8:39 PM, Dan Mons <dmons@cuttingedge.com.au> wrote:
On 3 January 2018 at 04:38, Brian Krusic <brian@krusic.com> wrote:
Ive had very good results with 1M record size and 1M NFS r/w size.

Ditto.

-Dan

This email is confidential and solely for the use of the intended recipient.  If you have received this email in error please notify the author and delete it immediately. This email is not to be distributed without the author's written consent. Unauthorised forwarding, printing, copying or use is strictly prohibited and may be a breach of copyright. Any views expressed in this email are those of the individual sender unless specifically stated to be the views of Cutting Edge Post Pty Ltd (Cutting Edge). Although this email has been sent in the belief that it is virus-free, it is the responsibility of the recipient to ensure that it is virus free. No responsibility is accepted by Cutting Edge for any loss or damage arising in any way from receipt or use of this email.  This email may contain legally privileged information and privilege is not waived if you have received this email in error.

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


0 Plus One's     0 Comments