DFW UNIX Users Group
SearchWiki:
Recent Changes Printable View Page History Edit Page
Content Last Modified on April 15, 2010, at 08:13 PM CST

Main.FileSystems History

Hide minor edits - Show changes to markup

April 15, 2010, at 08:13 PM by RPhilley
Changed lines 1-176 from:

5PecgF <a href="http://gzpndfyqsgxv.com/">gzpndfyqsgxv</a>, [url=http://kkzbqyxaswpw.com/]kkzbqyxaswpw[/url], [link=http://upoazwjvvonh.com/]upoazwjvvonh[/link], http://qqnrjlxvrslz.com/

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached, the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead, the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes) to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site, an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

April 15, 2010, at 06:27 AM by 119.63.137.116
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached, the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead, the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes) to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site, an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

5PecgF <a href="http://gzpndfyqsgxv.com/">gzpndfyqsgxv</a>, [url=http://kkzbqyxaswpw.com/]kkzbqyxaswpw[/url], [link=http://upoazwjvvonh.com/]upoazwjvvonh[/link], http://qqnrjlxvrslz.com/

March 04, 2010, at 03:07 PM by rdpearson
Changed lines 1-176 from:

Pg8WEH? <a href="http://ojquckolkasg.com/">ojquckolkasg</a>, [url=http://wiihukpadywn.com/]wiihukpadywn[/url], [link=http://ozreebehohys.com/]ozreebehohys[/link], http://ekrnwftmkmkb.com/

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached, the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead, the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes) to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site, an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

October 01, 2009, at 06:27 PM by 193.171.32.6
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached, the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead, the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes) to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site, an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

Pg8WEH? <a href="http://ojquckolkasg.com/">ojquckolkasg</a>, [url=http://wiihukpadywn.com/]wiihukpadywn[/url], [link=http://ozreebehohys.com/]ozreebehohys[/link], http://ekrnwftmkmkb.com/

August 20, 2009, at 09:38 AM by EricSchnoebelen
Changed lines 1-176 from:

iZeR8m <a href="http://uxtfsymqpdsi.com/">uxtfsymqpdsi</a>, [url=http://ysbdvorgezwm.com/]ysbdvorgezwm[/url], [link=http://egfzwcutxgcg.com/]egfzwcutxgcg[/link], http://sgfxktjbglcy.com/

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached, the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead, the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes) to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site, an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

August 20, 2009, at 02:37 AM by 174.133.97.90
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

iZeR8m <a href="http://uxtfsymqpdsi.com/">uxtfsymqpdsi</a>, [url=http://ysbdvorgezwm.com/]ysbdvorgezwm[/url], [link=http://egfzwcutxgcg.com/]egfzwcutxgcg[/link], http://sgfxktjbglcy.com/

August 16, 2009, at 10:18 AM by Stuart Yarus
Changed lines 1-176 from:

wvxrgE <a href="http://iiflfdaprava.com/">iiflfdaprava</a>, [url=http://zxrjxwgdptwb.com/]zxrjxwgdptwb[/url], [link=http://ezoponhnvxss.com/]ezoponhnvxss[/link], http://ycnlkwrrmxdm.com/

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

August 16, 2009, at 06:16 AM by lboxdyqqign
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

wvxrgE <a href="http://iiflfdaprava.com/">iiflfdaprava</a>, [url=http://zxrjxwgdptwb.com/]zxrjxwgdptwb[/url], [link=http://ezoponhnvxss.com/]ezoponhnvxss[/link], http://ycnlkwrrmxdm.com/

August 09, 2009, at 10:16 AM by EricSchnoebelen
Changed lines 1-176 from:

FOIc8G? <a href="http://pyvonoxqnegc.com/">pyvonoxqnegc</a>, [url=http://vqbjguqlnvra.com/]vqbjguqlnvra[/url], [link=http://vvcsnqqeysjj.com/]vvcsnqqeysjj[/link], http://djzrtiwqjetq.com/

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

August 08, 2009, at 07:37 PM by 212.103.139.75
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

FOIc8G? <a href="http://pyvonoxqnegc.com/">pyvonoxqnegc</a>, [url=http://vqbjguqlnvra.com/]vqbjguqlnvra[/url], [link=http://vvcsnqqeysjj.com/]vvcsnqqeysjj[/link], http://djzrtiwqjetq.com/

June 04, 2009, at 10:53 AM by EricSchnoebelen
Changed lines 1-176 from:

Cool!

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

June 04, 2009, at 12:21 AM by Anton
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

Cool!

October 11, 2008, at 11:35 AM by EricSchnoebelen
Changed lines 1-176 from:

LNu9Kq? <a href="http://jkirdpsrbgws.com/">jkirdpsrbgws</a>, [url=http://yajekjcgtkdm.com/]yajekjcgtkdm[/url], [link=http://imlifaziowvd.com/]imlifaziowvd[/link], http://iesdlrrsvuhp.com/

to:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

October 10, 2008, at 11:23 PM by nkveiiyso
Changed lines 1-176 from:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

JFS File System

Under Construction

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

ZFS File System

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307
ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

ZFS File System Update Added 082307

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

Cluster File Systems - Under Construction



Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



Grow/Shrink File Systems with LVM (table)

Growing, Shrinking File Systems with LVMUnder Construction
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


File Systems Lower Metrics



File Formats

List of File Formats - Wikipedia

File Extensions

File Extensions - Filext.com
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
About Git - Wikipedia

to:

LNu9Kq? <a href="http://jkirdpsrbgws.com/">jkirdpsrbgws</a>, [url=http://yajekjcgtkdm.com/]yajekjcgtkdm[/url], [link=http://imlifaziowvd.com/]imlifaziowvd[/link], http://iesdlrrsvuhp.com/

January 24, 2008, at 12:18 AM by rdpearson
Changed line 149 from:
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
to:
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
[Source] http://oss.sgi.com/projects/xfs/faq.html
August 23, 2007, at 10:19 AM by rdpearson
Changed line 70 from:

The *NIX DIstro page lists OpenSolaris based distros. These should run ZFS native Added 082307

to:

The *NIX DIstro page lists OpenSolaris based distros that should run ZFS native Added 082307

August 23, 2007, at 10:18 AM by rdpearson
Changed lines 70-71 from:

The *NIX DIstro page lists OpenSolaris based distros. These should run ZFS native
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006

to:

The *NIX DIstro page lists OpenSolaris based distros. These should run ZFS native Added 082307
Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006 Added 082307

Changed line 85 from:

ZFS File System Update

to:

ZFS File System Update Added 082307

August 23, 2007, at 10:14 AM by rdpearson
Added line 70:

The *NIX DIstro page lists OpenSolaris based distros. These should run ZFS native

Changed lines 84-91 from:
 ZFS File System Update Added 082207

Courtesy of: Brad Knowles <brad@shub-internet.org>, Consultant & Author LinkedIn? Profile: <http://tinyurl.com/y8kpxu> Slides from Invited Talks: <http://tinyurl.com/tj6q4>

to:

ZFS File System Update

Courtesy of:
Brad Knowles <brad@shub-internet.org>, Consultant & Author
LinkedIn Profile: <http://tinyurl.com/y8kpxu>
Slides from Invited Talks: <http://tinyurl.com/tj6q4>

Changed lines 93-95 from:

For a detailed comparison of various different configurations specific to the Thumper, see <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>. I particularly like his calculations comparing the IOPs? performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

to:

For a detailed comparison of various different configurations specific to the Thumper, see
<http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>.
I particularly like his calculations comparing the IOPs performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

Changed lines 101-104 from:

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs? rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek? Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

to:

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Changed lines 106-107 from:

including links to DTrace? tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

to:

including links to DTrace tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

Changed lines 109-123 from:

to:



August 23, 2007, at 09:55 AM by rdpearson
Changed lines 83-123 from:

to:
 ZFS File System Update Added 082207

Courtesy of: Brad Knowles <brad@shub-internet.org>, Consultant & Author LinkedIn? Profile: <http://tinyurl.com/y8kpxu> Slides from Invited Talks: <http://tinyurl.com/tj6q4>

I've actually done a survey of ZFS articles recently and I found a number that were very interesting:

For a detailed comparison of various different configurations specific to the Thumper, see <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance>. I particularly like his calculations comparing the IOPs? performance of a 73GB 2.5" Seagate Saviio SAS drive against a 750GB 3.5" Seagate Barracude SATA drive.

There's also a link to <http://blogs.sun.com/relling/entry/zfs_raid_recommendations_space_performance1> which has the "all-in" version of the charts.

Then, for the specific application of NFS on ZFS, I found the page at <http://developers.sun.com/solaris/articles/nfs_zfs.html> which talks about using NFS on ZFS.

And the ZFS Best Practices wiki at <http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide> links to an interesting page at <http://blogs.sun.com/roch/category/ZFS> which has all sorts of other interesting stuff, which I believe includes a way of calculating how you should size your zpools and your RAID-Z groups to achieve a given IOPs? rate.

The "ZFS and Database Recommendations" page in the ZFS Best Practices wiki also has some recent tips regarding the use of ztune for setting prefetches and concurrent I/O values. There's also a ZFS Storage Pools Recommendations section, which might be interesting. I also noted a mention of Sun StorageTek? Availability Suite (AVS), which might or might not be useful in terms of volume replication, point-in-time snapshots, or even continuous data replication. Or, if you want to avoid AVS, you might be able to play around with ZFS send & receive, as Mark Round does at <http://www.markround.com/archives/38-ZFS-Replication.html#extended>.

Eric Kustarz has some interesting ZFS benchmarking & tuning tips on his page at <http://blogs.sun.com/erickustarz/category/ZFS>, including links to DTrace? tools to help you look deeply into the ZFS code and see where it's spending all its time, and how you can look at and tune vq_max_pending, etc....

I also found an interesting page on Lustre, ZFS, and Linux at <http://liquidat.wordpress.com/2007/07/17/lustre-runs-zfs-on-linux/>.

August 23, 2007, at 09:25 AM by rdpearson
Changed line 70 from:

Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006

to:

Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006

August 23, 2007, at 09:21 AM by rdpearson
Added line 70:

Adrian Cockcroft on Sun ZFS and Thumper (x4500) - August 06, 2006

May 07, 2007, at 06:43 AM by rdpearson
Changed line 1 from:

File Systems Reference Links

to:

File Systems Reference Links

April 05, 2007, at 05:15 PM by rdpearson
Changed lines 112-113 from:

Grow/Shrink File Systems with LVM (table) Under Construction

to:

Grow/Shrink File Systems with LVM (table)

Changed line 115 from:
Growing, Shrinking File Systems with LVM
to:
Growing, Shrinking File Systems with LVMUnder Construction
April 05, 2007, at 05:03 PM by rdpearson
Changed line 119 from:
XFS Yes No   
to:
XFS Yes No  You can NOT make a XFS partition smaller online.
The only way to shrink is to do a complete dump, mkfs and restore.
An XFS filesystem may be enlarged by using xfs_growfs(8).
If using partitions, you need to have free space after this partition to do so.
Remove partition, recreate it larger with the exact same starting point.
Run xfs_growfs to make the partition larger.
Note - editing partition tables is a dangerous pastime,
so back up your filesystem before doing so.
Using XFS filesystems on top of a volume manager makes this a lot easier.
Deleted lines 126-129:

April 05, 2007, at 04:57 PM by rdpearson
Changed lines 32-33 from:

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

to:

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

Added lines 112-132:

Grow/Shrink File Systems with LVM (table) Under Construction

Growing, Shrinking File Systems with LVM
Logical volumes can be reduced in size as well as increased. However, it is very important to remember to reduce the size of the file system or whatever is residing in the volume before shrinking the volume itself, otherwise you risk losing data.

Overview - http://satlug.jvpappas.net/
Extend (grow) - http://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
Reduce (shrink) - http://www.tldp.org/HOWTO/LVM-HOWTO/reducelv.html
File System Grow Shrink Tool(s) Comments
ext2,3 Yes Yes   
ReiserFS, Reiser4 Yes Yes   
XFS Yes No   
JFS Yes No   
OpenGFS Yes No   
     
     
NTFS     
ZFS Yes Yes   
     


April 05, 2007, at 03:41 PM by rdpearson
Added lines 18-42:

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Sharing



ntfs-3g for Linux

How to install ntfs-3g for Fedora Core 6? - Laci's packages for Fedora Core

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

File Systems



Deleted lines 51-55:

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

Changed lines 81-90 from:

Future of File Systems

John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

to:


Cluster File Systems - Under Construction

Added lines 86-114:

Cluster File Systems Presentation

Special Presentation. For the January meeting we will have a presentation by Dr. Dominique Heger from Fortuitous Technologies
in Austin on filesystems that can be used in clusters.
The following is his abstract of the talk:

Traditional, local file systems support a persistent name space. A local file system views devices as being locally attached,
the devices are not shared, and hence there is no need in the file system design to enforce device- sharing semantics. Instead,
the focus is on aggressively caching and aggregating file system operations to improve performance by economizing on the number
of actual disk accesses required for each file system operation. Newer networking technologies allow multiple machines (nodes)
to share storage devices. IBMs General Parallel File System (GPFS) or Red Hats Global File System are representing distributed
file system technologies that are taking a shared, network-attached storage approach. These file systems are built on the premise
that a shared disk file system has to exist within the context of a cluster infrastructure, and has to provide proper error handling
and recovery, as well as the best performance possible (performance, availability, and scalability features are key requirements).

The goal of this presentation is to elaborate on the terminology's surrounding the file systems that are being used in a Linux
cluster based environment. Some of the terms actually overlap, which may result in misconceptions and confusion on the user site,
an issue that is addressed in this talk. Further, this presentation discusses the classification of some the applications that may
be executed on a Linux cluster. To illustrate cluster file system technology, IBMs GPFS and Red Hats GFS file system are introduced
in more detail. The last part of the presentation briefly focuses on Sun Microsystems ZFS file system. While ZFS today is considered
a local file system solution, some of the features embedded in the design have the potential to revolutionize the file system industry.

File Systems Management



File Systems Lower Metrics



February 23, 2007, at 08:46 AM by rdpearson
Changed lines 8-13 from:

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems
Comparing XFS, ReiserFS, and ext3 by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

to:

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
File Systems of Operating Systems - Filesystems - Excellent
Comparing XFS, ReiserFS, and ext3 - by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

February 23, 2007, at 08:35 AM by rdpearson
Changed lines 10-11 from:

Comparing XFS, ReiserFS, and ext3 by Daniel Robbins of Gentoo (2001) - IBM developerWorks

to:

File Systems of Operating Systems - Filesystems
Comparing XFS, ReiserFS, and ext3 by Daniel Robbins of Gentoo (2001) - IBM developerWorks

September 21, 2006, at 02:28 AM by rdpearson
Changed lines 6-11 from:

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
Comparing XFS, ReiserFS, and ext3 by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

to:

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
Comparing XFS, ReiserFS, and ext3 by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Changed lines 14-16 from:

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

to:

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

Changed lines 18-22 from:

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

to:

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

Changed lines 27-30 from:

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

to:

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

Changed lines 32-33 from:

OpenGFS - SourceForge

to:

OpenGFS - SourceForge

Changed lines 35-39 from:

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM

to:

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM developerWorks

Changed lines 41-43 from:

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

to:

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

Changed lines 45-47 from:

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

to:

XFS: A high-performance journaling filesystem
Who's using XFS? Linux Distributions shipping XFS

Changed lines 49-60 from:

ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

to:

ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

Changed lines 65-69 from:

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

to:

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

Changed lines 73-74 from:

List of File Formats - Wikipedia

to:

List of File Formats - Wikipedia

Changed lines 76-77 from:

File Extensions - Filext.com
File Extensions - Webopedia

to:

File Extensions - Filext.com
File Extensions - Webopedia

Changed lines 79-80 from:

File Allocation Table - Wikipedia

to:

File Allocation Table - Wikipedia

Changed lines 82-83 from:

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

to:

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

Changed lines 85-86 from:

Git - Wikipedia
About Git - Wikipedia

to:

Git - Wikipedia
About Git - Wikipedia

September 21, 2006, at 01:18 AM by rdpearson
Changed lines 61-62 from:

to:

Added lines 69-70:


September 21, 2006, at 01:14 AM by rdpearson
Changed lines 45-46 from:

[[http://oss.sgi.com/projects/xfs/users.html | Who's using XFS? Linux Distributions shipping XFS]

to:

Who's using XFS? Linux Distributions shipping XFS

Changed line 74 from:

http://filext.com/index.htm File Extensions

to:

File Extensions - Filext.com

Changed lines 83-84 from:

Git - Wikipedia
[[http://git.or.cz/about.html | About Git] - Wikipedia

to:

Git - Wikipedia
About Git - Wikipedia

September 21, 2006, at 01:07 AM by rdpearson
Added lines 46-84:

ZFS File System

ZFS: the last word in file systems
ZFS: OpenSolaris Community
100 Mirrored Filesystems in 5 minutes
ZFS Source Tour
General discussion about ZFS
ZFS on FUSE/Linux - Jeff Bonwick's Weblog
RAID-Z - Jeff Bonwick's Weblog
Coolest new storage product of the year: Sun's X4500
Jonathan gives us an early look at Thumper
Do-it-yourself X4500?
Home/SOHO NAS projects using ZFS - Eric Boutilier Weblog

Future of File Systems


John Siracusa of Ars Technica's View - Very interesting

ZFS On Apple?s Leopard: Drops Of Fuel On The Embers - Foreword - August 25th, 2006 by Robin Harris, StorageMojo
Time Machine and the future of the file system - August 15, 2006, Fascinating - John Siracusa, Ars Technica
Who's minding the store? - November 20, 2005 - John Siracusa, Ars Technica
The case for RAID - November 05, 2005 - John Siracusa, Ars Technica

File Formats

List of File Formats - Wikipedia

File Extensions

http://filext.com/index.htm File Extensions
File Extensions - Webopedia

FAT (File Allocation Table)

File Allocation Table - Wikipedia

File System Hierarchy Standard

Filesystem Hierarchy Standard - Filesystem Hierarchy Standard Group

SCM-RCS-VCS

Git - Wikipedia
[[http://git.or.cz/about.html | About Git] - Wikipedia

September 21, 2006, at 01:03 AM by rdpearson
Added lines 22-45:

JFS File System

Under Construction

NTFS for Linux

NTFS for Linux - SourceForge
Captive: The first free NTFS read/write filesystem for GNU/Linux - Jan Kratochvil Project
NTFS for Linux - Home Page

OpenGFS File System

OpenGFS - SourceForge

ReiserFS File System

Namesys (authors of ReiserFS)
ReiserFS v3 information (this is what most distros support during install time)
ReiserFS v4 information (next generation... has not been adopted into the main kernel yet)
Using ReiserFS (v4) with Linux - IBM

Special File Systems

tmpfs - like a ramdisk, but different - IBM developerWorks
Journalling Flash File System version 2 (JFFS2) - Wikipedia

XFS File System

XFS: A high-performance journaling filesystem
[[http://oss.sgi.com/projects/xfs/users.html | Who's using XFS? Linux Distributions shipping XFS]

September 21, 2006, at 12:58 AM by rdpearson
Added lines 1-21:

File Systems Reference Links



File Systems Comparison

File System Primer - Novell - Excellent
Comparison of File Systems - Wikipedia
Comparing XFS, ReiserFS, and ext3 by Daniel Robbins of Gentoo (2001) - IBM developerWorks
Filesystems (ext3, reiser, xfs, jfs) comparison on Debian Etch - Debian Administration

Bench Marking File Systems

Benchmarking Filesystems Part I by Justin Piszcz - Linux Gazette
Benchmarking Filesystems Part II by Justin Piszcz - Linux Gazette

FUSE - Filesystem in Userspace

FUSE (Linux) - Wikipedia
With FUSE it is possible to implement a fully functional filesystem in a userspace program - FUSE Homepage
FUSE makes it possible to implement a filesystem in a userspace program - FUSE Project page on SourceForge
FUSE Wiki

WikiHelp
Recent Changes Printable View Page History Edit Page
Special thanks for hosting our website to Central Iowa (Model) Railroad!