PC farm disk policy
User's home dirs are on a local disk :
physerv:/srv01/
while each user has the home dir. inside his/her assigned group.
-
Back-ups are done regularily by the WICC.
PANASAS disk space: /panfs
-
This is a high performance file system. All farm nodes see
this disk via DirectFlow driver
-
Priority in the use of this space is given to files that are
processed at
relatively high speed, such as n-tuples and other files where the CPU/IO
ratio
is tilted towards IO.
-
Do not archive files here. We will consider migrating files which are not
used
regularly.
-
Although it is not backed-up, this file system is more reliable than the
NFS
mounted file systems.
/PVFS disk space
-
PVFS allows many disks to appear as one large file system, /pvfs, seen
by all the computers in the farm. The following pvfs "disks" exist:
|
size |
disks are on nodes |
| /pvfsa |
1.38TB |
EIO28 -- EIO29 |
|
|
|
|
|
|
|
|
|
-
Actual files are allocated automatically and invisibly to a specific disk
by the PVFS system. You no longer have to concern yourself about where
to put your files.
-
Each group organizes and maintains its files under a single directory in
each /pvfs "disk" for the group, e.g. /pvfsa/cgrp.
-
DO NOT gzip/gunzip files residing on the /pvfs space, because the high
I/O causes a crash of the /pvfs system. Do the compress/uncompress elsewhere
and then copy the file to /pvfs .
-
One can use the command 'u2p' to do the copy: u2p file_name /pvfs/your_group/your_dir/file_name
-
DLT input and output can be done directly to the /pvfs space.
-
This space cannot be seen outside the farm.
-
Results should be FTP'ed elsewhere or written to DLT.
-
PLEASE NOTE: This entire space is NOT BACKED-UP. PVFS is
not intended to be a reliable store. Do not store irreplaceable
data in the PVFS system.
NFS Mounted data disk space
These are RAID disks from the machines eio33-eio35 on which the previous
/pvfs "disks" have been copied,
and the mountpoints names have been kept for users convenient:
| Machine |
Mount
Point |
Size |
eio35:/bata1
eio35:/bata2 |
/pvfs
/pvfsb |
1.19
TB
1.19 TB |
| eio34:/bata2 |
/pvfs2 |
1.19
TB |
| eio33:/bata1 |
/pvfs3 |
1.19
TB |
| eio34:/bata1 |
/pvfs4 |
1.19
TB |
| eio33:/bata2 |
/pvfs5 |
1.20
TB |
| eio33:/bata1 |
/pvfs8 |
same
as /pvfs3 |
These are RAID disks from the machines eio41-eio44 on which one previous
/pvfs7 "disk" have been copied,
and the mountpoint name have been kept for users convenient:
| Machine |
Mount
Point |
Size |
| eio41: |
/d411
/d412 /d413 |
961
GB each |
| eio42: |
/d421
/d422 /d423 |
961
GB each |
| eio43: |
/d431
/d432 /d433 |
961
GB each |
| eio44: |
/d441
/d442 |
961
GB each |
| eio44:/d443/pvfs7 |
/pvfs7 |
961
GB |
| |
|
|
PHYSDSKn node disks (/data1 and /data2):
-
The priority for this space is for datasets which are used interactively
by jobs running on their respective machines.
These disks are fast. Other uses of this space are second priority.
-
This space is not backed up, but because it is on RAID disks, it
is reasonably reliable.
-
about 600GB each
-
These disks are seen by all farm nodes (automounted on first use), but
cannot be seen outside the farm
/export on PHYSERV:
-
This area is currently about 63GB.
-
This disk IS visible in the farm via NFS (automounted on first use).
/dltspool on EIO02 (the DLT autoloader and tape drive are attached to EIO02):
-
This 30GB disk is used as a staging area for writing and reading DLT tapes.
Files should be moved elsewhere or deleted as soon as possible to allow
others to use this space. On Monday to Friday mornings, at 1AM, all files
older than 72 hours are deleted.
-
All farm nodes see this disk via NFS (automounted on first use)..
/Local on physerv:
-
This disk is intended for software that is shared by several groups.
-
Examples: Objectivity, LHC++, ROOT, PBS, Linux shareware, etc.
-
It is not for software specific to a group.
-
Users do NOT have write access to this disk.
-
This disk is backed up regularly by the WI Computer Center.
/srv01 on physerv:
-
An incremental back-up of this disk is done regularly by the WI Computer
Center.
-
Groups are assigned quoted space on this disk and manage their own space.
-
This RAID disk is very reliable; it is NOT for temporary files.
-
This disk is not intended for input or output data files to the farm.
-
This disk is intended for source, documentation, executables, databases
for calibration, input parameter files, production job management, etc.
AFS
-
AFS client only software is installed on a few farm nodes so that
AFS servers around the world can be accessed.
| rafsX.rcf.bnl.gov |
Eio36 |
| desy.de |
Eio16 |
| cern.ch |
Eio15 |
Last update: September 19, 2006 by Helen Katz