Log in Page Discussion History Go to the site toolbox

Lab Cluster

From Engineering Grid Wiki

Contents

Lab Cluster

cecload.png cecram.png


Updated hourly - see full cluster status at the Lab Grid Status page

About

The Lab Cluster is an installation of Grid Engine across the CEC Linux Lab. If you wish to use the lab, please have your faculty advisor email EIT Support for access.

The Lab Cluster is 30 quad-core machines, each with 4GB of RAM. Please keep the RAM limitations in mind as you design your jobs.

The fact that the grid is in an active lab means users need to keep several things in mind:

  • This grid is used occasionally for educational purposes. When such a class is in session, those jobs have priority.
  • The Linux Lab machines power themselves down after 10 minutes of inactivity. This will not affect cluster jobs - even if they're producing no apparent load, the machine will stay on. However, there may be a delay of up to 10 minutes while the queue master powers up machines to serve your jobs after you submit.
  • If a student logs into a lab machine at the console, your job will be suspended. This may adversely affect parallel computations, or any sort of submission where future jobs depend on the completion of previous jobs.
  • Since it is a lab, students have physical access to the machines. Machines may be turned off, rebooted, the power plug pulled, or the ethernet plug removed without warning.
  • The lab is interconnected via Gigabit Ethernet. Highly parallel computations may suffer as a result. If you can hold your parallelism to 4 nodes, the Grid will fill up one machine at a time and keep all four jobs local to a machine.
  • Your job storage is limited by your CEC home directory quota. If you have special needs for disk space, please speak with EIT. Extra disk space is available outside of your home directory. However, please keep in mind:
    • This space is very limited.
    • This space is allotted only temporarily, and you must not use it for long term storage - only while your jobs are active.
    • Other students and classes use this space. You must pre-plan your disk usage and notify EIT of your space needs.

Finally, this lab cluster is being provided as a free benefit to students without other means. If you use this grid to complete research, obtain a grant, or finish a thesis, please send Mark Bober (bober {at} wustl.edu) a link to the finished paper, the grant announcement, or other record of achievement. The best way to improve this resource outside of the normal lab refresh schedule is to show it as a valuable resource for the School.

Thank you.

Applications

In general, any application installed in the Linux Lab (including Grid) is available.

Usage

The Lab submit host is 'gridengine.int.cec.wustl.edu' - you can SSH to that from Grid, Hive, the Lab, or the CEC VPN.

There are two queues - all.q (default) and a 'parallel.q', for parallel computation.

It's very important to use the "-cwd" flag in your qsub script or command line, and to be in your intended working directory when you submit your job.

Site Toolbox:

Personal tools
This page was last modified on 18 February 2013, at 14:01. - This page has been accessed 6,664 times. - Disclaimers - About Engineering Grid Wiki