Computational Science Community Wiki

Differences between revisions 2 and 28 (spanning 26 versions)
Revision 2 as of 2012-05-03 12:38:48
Size: 4694
Editor: GeorgeLeaver
Comment:
Revision 28 as of 2019-11-07 17:36:02
Size: 690
Editor: GeorgeLeaver
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Training Background Materials = = LEGACY PAGE: Training Background Materials =
Line 3: Line 3:
''Information useful for training courses on research computing provided by IT Services''
Line 5: Line 4:
== CSF Basics ==
For CSF-based courses we have provided a [[attachment:ITS_ResearchTraining_CSFQuickStartGuide.pdf | Quick Start Guide|&do=get]].
== CSF and Course Materials Page ==
Line 8: Line 6:
 * Getting the course examples on the day of the course (inc. solutions): on the CSF, run the following command to download all course exercises. Do this each time your attend a course to get any updates:
 {{{
module load training/training_material
}}}
 
 * To get the examples & solutions on your home or work machine, you need to use a Subversion client (see [[Technical/software#devtools|Software Development Tools]]) and do a "checkout", for example:
 {{{
svn checkout http://kato.rcs.manchester.ac.uk/svnpublic/training
}}}

== CSF in-depth ==

Nearly all courses are run on the Computation Shared Facility (CSF). Course attendees have access to the CSF (and help using it) until the end of the course session (10 Apr 2012). At which point you may wish to move your files from the CSF to your local machine eg
  * UNIX/Linux/MacOS: from a terminal window, use either `rsync` or `scp`. Presuming you logged in to your local machine and are in the required destination directory on your local machine:<<BR>>
  `rsync -rt `''username''`@csf.itservices.manchester.ac.uk/training ./`<<BR>>
  `scp -pr `''username''`@csf.itservices.manchester.ac.uk/training ./`
  * Windows: install winscp, connect to the CSF, then drag the training directory from the CSF pane to the local pane

The below links give further information to back up the [[attachment:ITS_ResearchTraining_CSFQuickStartGuide.pdf | Quick Start Guide|&do=get]]

 1. Accessing CSF:
  i. [[csf/UserInfo|CSF User Info]]
  i. [[Learning/UNIX | Introduction to UNIX course]] includes a slide on `ssh`
  i. [[IntroResearchComputing | Introduction to Research Computing course]] includes a fews slides & an example on `ssh`

 1. Using Linux
  i. [[UNIX | UNIX/Linux links]]
  i. [[Learning/UNIX | Introduction to UNIX course]]
 
 1. Using modules:
  i. [[csf/Software/Modules|CSF Modules]]
  i. [[attachment:Learning/Modules/ITS_modules_v1_Jan2012.pdf| Course module on Modules]], covered in the [[Learning/UNIX | Introduction to UNIX course]]

 1. Accessing Compilers on CSF
  i. See [[csf/Software/Applications|CSF Software]], in particular
   i. [[csf/Software/Applications/Compilersintel|Intel compiler]] - please use this for all courses
   i. [[csf/Software/Applications/Compilersgnu|GNU compiler]]
   i. [[csf/Software/Applications/PGI|PGI compiler]]
  i. [[ProgTechsResearchComputing | Programming Techniques for Research Computing course]] includes a fews slides & an example on using the Intel compiler and comparing its optimisation values for `-O`

 1. Compiling and Running Parallel Codes on CSF
  i. All parallel codes should be run in batch (see below). Also see the [[csf/Software/Applications/openmpi|CSF MPI Implementation (openMPI)]] and [[csf/Software/Applications/openmp|CSF OpenMP]] pages.
  i. MPI (1 or more nodes). Nodes may be connected by gigEthernet (1Gb/sec) or !InfiniBand (4xQDR on CSF which equates to 32Gb/sec). The MPI module required depends on the compiler you wish to use (eg Intel or GCC) and the interconnect between nodes. For the courses, we have 2 non-InfiniBand connected nodes and ask people to use the Intel compilers (v11.1 is current) and the only MPI implementation is v1.4.3 of OpenMPI, therefore the relevant MPI module to load is `mpi/intel-11.1/openmpi/1.4.3`. This gives access to the compilers (`mpif90`/`mpicc`) and the MPI launcher `mpirun`. The number of MPI processes is controlled by the `-np` flag to `mpirun`.
  i. OpenMP (max of 1 node). The Intel compiler supports OpenMP by use of the `-openmp` flag. No additional commands are required to run a threaded executable. The number of threads is controlled, essentially, by the `OMP_NUM_THREADS` environment variable.


 1. Makefiles (to follow)
  i. [[ProgTechsResearchComputing | Programming Techniques for Research Computing course]] includes a fews slides & an example

 1. Submitting Jobs on CSF:
  i. [[csf/UserInfo/sge|CSF Batch Information]]
  i. [[IntroResearchComputing | Introduction to Research Computing course]] includes a fews slides & an example on using SGE to submit jobs


 1. Editors available on Linux Desktop and CSF:
  i. [[Technical/software/emacs | emacs]]
  i. [[http://projects.gnome.org/gedit/ | gedit]]
  i. [[Technical/software/vi |vi]]
  i. IDEs available on Linux Desktop and CSF: (to be confirmed)

[[../|Back to the Community Learning page]]
Please note: this wiki page is a legacy page. For up-to-date information please see:
 * The [[http://ri.itservices.manchester.ac.uk/course/rcsf/|Intro to CSF Course Materials Page]]
 * The [[http://app.manchester.ac.uk/rhpc|Intro to CSF Course Booking page]]
 * The [[http://ri.itservices.manchester.ac.uk/csf3|CSF online documentation]]
 * The [[https://www.staffnet.manchester.ac.uk/staff-learning-and-development/academicandresearch/practical-skills-and-knowledge/it-skills/research-computing/research-courses/|current list of courses]] (on Staffnet) for the particular course you want.

LEGACY PAGE: Training Background Materials


CSF and Course Materials Page

Please note: this wiki page is a legacy page. For up-to-date information please see: