Computational Science Community Wiki

Differences between revisions 14 and 28 (spanning 14 versions)
Revision 14 as of 2012-09-26 17:02:40
Size: 5037
Editor: GeorgeLeaver
Comment:
Revision 28 as of 2019-11-07 17:36:02
Size: 690
Editor: GeorgeLeaver
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Training Background Materials = = LEGACY PAGE: Training Background Materials =
Line 3: Line 3:
''Information useful for training courses on research computing provided by IT Services''
Line 5: Line 4:
== CSF and Course Materials ==
For CSF-based courses we have provided a [[attachment:ITS_ResearchTraining_CSFQuickStartGuide_v1.3_sept2012.pdf | Quick Start Guide (pdf)|&do=get]].
You may also follow the links from the [[../#schedule|current list of courses]] for the particular course you want.
== CSF and Course Materials Page ==
Line 9: Line 6:

=== Getting the exercises and solutions ===

 * '''On the CSF''': To get the course examples on the day of the course (inc. solutions): on the CSF, run the following command to download ''all'' course exercises. This will create a directory named {{{training}}} in your home directory. Do this each time your attend a course to get any updates:
 {{{
module load training/training_material
}}}

<<Anchor(getting)>>
 * '''On your own computer''': To get the examples & solutions on your home or work machine, you need to use a Subversion client (see [[Technical/software#devtools|Software Development Tools]]) and do a "checkout", for example:
 {{{
svn checkout http://kato.rcs.manchester.ac.uk/svnpublic/training
}}}

== CSF in-depth ==
Most courses are run on the [[csf|Computation Shared Facility (CSF)]]. Course attendees have access to the CSF (and help using it) until the end of the course session. At which point you may wish to move your files from the CSF to your local machine eg
  * UNIX/Linux/MacOS: from a terminal window, use either `rsync` or `scp`. Presuming you logged in to your local machine and are in the required destination directory on your local machine:<<BR>>
  `rsync -rt `''username''`@csf.itservices.manchester.ac.uk:~/training ./`<<BR>>
  `scp -pr `''username''`@csf.itservices.manchester.ac.uk:~/training ./`
  * Windows: install winscp, connect to the CSF, then drag the training directory from the CSF pane to the local pane

The below links give further information to back up the [[attachment:ITS_ResearchTraining_CSFQuickStartGuide_v1.2_june2012.pdf | Quick Start Guide|&do=get]]

 1. Accessing CSF:
  i. [[csf/UserInfo|CSF User Info]]
  i. [[Learning/UNIX | Introduction to UNIX course]] includes a slide on `ssh`
  i. [[IntroResearchComputing | Introduction to Research Computing course]] includes a fews slides & an example on `ssh`

 1. Using Linux
  i. [[UNIX | UNIX/Linux links]]
  i. [[Learning/UNIX | Introduction to UNIX course]]
 
 1. Using modules:
  i. [[csf/Software/Modules|CSF Modules]]
  i. [[attachment:Learning/Modules/ITS_modules_v1_Jan2012.pdf| Course module on Modules]], covered in the [[Learning/UNIX | Introduction to UNIX course]]

 1. Accessing Compilers on CSF
  i. See [[csf/Software/Applications|CSF Software]], in particular
   i. [[csf/Software/Applications/Compilersintel|Intel compiler]] - please use this for all courses
   i. [[csf/Software/Applications/Compilersgnu|GNU compiler]]
   i. [[csf/Software/Applications/PGI|PGI compiler]]
  i. [[ProgTechsResearchComputing | Programming Techniques for Research Computing course]] includes a fews slides & an example on using the Intel compiler and comparing its optimisation values for `-O`

 1. Compiling and Running Parallel Codes on CSF
  i. All parallel codes should be run in batch (see below). Also see the [[csf/Software/Applications/openmpi|CSF MPI Implementation (openMPI)]] and [[csf/Software/Applications/openmp|CSF OpenMP]] pages.
  i. MPI (1 or more nodes). Nodes may be connected by gigEthernet (1Gb/sec) or !InfiniBand (4xQDR on CSF which equates to 32Gb/sec). The MPI module required depends on the compiler you wish to use (eg Intel or GCC) and the interconnect between nodes. For the courses, we have 2 non-InfiniBand connected nodes and ask people to use the Intel compilers (v12.0 is current) and the only MPI implementation is v1.6 of OpenMPI, therefore the relevant MPI module to load is `mpi/intel-12.0/openmpi/1.6`. This gives access to the compilers (`mpif90`/`mpicc`) and the MPI launcher `mpirun`. The number of MPI processes is controlled by the `-np` flag to `mpirun`.
  i. OpenMP (max of 1 node). The Intel compiler supports OpenMP by use of the `-openmp` flag. No additional commands are required to run a threaded executable. The number of threads is controlled, essentially, by the `OMP_NUM_THREADS` environment variable.


 1. Makefiles (to follow)
  i. [[ProgTechsResearchComputing | Programming Techniques for Research Computing course]] includes a fews slides & an example

 1. Submitting Jobs on CSF:
  i. [[csf/UserInfo/sge|CSF Batch Information]]
  i. [[IntroResearchComputing | Introduction to Research Computing course]] includes a fews slides & an example on using SGE to submit jobs


 1. Editors available on Linux Desktop and CSF:
  i. [[Technical/software/emacs | emacs]]
  i. [[http://projects.gnome.org/gedit/ | gedit]]
  i. [[Technical/software/vi |vi]]
  i. IDEs available on Linux Desktop and CSF: (to be confirmed)

[[../|Back to the Community Learning page]]
Please note: this wiki page is a legacy page. For up-to-date information please see:
 * The [[http://ri.itservices.manchester.ac.uk/course/rcsf/|Intro to CSF Course Materials Page]]
 * The [[http://app.manchester.ac.uk/rhpc|Intro to CSF Course Booking page]]
 * The [[http://ri.itservices.manchester.ac.uk/csf3|CSF online documentation]]
 * The [[https://www.staffnet.manchester.ac.uk/staff-learning-and-development/academicandresearch/practical-skills-and-knowledge/it-skills/research-computing/research-courses/|current list of courses]] (on Staffnet) for the particular course you want.

LEGACY PAGE: Training Background Materials


CSF and Course Materials Page

Please note: this wiki page is a legacy page. For up-to-date information please see: