Computational Science Community Wiki

Differences between revisions 1 and 28 (spanning 27 versions)
Revision 1 as of 2012-05-03 12:29:48
Size: 4812
Editor: GeorgeLeaver
Comment:
Revision 28 as of 2019-11-07 17:36:02
Size: 690
Editor: GeorgeLeaver
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= Training Background Materials = = LEGACY PAGE: Training Background Materials =
Line 3: Line 3:
''Information useful for training courses on research computing provided by IT Services''
Line 5: Line 4:
For CSF-based courses we have provided a [[attachment:ITS_ResearchTraining_CSFQuickStartGuide.pdf | Quick Start Guide|&do=get]]. == CSF and Course Materials Page ==
Line 7: Line 6:
 1. <<Anchor(getting)>>Getting the course information
  i. presentation slides (as PDF): find the course in the list at the [[CommunityLearning|Community Learning]] page. PDFs are available on each course page.
  i. Getting the course examples on the day of the course (inc. solutions): on the CSF, run the command {{{module load training/training_material}}} to download all course exercises. You should run this afresh for each course.
  i. To get the examples & solutions on your work machine, you need to use a Subversion client (see [[Technical/software#devtools|Software Development Tools]]) and "checkout" eg
   a. `svn checkout http://kato.rcs.manchester.ac.uk/svnpublic/training`


Nearly all courses are run on the Computation Shared Facility (CSF). Course attendees have access to the CSF (and help using it) until the end of the course session (10 Apr 2012). At which point you may wish to move your files from the CSF to your local machine eg
  * UNIX/Linux/MacOS: from a terminal window, use either `rsync` or `scp`. Presuming you logged in to your local machine and are in the required destination directory on your local machine:<<BR>>
  `rsync -rt `''username''`@csf.itservices.manchester.ac.uk/training ./`<<BR>>
  `scp -pr `''username''`@csf.itservices.manchester.ac.uk/training ./`
  * Windows: install winscp, connect to the CSF, then drag the training directory from the CSF pane to the local pane

The below links give further information to back up the [[attachment:ITS_ResearchTraining_CSFQuickStartGuide.pdf | Quick Start Guide|&do=get]]

 1. Accessing CSF:
  i. [[csf/UserInfo|CSF User Info]]
  i. [[Learning/UNIX | Introduction to UNIX course]] includes a slide on `ssh`
  i. [[IntroResearchComputing | Introduction to Research Computing course]] includes a fews slides & an example on `ssh`

 1. Using Linux
  i. [[UNIX | UNIX/Linux links]]
  i. [[Learning/UNIX | Introduction to UNIX course]]
 
 1. Using modules:
  i. [[csf/Software/Modules|CSF Modules]]
  i. [[attachment:Learning/Modules/ITS_modules_v1_Jan2012.pdf| Course module on Modules]], covered in the [[Learning/UNIX | Introduction to UNIX course]]

 1. Accessing Compilers on CSF
  i. See [[csf/Software/Applications|CSF Software]], in particular
   i. [[csf/Software/Applications/Compilersintel|Intel compiler]] - please use this for all courses
   i. [[csf/Software/Applications/Compilersgnu|GNU compiler]]
   i. [[csf/Software/Applications/PGI|PGI compiler]]
  i. [[ProgTechsResearchComputing | Programming Techniques for Research Computing course]] includes a fews slides & an example on using the Intel compiler and comparing its optimisation values for `-O`

 1. Compiling and Running Parallel Codes on CSF
  i. All parallel codes should be run in batch (see below). Also see the [[csf/Software/Applications/openmpi|CSF MPI Implementation (openMPI)]] and [[csf/Software/Applications/openmp|CSF OpenMP]] pages.
  i. MPI (1 or more nodes). Nodes may be connected by gigEthernet (1Gb/sec) or !InfiniBand (4xQDR on CSF which equates to 32Gb/sec). The MPI module required depends on the compiler you wish to use (eg Intel or GCC) and the interconnect between nodes. For the courses, we have 2 non-InfiniBand connected nodes and ask people to use the Intel compilers (v11.1 is current) and the only MPI implementation is v1.4.3 of OpenMPI, therefore the relevant MPI module to load is `mpi/intel-11.1/openmpi/1.4.3`. This gives access to the compilers (`mpif90`/`mpicc`) and the MPI launcher `mpirun`. The number of MPI processes is controlled by the `-np` flag to `mpirun`.
  i. OpenMP (max of 1 node). The Intel compiler supports OpenMP by use of the `-openmp` flag. No additional commands are required to run a threaded executable. The number of threads is controlled, essentially, by the `OMP_NUM_THREADS` environment variable.


 1. Makefiles (to follow)
  i. [[ProgTechsResearchComputing | Programming Techniques for Research Computing course]] includes a fews slides & an example

 1. Submitting Jobs on CSF:
  i. [[csf/UserInfo/sge|CSF Batch Information]]
  i. [[IntroResearchComputing | Introduction to Research Computing course]] includes a fews slides & an example on using SGE to submit jobs


 1. Editors available on Linux Desktop and CSF:
  i. [[Technical/software/emacs | emacs]]
  i. [[http://projects.gnome.org/gedit/ | gedit]]
  i. [[Technical/software/vi |vi]]
  i. IDEs available on Linux Desktop and CSF: (to be confirmed)

[[../|Back to the Community Learning page]]
Please note: this wiki page is a legacy page. For up-to-date information please see:
 * The [[http://ri.itservices.manchester.ac.uk/course/rcsf/|Intro to CSF Course Materials Page]]
 * The [[http://app.manchester.ac.uk/rhpc|Intro to CSF Course Booking page]]
 * The [[http://ri.itservices.manchester.ac.uk/csf3|CSF online documentation]]
 * The [[https://www.staffnet.manchester.ac.uk/staff-learning-and-development/academicandresearch/practical-skills-and-knowledge/it-skills/research-computing/research-courses/|current list of courses]] (on Staffnet) for the particular course you want.

LEGACY PAGE: Training Background Materials


CSF and Course Materials Page

Please note: this wiki page is a legacy page. For up-to-date information please see: