Linux Appeal - Linux Command Line Tools for Fast File Processing

Sign up online for Linux Appeal now! (credit and debit cards accepted)

Date: 

31 January 2019

Location: 

CEH Lancaster, Lancaster Environment Centre, Library Avenue, Bailrigg, Lancaster, LA1 4AP Location map & travel directions

We may run this course in Bangor or Wallingford later in 2019 subject to demand - please express your interest for other locations here.

Cost:

£ 299 (standard)

£229 (students) 

Short Course Description:

This one-day course will give you an introduction to Linux and its ability to process big data files fast.  A short exercise will show the speed and efficiency of Linux tools compared to other data processing tools such as R or Excel.

You will log in to a training account and familiarise yourself with the Linux environment. You will learn to use basic commands such as ls, cd, mv, rm, less, and history.  We will discuss different types of regular expressions as used in Linux commands. You will do practical exercises and we encourage you to bring your own dataset.

You will learn advanced Linux tools such as grep, find, rsync, diff, cut, rename, awk and sed commands.  We will explore bash scripting. The course will end with a final file merging task you can solve in several different ways.  We will invite you to produce your own solution to produce the desired result.

Course Objectives:

  • Familiarise with the Linux environment and its ability to process large amounts of data fast with minimal resources. 
  • Apply knowledge to process and manage data files more efficiently and reliably.

Learning outcome:

You will have greater confidence and skills in using LINUX to prepare data for analysis and reformatting files. This will save you a lot of time in future data analysis

Accommodation:

Accommodation is not included in the price. We can advise you on suitable accommodation specific to the location nearer the time

Places:

12

Level:

Beginner

There are no pre-requisites for the Linux appeal course. Experience of data processing is advantageous.

Course Leader:

Milo Brooks Technical Development and Field Instrumentation Engineer, Centre for Ecology & Hydrology.

Milo has a BSc in Mathematics and Computer Science from McGill University.  He has over 25 years of experience in data processing, data management and applications development.  In the past 5 years, he has used Linux tools and scripts to synchronise, process and aggregate CEH datasets for optimal performance, reliability and security.  Milo is an open source technology enthusiast using it for environmental science data processing at work as well as for music, animation, CAD and 3D printing at home.

Target Audience:

  • MSc & PhD students
  • Early career researchers  and other academics
  • Those interested in Big Data and the internet of things

Sign up online for Linux Appeal now! (credit and debit cards accepted)

More detail & background:

From its humble origins as a project to put users in control of their own computing, Linux is now everywhere in our daily life.  It has been adapted to more platforms than any other in history.  When we consider smartphones and embedded systems, Linux is the most widely installed operating system in the world.  It is used almost exclusively by web and cloud computing servers.  All 500 of the world's fastest supercomputers run on Linux. It sounds too good to be true that a community developed technology can be so influential, but it is!  Join the millions of users worldwide and take part in the ever-growing open source movement.