HPCI - manage cluster/cloud computing

By John Macdonald from toronto.pm
Date: Wednesday, 10 June 2015 10:30
Duration: 20 minutes
Target audience: Any
Language: English
Tags: cloud cluster computing high performance

HPCI is a new CPAN module to manage collections of jobs to be run on a cluster or cloud. The name is deliberately similar to DBI (/DBD) to show the equivalent intent - a generic interface (HPCI) that will run tasks on any type of computer collection supported by a driver (HPCD). The initial release will include drivers for SGE (Sun Grid Engine) and uni (uniprocessor - simply uses fork on the host computer; used for testing before determining that some more useful cluster/cloud is available). To the extent possible, a HPCI-using program should convert from using one type of cluster or cloud to another simply by changing the configuration parameters for the initial object create' with the rest of the interaction needed no change to the code. (There will be cluster/cloud specific attributes or mechanisms that hinder such mobility, but they only cause problems if the program uses them.)

Attended by: Andrew Griffin, Jason Hall (‎Jayce^‎), Derek Clifford, Tony Chambers, Joseph Hall, Jared Miller, Dana Jacobsen (‎danaj‎), Kevin Metcalf (‎profmetcalf‎), Fitz Elliott, Kenneth Graves (‎kag‎), Paul Seamons, Jeff Smith, Joseph Alsop, Weldon Whipple, Ryan Chaudhry, Gabriel Munoz (‎gabriel‎), Ryan Olson (‎Gimpson‎), Stephen Scaffidi (‎hercynium‎), Norman Yamada, Mike Greb (‎mikegrb‎), Thomas Sibley (‎trs‎), Rikus Goodell, Scott O'Neil, Reini Urban (‎rurban‎),