SaltConf15 - NTT America - Implementing MapReduce Workflows with SaltStack
A SaltConf15 talk by Ed Lane and David Hilton of NTT America (formerly Verio). This talk will share details on using SaltStack as a framework for implementing map-reduce style work flows and will also discuss how this same work flow pattern can be used for implementing batch flows on a cluster of minions when migrating customers to other platforms. We will also share several demos including a re-run returner which automatically reschedules any arbitrary execution module to run sequentially on a cluster of minions with minimal setup and a map-reduce bioinformatics algorithm implemented using SaltStack with no Hadoop needed.