In this video from ISC'14, Xavier Vigouroux from the Bull Center for Excellence in Parallel Programming describes how programming tools from Allinea Software enable debugging at scale.
Learn more:
http://www.bull.com/extreme-computing...
and
http://allinea.com