This is a great paper about implementing an efficient large scale parallel version of L-BFGS algorithm in MapReduce.

http://papers.nips.cc/paper/5333-large-scale-l-bfgs-using-mapreduce.pdf