> BTW: I was wondering whether I could or should build just one lm using srilm for both sphinx and kaldi instead of my current approach where I build a separate lm using cmuclmtk for sphinx.
Yes, you can just use srilm. There is no need to use cmulmtk, it is outdated toolkit.
