The risks would be a misalignment between the training data and your business data. Business apps with clever acronyms that have strong associations with sentiment would be the major risk.

The value-add of such a system is unclear at best. The IT help desk ticketing systems I am familiar will all have a review/feedback component. The IT staff already know all the A-holes. Are you trying to empirically prove who the A-holes are?