I believe [this website][1] has a guide to the solution that you're looking for.

[1]: http://www.talkandroid.com/guides/beginner/how-to-turn-off-okay-google-always-listening-feature-in-the-google-experience-launcher/