You can't add just any app to that list. It sounds like you've already found the multi-window list of apps in Settings → Display →(the one you get by clicking Multi windowEdit). That list only contains apps that have been written using Samsung's vendor-specific library to support the multi-window feature. (I suspect that the feature also has special-case code to enable the Google apps in the list such as Hangouts, but that's just speculation on my part.)
You can only make an app appear in that list by contacting the developer of the app and asking them to support it. It may be an up-hill struggle to convince them to invest time and make their app larger to support a feature used by a minority of users on one manufacturer's devices.