Use a specific font for emojis

i’d like to use the pretty Segoe UI Symbol emoji. I installed the font by copying it over from my windows install, and awesomely enough, my system falls back to it for all emoji that my main font doesn’t have. But all (black and white) emoji existing in my main font are used. How can I tell fontconfig to prefer “Segoe UI Symbol” for certain unicode ranges (the ones defined [here](http://en.wikipedia.org/wiki/Emoji)) ?