A recent spate of polling paints a bad picture of declining support for the president from voters of color. But just how worrisome is it?