So it was seriously loose, but it just wouldn't come apart. I ended up banging on it with a 24oz dead blow hammer to get it to slide out. I don't have any picture of me hitting it with the hammer. That would have been good.
Now I can see what was hanging it up. The joint had very little glue still functioning, if it ever did. But part of the dove tail pin that was glued good, held the whole joint together until it broke away forming a "key". That's why it was loose, but took some force to slide it apart.