I'm confused - are the Conservatives Whigs or are they Tories?

According to the history of the party said, it gives two differing soruces. On one hands Conservatives come from the Royalist Tories. On the other hand, it came from the Peelites, a fraction of Conservatives that completely broke off and joined the Whigs.
Which one is accepted and which one is fact?