He does have a reason if nobody's love mattered to him except his father.
Pent abdicated his position as Count Reglay in order to continue Athos' studies; I was under the impression that he had moved to Arcadia to do so, since that was where Athos lived, and where I assume that all of his books would be, too; Pent could hardly continue Athos' studies without those.
That said, it would have been nice to meet him and Louise in Arcadia.