Since your residence card expired after you left Japan, the two years until then will not be counted for your PR application as the number of years required for a permanent residence permit. You will need to reset this to zero and start building your stay record from scratch. According to the Immigration Services Agency's guidelines on their website, the condition is that the applicant must continue to reside in Japan for a certain period of time, depending on the situation.
